[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:56:58.939232   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43933
I20260709 12:56:58.941645   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:56:58.943185   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:58.966784   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:58.971751   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:58.970475   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:00.237411   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1264 milliseconds
I20260709 12:57:00.237711   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:57:00.239656   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:00.240010   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:00.240247   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601820240222 us; error 0 us; skew 500 ppm
I20260709 12:57:00.241218   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:00.249413   431 webserver.cc:533] Webserver started at http://127.0.107.254:35231/ using document root <none> and password file <none>
I20260709 12:57:00.250837   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:00.251278   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:00.252043   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:00.261201   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "26579fb058554cb5b5ef10819f1b820c"
format_stamp: "Formatted at 2026-07-09 12:57:00 on dist-test-slave-fc6v"
I20260709 12:57:00.272204   431 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.006s	sys 0.005s
I20260709 12:57:00.279436   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:00.281119   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:57:00.281594   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "26579fb058554cb5b5ef10819f1b820c"
format_stamp: "Formatted at 2026-07-09 12:57:00 on dist-test-slave-fc6v"
I20260709 12:57:00.282162   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:00.348842   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:00.350790   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:57:00.351362   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:00.465353   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43933
I20260709 12:57:00.465473   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43933 every 8 connection(s)
I20260709 12:57:00.476022   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:00.504877   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c: Bootstrap starting.
I20260709 12:57:00.512979   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:00.515401   498 log.cc:826] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c: Log is configured to *not* fsync() on all Append() calls
I20260709 12:57:00.523116   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c: No bootstrap required, opened a new log
I20260709 12:57:00.550681   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26579fb058554cb5b5ef10819f1b820c" member_type: VOTER }
I20260709 12:57:00.551434   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:00.551837   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26579fb058554cb5b5ef10819f1b820c, State: Initialized, Role: FOLLOWER
I20260709 12:57:00.553119   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26579fb058554cb5b5ef10819f1b820c" member_type: VOTER }
I20260709 12:57:00.554423   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:00.554798   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:00.555214   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:00.560530   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26579fb058554cb5b5ef10819f1b820c" member_type: VOTER }
I20260709 12:57:00.561566   498 leader_election.cc:304] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26579fb058554cb5b5ef10819f1b820c; no voters: 
I20260709 12:57:00.564836   498 leader_election.cc:290] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:00.565218   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:00.570008   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 1 LEADER]: Becoming Leader. State: Replica: 26579fb058554cb5b5ef10819f1b820c, State: Running, Role: LEADER
I20260709 12:57:00.571879   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26579fb058554cb5b5ef10819f1b820c" member_type: VOTER }
I20260709 12:57:00.573271   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:00.588038   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26579fb058554cb5b5ef10819f1b820c. Latest consensus state: current_term: 1 leader_uuid: "26579fb058554cb5b5ef10819f1b820c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26579fb058554cb5b5ef10819f1b820c" member_type: VOTER } }
I20260709 12:57:00.589018   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:00.589104   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26579fb058554cb5b5ef10819f1b820c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26579fb058554cb5b5ef10819f1b820c" member_type: VOTER } }
I20260709 12:57:00.589733   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:00.595709   510 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:00.614903   510 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:00.618517   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:00.639925   510 catalog_manager.cc:1383] Generated new cluster ID: 7309dd51d97a45c28f5d5b9a7804210b
I20260709 12:57:00.640280   510 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:00.670161   510 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:00.672706   510 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:00.691042   510 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c: Generated new TSK 0
I20260709 12:57:00.692376   510 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:00.750638   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:00.765595   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:00.763402   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:00.770068   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:00.772691   431 server_base.cc:1061] running on GCE node
I20260709 12:57:00.773658   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:00.773880   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:00.774010   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601820773999 us; error 0 us; skew 500 ppm
I20260709 12:57:00.774705   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:00.781635   431 webserver.cc:533] Webserver started at http://127.0.107.193:35719/ using document root <none> and password file <none>
I20260709 12:57:00.782401   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:00.782652   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:00.783072   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:00.784624   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
format_stamp: "Formatted at 2026-07-09 12:57:00 on dist-test-slave-fc6v"
I20260709 12:57:00.792449   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:57:00.798746   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:00.800211   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 12:57:00.800761   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
format_stamp: "Formatted at 2026-07-09 12:57:00 on dist-test-slave-fc6v"
I20260709 12:57:00.801313   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:00.842705   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:00.844985   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:00.849049   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:00.855790   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:00.856207   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:00.856565   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:00.856817   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:01.001993   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41325
I20260709 12:57:01.002084   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41325 every 8 connection(s)
I20260709 12:57:01.012305   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:01.031759   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:01.040194   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:01.044052   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:01.045890   431 server_base.cc:1061] running on GCE node
I20260709 12:57:01.046893   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:01.047183   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:01.047390   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601821047367 us; error 0 us; skew 500 ppm
I20260709 12:57:01.048084   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:01.051748   431 webserver.cc:533] Webserver started at http://127.0.107.194:35087/ using document root <none> and password file <none>
I20260709 12:57:01.052517   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:01.052858   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:01.053296   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:01.055094   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "a0e4768b69624a7688aa2e6571d3612f"
format_stamp: "Formatted at 2026-07-09 12:57:01 on dist-test-slave-fc6v"
I20260709 12:57:01.057479   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43933
I20260709 12:57:01.058115   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:01.059741   591 heartbeater.cc:507] Master 127.0.107.254:43933 requested a full tablet report, sending...
I20260709 12:57:01.062403   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:57:01.064543   463 ts_manager.cc:194] Registered new tserver with Master: b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325)
I20260709 12:57:01.069288   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:01.069334   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51256
I20260709 12:57:01.070509   431 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:57:01.070925   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "a0e4768b69624a7688aa2e6571d3612f"
format_stamp: "Formatted at 2026-07-09 12:57:01 on dist-test-slave-fc6v"
I20260709 12:57:01.071280   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:01.092697   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:01.094326   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:01.096154   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:01.100332   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:01.100611   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:01.100916   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:01.101150   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:01.250157   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39681
I20260709 12:57:01.250474   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39681 every 8 connection(s)
I20260709 12:57:01.265297   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:01.277612   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:01.282017   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43933
I20260709 12:57:01.282529   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:01.283622   666 heartbeater.cc:507] Master 127.0.107.254:43933 requested a full tablet report, sending...
I20260709 12:57:01.286468   463 ts_manager.cc:194] Registered new tserver with Master: a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:01.288470   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51266
W20260709 12:57:01.293305   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:01.293706   431 server_base.cc:1061] running on GCE node
W20260709 12:57:01.294503   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:01.295783   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:01.296064   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:01.296347   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601821296318 us; error 0 us; skew 500 ppm
I20260709 12:57:01.297180   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:01.300489   431 webserver.cc:533] Webserver started at http://127.0.107.195:33719/ using document root <none> and password file <none>
I20260709 12:57:01.301205   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:01.301637   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:01.302011   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:01.303807   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "3693351f2d8c4966ace8678c7dee8a0a"
format_stamp: "Formatted at 2026-07-09 12:57:01 on dist-test-slave-fc6v"
I20260709 12:57:01.310467   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:57:01.315402   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:01.316479   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:57:01.316890   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "3693351f2d8c4966ace8678c7dee8a0a"
format_stamp: "Formatted at 2026-07-09 12:57:01 on dist-test-slave-fc6v"
I20260709 12:57:01.317288   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:01.345331   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:01.347229   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:01.350904   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:01.355273   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:01.355620   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:57:01.355919   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:01.356146   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:01.495329   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39501
I20260709 12:57:01.495497   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39501 every 8 connection(s)
I20260709 12:57:01.521513   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43933
I20260709 12:57:01.521987   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:01.522940   740 heartbeater.cc:507] Master 127.0.107.254:43933 requested a full tablet report, sending...
I20260709 12:57:01.525243   463 ts_manager.cc:194] Registered new tserver with Master: 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:01.525440   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015228095s
I20260709 12:57:01.526790   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51274
I20260709 12:57:01.595312   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51284:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:01.600284   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:01.744338   630 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb2796d56824d07b83c91365dd89cae (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:01.743134   631 tablet_service.cc:1511] Processing CreateTablet for tablet c743e3b5dc2a4978bb0148d69b1908b8 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:01.750741   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb2796d56824d07b83c91365dd89cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.752529   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c743e3b5dc2a4978bb0148d69b1908b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.742095   629 tablet_service.cc:1511] Processing CreateTablet for tablet 1526529dee304f71b1349535c332fd1a (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:01.762534   628 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3162d1a46f409cbe48127ff90f9b21 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:01.768138   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1526529dee304f71b1349535c332fd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.776412   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3162d1a46f409cbe48127ff90f9b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.775810   627 tablet_service.cc:1511] Processing CreateTablet for tablet 7a01c8684ff24ab5854ef7950afb8f3d (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:01.781137   626 tablet_service.cc:1511] Processing CreateTablet for tablet 796a64ee4e934365a130c0fb135dd6ea (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:01.784446   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a64ee4e934365a130c0fb135dd6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.792863   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a01c8684ff24ab5854ef7950afb8f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.802114   625 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0c28da4b254263bee394f5f399ec2a (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:01.819363   704 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb2796d56824d07b83c91365dd89cae (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:01.822755   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb2796d56824d07b83c91365dd89cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.825094   702 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3162d1a46f409cbe48127ff90f9b21 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:01.825213   703 tablet_service.cc:1511] Processing CreateTablet for tablet 1526529dee304f71b1349535c332fd1a (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:01.815111   705 tablet_service.cc:1511] Processing CreateTablet for tablet c743e3b5dc2a4978bb0148d69b1908b8 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:01.838410   700 tablet_service.cc:1511] Processing CreateTablet for tablet 796a64ee4e934365a130c0fb135dd6ea (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:01.841120   699 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0c28da4b254263bee394f5f399ec2a (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:01.847007   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0c28da4b254263bee394f5f399ec2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.846884   701 tablet_service.cc:1511] Processing CreateTablet for tablet 7a01c8684ff24ab5854ef7950afb8f3d (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:01.854005   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1526529dee304f71b1349535c332fd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.856513   698 tablet_service.cc:1511] Processing CreateTablet for tablet 82a918679c844e899bba4c4408530bf8 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:01.855516   630 tablet_service.cc:1511] Processing CreateTablet for tablet 82a918679c844e899bba4c4408530bf8 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:01.860900   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a918679c844e899bba4c4408530bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.861454   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a64ee4e934365a130c0fb135dd6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.863346   758 tablet_bootstrap.cc:492] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:01.879176   556 tablet_service.cc:1511] Processing CreateTablet for tablet c743e3b5dc2a4978bb0148d69b1908b8 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:01.882863   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3162d1a46f409cbe48127ff90f9b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.895328   624 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1e725f90274bcfad511c676e0cd755 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:01.905601   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c743e3b5dc2a4978bb0148d69b1908b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.909732   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c743e3b5dc2a4978bb0148d69b1908b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.911466   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1e725f90274bcfad511c676e0cd755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.912357   697 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1e725f90274bcfad511c676e0cd755 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:01.893193   555 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb2796d56824d07b83c91365dd89cae (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:01.908152   554 tablet_service.cc:1511] Processing CreateTablet for tablet 1526529dee304f71b1349535c332fd1a (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:01.914083   549 tablet_service.cc:1511] Processing CreateTablet for tablet 82a918679c844e899bba4c4408530bf8 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:01.922196   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a01c8684ff24ab5854ef7950afb8f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.926286   550 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0c28da4b254263bee394f5f399ec2a (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:01.930521   551 tablet_service.cc:1511] Processing CreateTablet for tablet 796a64ee4e934365a130c0fb135dd6ea (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:01.939520   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb2796d56824d07b83c91365dd89cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.936887   553 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3162d1a46f409cbe48127ff90f9b21 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:01.934448   552 tablet_service.cc:1511] Processing CreateTablet for tablet 7a01c8684ff24ab5854ef7950afb8f3d (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:01.942513   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a918679c844e899bba4c4408530bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.943522   548 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1e725f90274bcfad511c676e0cd755 (DEFAULT_TABLE table=test-workload [id=30d76b7510264acfaeecdcbafe5651df]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:01.946625   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1e725f90274bcfad511c676e0cd755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.942513   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1526529dee304f71b1349535c332fd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.960817   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a918679c844e899bba4c4408530bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.967926   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0c28da4b254263bee394f5f399ec2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.957890   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0c28da4b254263bee394f5f399ec2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.996443   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a01c8684ff24ab5854ef7950afb8f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.996230   758 tablet_bootstrap.cc:654] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.025065   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a64ee4e934365a130c0fb135dd6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:02.037909   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1e725f90274bcfad511c676e0cd755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:02.062249   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3162d1a46f409cbe48127ff90f9b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:02.080785   591 heartbeater.cc:499] Master 127.0.107.254:43933 was elected leader, sending a full tablet report...
I20260709 12:57:02.102571   759 tablet_bootstrap.cc:492] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:02.136744   758 tablet_bootstrap.cc:492] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:02.137427   758 ts_tablet_manager.cc:1403] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.300s	user 0.021s	sys 0.028s
I20260709 12:57:02.151777   761 tablet_bootstrap.cc:492] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.158468   758 raft_consensus.cc:359] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.159441   758 raft_consensus.cc:385] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.159822   758 raft_consensus.cc:740] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.161567   758 consensus_queue.cc:260] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.169338   759 tablet_bootstrap.cc:654] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.172152   761 tablet_bootstrap.cc:654] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.182471   666 heartbeater.cc:499] Master 127.0.107.254:43933 was elected leader, sending a full tablet report...
I20260709 12:57:02.188891   758 ts_tablet_manager.cc:1434] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.051s	user 0.013s	sys 0.013s
I20260709 12:57:02.190034   758 tablet_bootstrap.cc:492] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:02.207273   761 tablet_bootstrap.cc:492] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:02.207911   761 ts_tablet_manager.cc:1403] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.009s
I20260709 12:57:02.218334   761 raft_consensus.cc:359] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.218950   761 raft_consensus.cc:385] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.219264   761 raft_consensus.cc:740] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.219820   759 tablet_bootstrap.cc:492] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:02.220352   759 ts_tablet_manager.cc:1403] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.005s
I20260709 12:57:02.220162   761 consensus_queue.cc:260] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.227785   740 heartbeater.cc:499] Master 127.0.107.254:43933 was elected leader, sending a full tablet report...
I20260709 12:57:02.228091   758 tablet_bootstrap.cc:654] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.225939   759 raft_consensus.cc:359] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.230693   761 ts_tablet_manager.cc:1434] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 12:57:02.229444   759 raft_consensus.cc:385] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.232158   759 raft_consensus.cc:740] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.233421   761 tablet_bootstrap.cc:492] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.233436   759 consensus_queue.cc:260] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.244328   759 ts_tablet_manager.cc:1434] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 12:57:02.245448   761 tablet_bootstrap.cc:654] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.251585   759 tablet_bootstrap.cc:492] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
W20260709 12:57:02.262652   741 tablet.cc:2406] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:02.272194   766 raft_consensus.cc:493] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.273182   766 raft_consensus.cc:515] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.279264   766 leader_election.cc:290] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.297091   758 tablet_bootstrap.cc:492] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:02.297966   758 ts_tablet_manager.cc:1403] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.031s
I20260709 12:57:02.304557   759 tablet_bootstrap.cc:654] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.306365   758 raft_consensus.cc:359] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.307194   758 raft_consensus.cc:385] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.307750   758 raft_consensus.cc:740] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.309751   758 consensus_queue.cc:260] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.312124   758 ts_tablet_manager.cc:1434] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:57:02.314028   758 tablet_bootstrap.cc:492] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:02.315747   761 tablet_bootstrap.cc:492] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:02.316496   761 ts_tablet_manager.cc:1403] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.027s
I20260709 12:57:02.322873   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:02.323982   715 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 0.
I20260709 12:57:02.326947   531 leader_election.cc:304] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:02.328675   769 raft_consensus.cc:2804] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.329131   769 raft_consensus.cc:493] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.329505   769 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.330473   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:02.331369   641 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 0.
I20260709 12:57:02.338271   769 raft_consensus.cc:515] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.338455   761 raft_consensus.cc:359] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.340644   761 raft_consensus.cc:385] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.341507   761 raft_consensus.cc:740] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.343740   769 leader_election.cc:290] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.344498   759 tablet_bootstrap.cc:492] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:02.345687   759 ts_tablet_manager.cc:1403] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.013s
I20260709 12:57:02.344620   761 consensus_queue.cc:260] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.346397   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:02.346985   715 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.348852   761 ts_tablet_manager.cc:1434] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.005s
I20260709 12:57:02.345168   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:02.349793   641 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.349989   761 tablet_bootstrap.cc:492] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.351852   759 raft_consensus.cc:359] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.352763   759 raft_consensus.cc:385] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.353091   759 raft_consensus.cc:740] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.354105   759 consensus_queue.cc:260] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.356897   759 ts_tablet_manager.cc:1434] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:57:02.358112   759 tablet_bootstrap.cc:492] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:02.359987   761 tablet_bootstrap.cc:654] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.366858   759 tablet_bootstrap.cc:654] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.375957   761 tablet_bootstrap.cc:492] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:02.377360   761 ts_tablet_manager.cc:1403] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 12:57:02.385761   761 raft_consensus.cc:359] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.386656   761 raft_consensus.cc:385] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.386978   761 raft_consensus.cc:740] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.387884   761 consensus_queue.cc:260] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.393268   715 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 1.
I20260709 12:57:02.396787   531 leader_election.cc:304] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:02.397178   758 tablet_bootstrap.cc:654] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.398080   769 raft_consensus.cc:2804] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.398805   769 raft_consensus.cc:697] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:02.399066   759 tablet_bootstrap.cc:492] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:02.399962   769 consensus_queue.cc:237] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.399770   759 ts_tablet_manager.cc:1403] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.013s
I20260709 12:57:02.403862   761 ts_tablet_manager.cc:1434] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 12:57:02.405292   761 tablet_bootstrap.cc:492] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.407335   759 raft_consensus.cc:359] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.408388   759 raft_consensus.cc:385] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.408747   759 raft_consensus.cc:740] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.409960   759 consensus_queue.cc:260] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.413282   759 ts_tablet_manager.cc:1434] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:57:02.414763   759 tablet_bootstrap.cc:492] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:02.417191   641 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 1.
I20260709 12:57:02.427928   766 raft_consensus.cc:493] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.432242   766 raft_consensus.cc:515] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.438241   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:02.438503   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:02.438922   759 tablet_bootstrap.cc:654] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.439415   715 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 0.
W20260709 12:57:02.441987   529 leader_election.cc:343] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.442641   766 leader_election.cc:290] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.431931   761 tablet_bootstrap.cc:654] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.443105   531 leader_election.cc:304] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:02.444291   766 raft_consensus.cc:2804] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.444576   758 tablet_bootstrap.cc:492] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:02.444768   766 raft_consensus.cc:493] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.445219   766 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.445195   758 ts_tablet_manager.cc:1403] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.006s
I20260709 12:57:02.462396   463 catalog_manager.cc:5697] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 0 to 1, leader changed from <none> to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.460973   758 raft_consensus.cc:359] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.468743   758 raft_consensus.cc:385] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.469619   758 raft_consensus.cc:740] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.467617   766 raft_consensus.cc:515] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.471935   766 leader_election.cc:290] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.472981   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:02.473181   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:02.473819   715 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.476029   758 consensus_queue.cc:260] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.477137   759 tablet_bootstrap.cc:492] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:02.478510   759 ts_tablet_manager.cc:1403] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.009s
I20260709 12:57:02.478488   641 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.482098   759 raft_consensus.cc:359] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.482579   715 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 1.
I20260709 12:57:02.482955   759 raft_consensus.cc:385] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.483304   759 raft_consensus.cc:740] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.483943   531 leader_election.cc:304] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:02.484230   759 consensus_queue.cc:260] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.485061   766 raft_consensus.cc:2804] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.485723   766 raft_consensus.cc:697] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:02.486665   766 consensus_queue.cc:237] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.487290   759 ts_tablet_manager.cc:1434] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:02.487735   641 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 1.
I20260709 12:57:02.488590   759 tablet_bootstrap.cc:492] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:02.491834   761 tablet_bootstrap.cc:492] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:02.492509   761 ts_tablet_manager.cc:1403] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.013s
I20260709 12:57:02.496789   761 raft_consensus.cc:359] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.497628   761 raft_consensus.cc:385] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.497982   761 raft_consensus.cc:740] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.499071   758 ts_tablet_manager.cc:1434] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.005s
I20260709 12:57:02.500919   758 tablet_bootstrap.cc:492] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:02.502604   761 consensus_queue.cc:260] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.508747   761 ts_tablet_manager.cc:1434] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:57:02.509915   761 tablet_bootstrap.cc:492] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.525552   765 raft_consensus.cc:493] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.526288   761 tablet_bootstrap.cc:654] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.526201   765 raft_consensus.cc:515] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.533995   765 leader_election.cc:290] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:02.535008   759 tablet_bootstrap.cc:654] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.562646   758 tablet_bootstrap.cc:654] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.591482   765 raft_consensus.cc:493] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.592155   765 raft_consensus.cc:515] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.597561   765 leader_election.cc:290] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:02.598937   766 raft_consensus.cc:493] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.600019   766 raft_consensus.cc:515] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.612191   769 raft_consensus.cc:493] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.623839   762 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.624552   762 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.619444   769 raft_consensus.cc:515] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.625435   766 leader_election.cc:290] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.630338   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:02.631031   762 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.633982   769 leader_election.cc:290] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
W20260709 12:57:02.649194   529 leader_election.cc:343] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.655900   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:02.670945   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
W20260709 12:57:02.675314   529 leader_election.cc:343] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.679994   758 tablet_bootstrap.cc:492] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:02.680617   758 ts_tablet_manager.cc:1403] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.016s
I20260709 12:57:02.673106   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
W20260709 12:57:02.695829   531 leader_election.cc:343] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.696626   531 leader_election.cc:304] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b138f41df8ec40a9b18dbe6f7eecc731; no voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:02.697288   758 raft_consensus.cc:359] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.697657   769 raft_consensus.cc:2749] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:02.698103   758 raft_consensus.cc:385] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.698474   758 raft_consensus.cc:740] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
W20260709 12:57:02.698132   531 leader_election.cc:343] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.700203   531 leader_election.cc:304] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b138f41df8ec40a9b18dbe6f7eecc731; no voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:02.701007   769 raft_consensus.cc:2749] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:02.703044   761 tablet_bootstrap.cc:492] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:02.706769   761 ts_tablet_manager.cc:1403] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.197s	user 0.011s	sys 0.029s
I20260709 12:57:02.710258   761 raft_consensus.cc:359] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.711180   761 raft_consensus.cc:385] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.715735   758 consensus_queue.cc:260] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.711566   761 raft_consensus.cc:740] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.722288   758 ts_tablet_manager.cc:1434] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.007s
I20260709 12:57:02.726996   759 tablet_bootstrap.cc:492] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:02.729578   759 ts_tablet_manager.cc:1403] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.241s	user 0.040s	sys 0.025s
I20260709 12:57:02.731243   758 tablet_bootstrap.cc:492] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:02.731699   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:02.730548   761 consensus_queue.cc:260] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.739264   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:02.734364   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
W20260709 12:57:02.746627   679 leader_election.cc:343] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:02.747920   678 leader_election.cc:343] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:02.748842   679 leader_election.cc:343] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.749365   679 leader_election.cc:304] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a; no voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:02.750769   765 raft_consensus.cc:2749] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:02.744932   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:02.751456   759 raft_consensus.cc:359] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.749485   761 ts_tablet_manager.cc:1434] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.008s
I20260709 12:57:02.754603   761 tablet_bootstrap.cc:492] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.752992   641 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 0.
W20260709 12:57:02.752540   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:02.753291   759 raft_consensus.cc:385] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.757030   678 leader_election.cc:304] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:02.762565   765 raft_consensus.cc:2804] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.763211   765 raft_consensus.cc:493] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.760541   759 raft_consensus.cc:740] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.763857   765 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.771039   758 tablet_bootstrap.cc:654] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.773934   759 consensus_queue.cc:260] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.778781   759 ts_tablet_manager.cc:1434] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:57:02.780081   759 tablet_bootstrap.cc:492] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:02.779959   769 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.780584   769 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.781320   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:02.781968   565 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 0.
I20260709 12:57:02.762308   462 catalog_manager.cc:5697] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 0 to 1, leader changed from <none> to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.786906   605 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:02.787158   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:02.788174   641 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 0.
I20260709 12:57:02.788827   762 raft_consensus.cc:2804] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.789217   762 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.789593   762 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.790304   529 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:02.792512   766 raft_consensus.cc:2804] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.792619   761 tablet_bootstrap.cc:654] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.793013   766 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.794730   766 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.802887   769 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.803184   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
W20260709 12:57:02.805449   531 leader_election.cc:343] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.808887   762 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.815146   769 consensus_queue.cc:1048] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.802333   765 raft_consensus.cc:515] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.819525   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:02.828934   759 tablet_bootstrap.cc:654] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.824457   766 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.835896   565 raft_consensus.cc:2393] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a0e4768b69624a7688aa2e6571d3612f in current term 1: Already voted for candidate b138f41df8ec40a9b18dbe6f7eecc731 in this term.
I20260709 12:57:02.835630   769 consensus_queue.cc:1048] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.836551   762 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:02.838925   765 leader_election.cc:290] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:02.840993   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:02.841610   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:02.842497   640 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.876478   766 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
W20260709 12:57:02.855258   606 leader_election.cc:343] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.878052   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:02.855839   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
W20260709 12:57:02.906608   606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:39501, user_credentials={real_user=slave}} blocked reactor thread for 56485.8us
I20260709 12:57:02.870839   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:02.903231   640 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 1.
I20260709 12:57:02.908757   759 tablet_bootstrap.cc:492] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:02.910815   759 ts_tablet_manager.cc:1403] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.006s
W20260709 12:57:02.910686   531 leader_election.cc:343] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.904912   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
W20260709 12:57:02.912592   679 leader_election.cc:343] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:02.913655   606 leader_election.cc:343] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.908757   758 tablet_bootstrap.cc:492] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:02.914933   759 raft_consensus.cc:359] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.919541   759 raft_consensus.cc:385] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.920096   759 raft_consensus.cc:740] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.920756   639 raft_consensus.cc:2393] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b138f41df8ec40a9b18dbe6f7eecc731 in current term 1: Already voted for candidate a0e4768b69624a7688aa2e6571d3612f in this term.
I20260709 12:57:02.921077   761 tablet_bootstrap.cc:492] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:02.920959   759 consensus_queue.cc:260] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.921600   761 ts_tablet_manager.cc:1403] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.167s	user 0.024s	sys 0.022s
I20260709 12:57:02.918699   758 ts_tablet_manager.cc:1403] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.190s	user 0.035s	sys 0.022s
I20260709 12:57:02.923218   529 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b138f41df8ec40a9b18dbe6f7eecc731; no voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:02.925906   793 raft_consensus.cc:2749] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:02.931597   766 consensus_queue.cc:1048] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.934402   759 ts_tablet_manager.cc:1434] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:57:02.933956   761 raft_consensus.cc:359] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.934989   761 raft_consensus.cc:385] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.935344   761 raft_consensus.cc:740] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.936053   759 tablet_bootstrap.cc:492] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:02.936014   758 raft_consensus.cc:359] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.937819   758 raft_consensus.cc:385] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.936796   761 consensus_queue.cc:260] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.938905   758 raft_consensus.cc:740] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.944825   758 consensus_queue.cc:260] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:02.950137   761 ts_tablet_manager.cc:1434] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.005s
I20260709 12:57:02.951169   793 consensus_queue.cc:1048] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.952136   761 tablet_bootstrap.cc:492] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:02.956593   759 tablet_bootstrap.cc:654] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.961804   758 ts_tablet_manager.cc:1434] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 12:57:02.963455   758 tablet_bootstrap.cc:492] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:02.970130   605 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f; no voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:02.975672   758 tablet_bootstrap.cc:654] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.979286   762 raft_consensus.cc:2749] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:57:02.980722   605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41325, user_credentials={real_user=slave}} blocked reactor thread for 130568us
I20260709 12:57:02.984396   678 leader_election.cc:304] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:02.987980   797 raft_consensus.cc:2804] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.990995   765 raft_consensus.cc:493] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.996563   765 raft_consensus.cc:515] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.004015   765 leader_election.cc:290] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:03.005277   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.011628   565 raft_consensus.cc:2468] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 0.
I20260709 12:57:03.005541   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
W20260709 12:57:03.014763   678 leader_election.cc:343] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:03.017432   762 raft_consensus.cc:493] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.017091   797 raft_consensus.cc:697] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:03.026212   762 raft_consensus.cc:515] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.017583   679 leader_election.cc:304] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:03.033906   808 raft_consensus.cc:2804] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:03.034989   808 raft_consensus.cc:493] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:03.041317   761 tablet_bootstrap.cc:654] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.046852   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.049259   762 leader_election.cc:290] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:03.038111   808 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:03.051471   605 leader_election.cc:343] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:03.052538   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:03.053264   715 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 0.
I20260709 12:57:03.063279   759 tablet_bootstrap.cc:492] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:03.063158   606 leader_election.cc:304] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:03.064977   759 ts_tablet_manager.cc:1403] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.020s
I20260709 12:57:03.026872   797 consensus_queue.cc:237] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.069432   806 raft_consensus.cc:2804] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:03.069826   759 raft_consensus.cc:359] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.070272   806 raft_consensus.cc:493] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:03.070684   759 raft_consensus.cc:385] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.070904   806 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.071074   759 raft_consensus.cc:740] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.072199   759 consensus_queue.cc:260] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.079344   759 ts_tablet_manager.cc:1434] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:57:03.088629   759 tablet_bootstrap.cc:492] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:03.119205   765 raft_consensus.cc:493] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.132372   765 raft_consensus.cc:515] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.136956   806 raft_consensus.cc:515] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.139150   761 tablet_bootstrap.cc:492] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:03.141674   806 leader_election.cc:290] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:03.142319   761 ts_tablet_manager.cc:1403] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.190s	user 0.022s	sys 0.047s
I20260709 12:57:03.143671   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:03.144598   565 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.145637   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.147009   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:03.148896   715 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.149461   761 raft_consensus.cc:359] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.150235   761 raft_consensus.cc:385] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.150997   761 raft_consensus.cc:740] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.152190   761 consensus_queue.cc:260] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.153472   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:03.154966   761 ts_tablet_manager.cc:1434] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
W20260709 12:57:03.155398   678 leader_election.cc:343] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:03.156168   761 tablet_bootstrap.cc:492] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:03.156457   765 leader_election.cc:290] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:03.147018   566 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 0.
I20260709 12:57:03.158291   679 leader_election.cc:304] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:03.160336   765 raft_consensus.cc:2804] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:03.160758   765 raft_consensus.cc:493] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:03.160818   758 tablet_bootstrap.cc:492] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:03.161432   758 ts_tablet_manager.cc:1403] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.198s	user 0.027s	sys 0.051s
I20260709 12:57:03.138092   808 raft_consensus.cc:515] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.163267   765 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.167006   758 raft_consensus.cc:359] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.167759   759 tablet_bootstrap.cc:654] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.168062   758 raft_consensus.cc:385] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.168447   758 raft_consensus.cc:740] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.169731   715 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 1.
I20260709 12:57:03.170008   758 consensus_queue.cc:260] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.173020   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:03.161314   461 catalog_manager.cc:5697] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:03.176045   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:03.174247   765 raft_consensus.cc:515] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.177560   606 leader_election.cc:304] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:03.176048   565 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 1.
I20260709 12:57:03.175410   808 leader_election.cc:290] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
W20260709 12:57:03.180584   678 leader_election.cc:343] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:03.181900   765 leader_election.cc:290] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:03.182471   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:03.183104   565 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.183223   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:03.183764   806 raft_consensus.cc:2804] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:03.183885   639 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.182653   761 tablet_bootstrap.cc:654] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.178447   566 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.184664   758 ts_tablet_manager.cc:1434] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:57:03.194489   758 tablet_bootstrap.cc:492] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:03.207046   759 tablet_bootstrap.cc:492] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:03.207713   759 ts_tablet_manager.cc:1403] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.008s
I20260709 12:57:03.202584   639 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 1.
I20260709 12:57:03.203408   566 raft_consensus.cc:2468] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 1.
I20260709 12:57:03.210464   678 leader_election.cc:304] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:03.210176   806 raft_consensus.cc:697] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:03.216091   765 raft_consensus.cc:2804] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:03.216974   765 raft_consensus.cc:697] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:03.217549   565 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 1.
I20260709 12:57:03.218012   765 consensus_queue.cc:237] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.225536   679 leader_election.cc:304] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:03.226963   806 consensus_queue.cc:237] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.228125   808 raft_consensus.cc:2804] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:03.228777   808 raft_consensus.cc:697] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:03.229835   808 consensus_queue.cc:237] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.228912   761 tablet_bootstrap.cc:492] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:03.231611   761 ts_tablet_manager.cc:1403] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.007s
I20260709 12:57:03.236249   758 tablet_bootstrap.cc:654] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.237460   761 raft_consensus.cc:359] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.237846   759 raft_consensus.cc:359] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.238425   761 raft_consensus.cc:385] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.238597   759 raft_consensus.cc:385] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.238842   761 raft_consensus.cc:740] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.238953   759 raft_consensus.cc:740] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.240049   759 consensus_queue.cc:260] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.247603   759 ts_tablet_manager.cc:1434] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 12:57:03.249148   759 tablet_bootstrap.cc:492] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731: Bootstrap starting.
I20260709 12:57:03.259136   759 tablet_bootstrap.cc:654] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.263163   761 consensus_queue.cc:260] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.271867   761 ts_tablet_manager.cc:1434] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:57:03.273527   761 tablet_bootstrap.cc:492] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: Bootstrap starting.
I20260709 12:57:03.279628   758 tablet_bootstrap.cc:492] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:03.276500   461 catalog_manager.cc:5697] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 0 to 1, leader changed from <none> to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:03.282243   758 ts_tablet_manager.cc:1403] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.004s
I20260709 12:57:03.287657   758 raft_consensus.cc:359] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.289269   758 raft_consensus.cc:385] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.289705   758 raft_consensus.cc:740] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.290570   758 consensus_queue.cc:260] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.294219   758 ts_tablet_manager.cc:1434] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:57:03.295573   758 tablet_bootstrap.cc:492] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:03.297102   761 tablet_bootstrap.cc:654] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.299333   463 catalog_manager.cc:5697] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:03.301446   463 catalog_manager.cc:5697] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:03.304657   758 tablet_bootstrap.cc:654] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.319723   759 tablet_bootstrap.cc:492] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731: No bootstrap required, opened a new log
I20260709 12:57:03.320464   759 ts_tablet_manager.cc:1403] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.003s
I20260709 12:57:03.325503   759 raft_consensus.cc:359] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.326638   759 raft_consensus.cc:385] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.327209   759 raft_consensus.cc:740] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.328681   759 consensus_queue.cc:260] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.330557   761 tablet_bootstrap.cc:492] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: No bootstrap required, opened a new log
I20260709 12:57:03.331094   761 ts_tablet_manager.cc:1403] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.017s
I20260709 12:57:03.336750   761 raft_consensus.cc:359] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.337792   761 raft_consensus.cc:385] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.338177   761 raft_consensus.cc:740] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.338418   758 tablet_bootstrap.cc:492] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:03.338937   758 ts_tablet_manager.cc:1403] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.019s
I20260709 12:57:03.339085   761 consensus_queue.cc:260] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.343227   761 ts_tablet_manager.cc:1434] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:57:03.344584   759 ts_tablet_manager.cc:1434] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:57:03.347792   806 raft_consensus.cc:493] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.348387   806 raft_consensus.cc:515] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.350662   806 leader_election.cc:290] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:03.351936   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.352388   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:03.351488   758 raft_consensus.cc:359] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.352847   566 raft_consensus.cc:2468] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 0.
I20260709 12:57:03.353008   715 raft_consensus.cc:2468] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 0.
I20260709 12:57:03.353010   758 raft_consensus.cc:385] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.353592   758 raft_consensus.cc:740] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.354472   605 leader_election.cc:304] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:03.354342   758 consensus_queue.cc:260] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.355592   814 raft_consensus.cc:2804] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:03.355964   814 raft_consensus.cc:493] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:03.356261   814 raft_consensus.cc:3060] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.356648   758 ts_tablet_manager.cc:1434] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 12:57:03.357649   758 tablet_bootstrap.cc:492] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: Bootstrap starting.
I20260709 12:57:03.364723   758 tablet_bootstrap.cc:654] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:03.371198   814 raft_consensus.cc:515] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.374614   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:03.375378   566 raft_consensus.cc:3060] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.380659   814 leader_election.cc:290] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:03.383163   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:03.383934   715 raft_consensus.cc:3060] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.387322   566 raft_consensus.cc:2468] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 1.
I20260709 12:57:03.390561   758 tablet_bootstrap.cc:492] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: No bootstrap required, opened a new log
I20260709 12:57:03.390267   605 leader_election.cc:304] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:03.391863   758 ts_tablet_manager.cc:1403] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.019s
I20260709 12:57:03.392202   814 raft_consensus.cc:2804] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:03.393038   814 raft_consensus.cc:697] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:03.393965   715 raft_consensus.cc:2468] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 1.
I20260709 12:57:03.393993   814 consensus_queue.cc:237] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.395660   758 raft_consensus.cc:359] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.396530   758 raft_consensus.cc:385] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:03.396890   758 raft_consensus.cc:740] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Initialized, Role: FOLLOWER
I20260709 12:57:03.397583   758 consensus_queue.cc:260] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.399837   758 ts_tablet_manager.cc:1434] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:03.406325   462 catalog_manager.cc:5697] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 0 to 1, leader changed from <none> to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:03.438980   808 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.439682   808 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.442253   808 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:03.443861   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.443778   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:03.444926   566 raft_consensus.cc:2393] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3693351f2d8c4966ace8678c7dee8a0a in current term 1: Already voted for candidate b138f41df8ec40a9b18dbe6f7eecc731 in this term.
I20260709 12:57:03.444926   639 raft_consensus.cc:2393] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3693351f2d8c4966ace8678c7dee8a0a in current term 1: Already voted for candidate a0e4768b69624a7688aa2e6571d3612f in this term.
I20260709 12:57:03.446558   678 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a; no voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:03.448247   808 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.449604   766 raft_consensus.cc:493] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.450178   766 raft_consensus.cc:515] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.453763   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:03.453972   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:03.454527   766 leader_election.cc:290] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:03.455492   639 raft_consensus.cc:2393] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b138f41df8ec40a9b18dbe6f7eecc731 in current term 1: Already voted for candidate 3693351f2d8c4966ace8678c7dee8a0a in this term.
I20260709 12:57:03.457464   808 raft_consensus.cc:2749] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:03.457973   529 leader_election.cc:304] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b138f41df8ec40a9b18dbe6f7eecc731; no voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:03.459022   766 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.465827   766 raft_consensus.cc:2749] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:03.626111   808 raft_consensus.cc:493] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.626727   808 raft_consensus.cc:515] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.629184   808 leader_election.cc:290] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:03.629218   765 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.630434   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f" is_pre_election: true
I20260709 12:57:03.631016   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.631299   639 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 0.
I20260709 12:57:03.631747   566 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 0.
I20260709 12:57:03.632661   678 leader_election.cc:304] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:03.635269   765 raft_consensus.cc:2804] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:03.635756   765 raft_consensus.cc:493] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:03.636137   765 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.645263   765 raft_consensus.cc:515] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.649916   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:03.650647   566 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.654290   808 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.660255   765 leader_election.cc:290] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:03.661084   566 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 1.
I20260709 12:57:03.662418   679 leader_election.cc:304] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:03.663277   808 raft_consensus.cc:2804] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:03.663924   808 raft_consensus.cc:697] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:03.665246   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:03.666008   639 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.664943   808 consensus_queue.cc:237] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.671934   765 consensus_queue.cc:1048] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.675498   765 consensus_queue.cc:1048] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.709816   828 consensus_queue.cc:1048] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.713328   462 catalog_manager.cc:5697] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:03.727972   641 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:03.741387   639 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 1.
I20260709 12:57:03.749349   806 consensus_queue.cc:1048] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.752945   814 consensus_queue.cc:1048] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:03.760591   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:03.884478   814 raft_consensus.cc:493] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:03.885130   814 raft_consensus.cc:515] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:03.885756   808 consensus_queue.cc:1048] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.892534   814 leader_election.cc:290] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:03.894795   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:03.914845   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:03.944353   606 leader_election.cc:304] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f; no voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:03.945636   806 consensus_queue.cc:1048] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.947108   842 raft_consensus.cc:2749] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:03.951503   806 consensus_queue.cc:1048] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:04.104138   808 consensus_queue.cc:1048] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:04.121611   797 consensus_queue.cc:1048] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:04.673833   842 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:04.674464   842 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:04.676493   842 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:04.677548   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" is_pre_election: true
I20260709 12:57:04.677605   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a" is_pre_election: true
I20260709 12:57:04.678208   566 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 1.
I20260709 12:57:04.678231   715 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 1.
I20260709 12:57:04.679502   605 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:04.680320   842 raft_consensus.cc:2804] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:04.680722   842 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:04.681136   842 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:04.686789   842 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:04.688747   842 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:04.689675   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:04.689934   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:04.690254   566 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:04.690495   715 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:04.697157   566 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:04.697336   715 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:04.698318   605 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:04.699080   842 raft_consensus.cc:2804] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:04.700114   842 raft_consensus.cc:697] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:04.700930   842 consensus_queue.cc:237] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:04.709225   461 catalog_manager.cc:5697] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 0 to 2, leader changed from <none> to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.164641   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:55942
I20260709 12:57:05.165369   640 raft_consensus.cc:606] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Received request to transfer leadership to TS b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:05.183276   566 raft_consensus.cc:1275] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:05.185030   842 consensus_queue.cc:1048] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:05.186057   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
mode: GRACEFUL
new_leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:46526
I20260709 12:57:05.186671   715 raft_consensus.cc:606] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Received request to transfer leadership to TS b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:05.190825   715 raft_consensus.cc:1275] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:05.194767   856 raft_consensus.cc:993] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:05.195585   847 raft_consensus.cc:1081] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Signalling peer b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:05.196619   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:46526
I20260709 12:57:05.197427   715 raft_consensus.cc:606] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:05.197609   842 consensus_queue.cc:1048] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:05.198225   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:36602
I20260709 12:57:05.202226   564 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.202714   564 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:05.208900   564 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.218286   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:46526
I20260709 12:57:05.219080   714 raft_consensus.cc:606] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:05.220844   564 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:05.221455   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:05.221580   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:05.222122   640 raft_consensus.cc:3055] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:05.222502   640 raft_consensus.cc:740] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:05.223409   640 consensus_queue.cc:260] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.224874   640 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:05.235039   640 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:05.236343   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a918679c844e899bba4c4408530bf8"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:46526
I20260709 12:57:05.236397   529 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 3693351f2d8c4966ace8678c7dee8a0a
I20260709 12:57:05.237149   715 raft_consensus.cc:606] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:05.237413   833 raft_consensus.cc:2804] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:05.238946   833 raft_consensus.cc:697] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:05.240000   833 consensus_queue.cc:237] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.244254   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:55942
I20260709 12:57:05.244992   640 raft_consensus.cc:606] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Received request to transfer leadership to TS 3693351f2d8c4966ace8678c7dee8a0a
I20260709 12:57:05.248826   461 catalog_manager.cc:5697] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 2 to 3, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.257407   864 raft_consensus.cc:993] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:05.258114   864 raft_consensus.cc:1081] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:05.260910   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55928
I20260709 12:57:05.261767   640 raft_consensus.cc:493] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.262223   640 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.268999   866 raft_consensus.cc:993] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: : Instructing follower b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:05.268980   640 raft_consensus.cc:515] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.269706   765 raft_consensus.cc:1081] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Signalling peer b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:05.271340   640 leader_election.cc:290] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:05.271642   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:36590
I20260709 12:57:05.272132   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:05.272342   564 raft_consensus.cc:493] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.272781   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:05.272781   564 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.272814   566 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.273316   715 raft_consensus.cc:3055] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.273641   715 raft_consensus.cc:740] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:05.274402   715 consensus_queue.cc:260] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.275601   715 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.281006   715 raft_consensus.cc:2468] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:05.281543   566 raft_consensus.cc:2468] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:05.281529   564 raft_consensus.cc:515] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.282310   606 leader_election.cc:304] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:05.283250   856 raft_consensus.cc:2804] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.283835   856 raft_consensus.cc:697] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:05.284212   564 leader_election.cc:290] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 2 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:05.284759   856 consensus_queue.cc:237] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.288462   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:05.288754   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:05.289266   640 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.289376   715 raft_consensus.cc:3055] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.289740   715 raft_consensus.cc:740] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:05.290640   715 consensus_queue.cc:260] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.292016   715 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.293598   461 catalog_manager.cc:5697] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 1 to 2, leader changed from 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.297627   640 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 2.
I20260709 12:57:05.299458   529 leader_election.cc:304] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:05.299891   715 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 2.
I20260709 12:57:05.300541   833 raft_consensus.cc:2804] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.301136   833 raft_consensus.cc:697] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:05.302119   833 consensus_queue.cc:237] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.310844   461 catalog_manager.cc:5697] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 1 to 2, leader changed from 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195) to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.424396   765 raft_consensus.cc:993] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:05.425053   866 raft_consensus.cc:1081] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:05.427345   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55928
I20260709 12:57:05.428061   640 raft_consensus.cc:493] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.428447   640 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.436055   640 raft_consensus.cc:515] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.442660   640 leader_election.cc:290] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:05.443647   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:05.445164   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:05.444379   564 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.445976   715 raft_consensus.cc:3055] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.446444   715 raft_consensus.cc:740] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:05.447513   715 consensus_queue.cc:260] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.449169   715 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.457763   564 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:05.469589   605 leader_election.cc:304] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:05.471025   856 raft_consensus.cc:2804] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.471863   856 raft_consensus.cc:697] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:05.472942   856 consensus_queue.cc:237] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.462992   715 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:05.710462   714 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:05.712704   461 catalog_manager.cc:5697] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 1 to 2, leader changed from 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.714486   715 raft_consensus.cc:1275] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:05.718701   714 raft_consensus.cc:1275] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:05.722306   862 consensus_queue.cc:1048] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:05.723743   857 consensus_queue.cc:1048] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:05.724496   866 raft_consensus.cc:993] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:05.724772   856 raft_consensus.cc:993] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:05.725016   866 raft_consensus.cc:1081] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:05.725185   856 raft_consensus.cc:1081] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Signalling peer 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:05.726750   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a918679c844e899bba4c4408530bf8"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55928
I20260709 12:57:05.727360   640 raft_consensus.cc:493] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.727913   640 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.731609   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:57:05.732493   712 raft_consensus.cc:493] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.733024   712 raft_consensus.cc:3060] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.735478   640 raft_consensus.cc:515] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.738646   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:05.739238   564 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.741298   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:05.742246   714 raft_consensus.cc:3055] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.742745   714 raft_consensus.cc:740] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:05.740105   640 leader_election.cc:290] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:05.744006   714 consensus_queue.cc:260] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.745513   714 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.749384   564 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:05.749419   712 raft_consensus.cc:515] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.751806   605 leader_election.cc:304] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:05.752784   856 raft_consensus.cc:2804] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.753352   856 raft_consensus.cc:697] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:05.753926   640 raft_consensus.cc:1275] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:05.754263   856 consensus_queue.cc:237] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.755353   712 leader_election.cc:290] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:05.756598   862 consensus_queue.cc:1048] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:05.758983   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:05.759701   641 raft_consensus.cc:3055] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.760037   641 raft_consensus.cc:740] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:05.761667   641 consensus_queue.cc:260] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.767773   566 raft_consensus.cc:1275] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:05.763015   641 raft_consensus.cc:3060] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.770341   857 consensus_queue.cc:1048] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:05.778697   714 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:05.794911   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1e725f90274bcfad511c676e0cd755" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:05.795830   564 raft_consensus.cc:3060] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.811753   463 catalog_manager.cc:5697] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 1 to 2, leader changed from 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.816588   641 raft_consensus.cc:2468] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 2.
I20260709 12:57:05.818717   678 leader_election.cc:304] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:05.820261   864 raft_consensus.cc:2804] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.820900   864 raft_consensus.cc:697] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:05.821817   864 consensus_queue.cc:237] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:05.832600   564 raft_consensus.cc:2468] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 2.
I20260709 12:57:05.835932   715 raft_consensus.cc:1275] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:05.837711   833 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:05.847349   461 catalog_manager.cc:5697] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 1 to 2, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:05.866210   641 raft_consensus.cc:1275] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:05.868289   881 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:05.978145   715 raft_consensus.cc:1275] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:05.980187   856 consensus_queue.cc:1048] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:05.990276   564 raft_consensus.cc:1275] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:05.993091   842 consensus_queue.cc:1048] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:06.190681   564 raft_consensus.cc:1275] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.192965   842 consensus_queue.cc:1048] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:06.203466   715 raft_consensus.cc:1275] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.205260   842 consensus_queue.cc:1048] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:06.371994   641 raft_consensus.cc:1275] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.373397   765 consensus_queue.cc:1048] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:06.385727   564 raft_consensus.cc:1275] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.387723   890 consensus_queue.cc:1048] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:06.595767   494 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 434
W20260709 12:57:06.596791   494 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 497
W20260709 12:57:06.598471   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0da0 after lost signal to thread 590
W20260709 12:57:06.599313   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001c33a0 after lost signal to thread 665
W20260709 12:57:06.600111   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001f19c0 after lost signal to thread 739
I20260709 12:57:08.434784   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:57:08.435927   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:08.460125   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
mode: GRACEFUL
new_leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:36618
I20260709 12:57:08.460979   566 raft_consensus.cc:606] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 LEADER]: Received request to transfer leadership to TS 3693351f2d8c4966ace8678c7dee8a0a
I20260709 12:57:08.478305   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:55948
I20260709 12:57:08.479162   641 raft_consensus.cc:606] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Received request to transfer leadership to TS 3693351f2d8c4966ace8678c7dee8a0a
I20260709 12:57:08.480943   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:08.481549   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:08.669195   899 raft_consensus.cc:993] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: : Instructing follower 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:08.669773   894 raft_consensus.cc:1081] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 LEADER]: Signalling peer 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:08.671852   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:46514
I20260709 12:57:08.672509   715 raft_consensus.cc:493] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:08.672827   715 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:08.677974   715 raft_consensus.cc:515] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:08.679816   715 leader_election.cc:290] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 3 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:08.680876   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:08.680976   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:08.681710   641 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:08.681689   566 raft_consensus.cc:3055] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:08.682248   566 raft_consensus.cc:740] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:08.683184   566 consensus_queue.cc:260] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:08.684679   566 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:08.687635   641 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 3.
I20260709 12:57:08.688868   678 leader_election.cc:304] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:08.689620   893 raft_consensus.cc:2804] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:08.691076   893 raft_consensus.cc:697] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:08.692026   893 consensus_queue.cc:237] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:08.693687   566 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 3.
I20260709 12:57:08.702435   461 catalog_manager.cc:5697] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 2 to 3, leader changed from b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193) to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:08.998128   857 raft_consensus.cc:993] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:08.999207   904 raft_consensus.cc:1081] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Signalling peer 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:09.005928   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:57:09.007301   715 raft_consensus.cc:493] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.008139   715 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.021132   715 raft_consensus.cc:515] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.023927   715 leader_election.cc:290] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:09.025959   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:09.026058   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:09.027213   566 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.027218   641 raft_consensus.cc:3055] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.032207   641 raft_consensus.cc:740] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:09.033309   641 consensus_queue.cc:260] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.035334   641 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.035210   566 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 2.
I20260709 12:57:09.037067   679 leader_election.cc:304] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:09.038395   893 raft_consensus.cc:2804] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.038964   893 raft_consensus.cc:697] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:09.040133   893 consensus_queue.cc:237] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.044394   641 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 2.
I20260709 12:57:09.053539   461 catalog_manager.cc:5697] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 1 to 2, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.131920   566 raft_consensus.cc:1275] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:09.133577   893 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:09.154330   641 raft_consensus.cc:1275] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:09.159255   900 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:09.430274   566 raft_consensus.cc:1275] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:09.431795   900 consensus_queue.cc:1048] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:09.443496   641 raft_consensus.cc:1275] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:09.445416   915 consensus_queue.cc:1048] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:09.482815   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:09.506706   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:36628
I20260709 12:57:09.507355   566 raft_consensus.cc:606] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:09.513270   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:36628
I20260709 12:57:09.513818   566 raft_consensus.cc:606] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:09.520051   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1526529dee304f71b1349535c332fd1a"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:36628
I20260709 12:57:09.520641   566 raft_consensus.cc:606] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:09.526537   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:46526
I20260709 12:57:09.527235   714 raft_consensus.cc:606] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:09.528944   919 raft_consensus.cc:993] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.529678   894 raft_consensus.cc:1081] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.531472   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55916
I20260709 12:57:09.532111   641 raft_consensus.cc:493] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.532434   641 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:09.536376   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
mode: GRACEFUL
new_leader_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:46526
I20260709 12:57:09.537066   714 raft_consensus.cc:606] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Received request to transfer leadership to TS a0e4768b69624a7688aa2e6571d3612f
I20260709 12:57:09.539522   641 raft_consensus.cc:515] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.542487   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:09.542780   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb2796d56824d07b83c91365dd89cae" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:09.543143   641 leader_election.cc:290] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 4 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:09.543157   566 raft_consensus.cc:3055] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:09.543409   714 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:09.543785   566 raft_consensus.cc:740] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:09.544772   566 consensus_queue.cc:260] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.545830   566 raft_consensus.cc:3060] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:09.549700   714 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 4.
I20260709 12:57:09.551180   606 leader_election.cc:304] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:09.551339   566 raft_consensus.cc:2468] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 4.
I20260709 12:57:09.552273   904 raft_consensus.cc:2804] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:09.552786   904 raft_consensus.cc:697] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 4 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:09.553648   904 consensus_queue.cc:237] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.561101   461 catalog_manager.cc:5697] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 3 to 4, leader changed from b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:09.724367   919 raft_consensus.cc:993] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.724876   894 raft_consensus.cc:1081] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.726599   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1526529dee304f71b1349535c332fd1a"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55916
I20260709 12:57:09.727097   641 raft_consensus.cc:493] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.727366   641 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.733757   641 raft_consensus.cc:515] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.735939   641 leader_election.cc:290] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:09.737107   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:09.737002   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:09.737856   714 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.737875   566 raft_consensus.cc:3055] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.738402   566 raft_consensus.cc:740] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:09.739326   566 consensus_queue.cc:260] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.740772   566 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.746505   714 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:09.748638   606 leader_election.cc:304] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:09.748922   566 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:09.749637   904 raft_consensus.cc:2804] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.750250   904 raft_consensus.cc:697] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:09.751200   904 consensus_queue.cc:237] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.760382   461 catalog_manager.cc:5697] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 1 to 2, leader changed from b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:09.761348   915 raft_consensus.cc:993] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.761955   893 raft_consensus.cc:1081] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.763895   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55928
I20260709 12:57:09.764472   641 raft_consensus.cc:493] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.764840   641 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:09.773010   641 raft_consensus.cc:515] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.774909   641 leader_election.cc:290] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 4 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:09.776113   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:09.776108   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3162d1a46f409cbe48127ff90f9b21" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:09.776959   566 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:09.777925   714 raft_consensus.cc:3055] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:09.778362   714 raft_consensus.cc:740] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:09.779220   714 consensus_queue.cc:260] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.780555   714 raft_consensus.cc:3060] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:09.782984   566 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 4.
I20260709 12:57:09.784412   605 leader_election.cc:304] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:09.785235   904 raft_consensus.cc:2804] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:09.785743   904 raft_consensus.cc:697] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 4 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:09.786863   904 consensus_queue.cc:237] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.786945   714 raft_consensus.cc:2468] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 4.
I20260709 12:57:09.793864   461 catalog_manager.cc:5697] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 3 to 4, leader changed from 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:09.917112   919 raft_consensus.cc:993] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.917663   894 raft_consensus.cc:1081] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:09.919502   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55916
I20260709 12:57:09.920101   641 raft_consensus.cc:493] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.920545   641 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.925721   641 raft_consensus.cc:515] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.927708   641 leader_election.cc:290] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:09.928395   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:09.928828   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:09.929064   566 raft_consensus.cc:3055] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.929373   566 raft_consensus.cc:740] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:09.929394   714 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.930333   566 consensus_queue.cc:260] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.931599   566 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.937330   714 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:09.938653   566 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 2.
I20260709 12:57:09.938817   606 leader_election.cc:304] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:09.939846   904 raft_consensus.cc:2804] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.940434   904 raft_consensus.cc:697] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:09.941330   904 consensus_queue.cc:237] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:09.948984   461 catalog_manager.cc:5697] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 1 to 2, leader changed from b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:10.025554   893 raft_consensus.cc:993] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: : Instructing follower a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:10.026468   900 raft_consensus.cc:1081] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Signalling peer a0e4768b69624a7688aa2e6571d3612f to start an election
I20260709 12:57:10.028342   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
 from {username='slave'} at 127.0.0.1:55928
I20260709 12:57:10.028946   641 raft_consensus.cc:493] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:10.029304   641 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:10.034499   641 raft_consensus.cc:515] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:10.036232   641 leader_election.cc:290] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 3 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:10.037176   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:10.037289   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a64ee4e934365a130c0fb135dd6ea" candidate_uuid: "a0e4768b69624a7688aa2e6571d3612f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:10.037734   566 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:10.037878   714 raft_consensus.cc:3055] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:10.038232   714 raft_consensus.cc:740] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:10.039044   714 consensus_queue.cc:260] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:10.040385   714 raft_consensus.cc:3060] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:10.046017   566 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 3.
I20260709 12:57:10.046983   714 raft_consensus.cc:2468] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e4768b69624a7688aa2e6571d3612f in term 3.
I20260709 12:57:10.047092   605 leader_election.cc:304] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:10.047968   904 raft_consensus.cc:2804] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:10.048417   904 raft_consensus.cc:697] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 3 LEADER]: Becoming Leader. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:10.049178   904 consensus_queue.cc:237] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:10.055441   461 catalog_manager.cc:5697] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f reported cstate change: term changed from 2 to 3, leader changed from 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195) to a0e4768b69624a7688aa2e6571d3612f (127.0.107.194). New cstate: current_term: 3 leader_uuid: "a0e4768b69624a7688aa2e6571d3612f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:10.129751   714 raft_consensus.cc:1275] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:10.131281   857 consensus_queue.cc:1048] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:10.142529   566 raft_consensus.cc:1275] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:10.147248   904 consensus_queue.cc:1048] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:10.154428   714 raft_consensus.cc:1275] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:10.156034   904 consensus_queue.cc:1048] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:10.167714   566 raft_consensus.cc:1275] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:10.169447   928 consensus_queue.cc:1048] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:10.327828   566 raft_consensus.cc:1275] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:10.327996   714 raft_consensus.cc:1275] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:10.329455   928 consensus_queue.cc:1048] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:10.329515   857 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:10.347023   564 raft_consensus.cc:1275] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:10.351274   714 raft_consensus.cc:1275] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:10.351409   904 consensus_queue.cc:1048] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:57:10.353798   937 consensus_queue.cc:1048] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:10.465570   714 raft_consensus.cc:1275] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:10.467235   936 consensus_queue.cc:1048] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:10.477389   566 raft_consensus.cc:1275] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Refusing update from remote peer a0e4768b69624a7688aa2e6571d3612f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:10.479259   928 consensus_queue.cc:1048] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:12.555912   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:12.563889   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1526529dee304f71b1349535c332fd1a"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:55948
I20260709 12:57:12.564532   641 raft_consensus.cc:606] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Received request to transfer leadership to TS b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:12.567664   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:55948
I20260709 12:57:12.568244   641 raft_consensus.cc:606] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Received request to transfer leadership to TS b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:12.571192   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:55948
I20260709 12:57:12.571769   641 raft_consensus.cc:606] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Received request to transfer leadership to TS b138f41df8ec40a9b18dbe6f7eecc731
I20260709 12:57:12.574542   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a918679c844e899bba4c4408530bf8"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:55948
I20260709 12:57:12.575136   641 raft_consensus.cc:606] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Received request to transfer leadership to TS 3693351f2d8c4966ace8678c7dee8a0a
I20260709 12:57:12.577960   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8"
dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
mode: GRACEFUL
new_leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:55948
I20260709 12:57:12.578483   641 raft_consensus.cc:606] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Received request to transfer leadership to TS 3693351f2d8c4966ace8678c7dee8a0a
I20260709 12:57:12.579494   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:12.580055   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:12.609364   936 raft_consensus.cc:993] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:12.609965   943 raft_consensus.cc:1081] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Signalling peer 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:12.611822   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a918679c844e899bba4c4408530bf8"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:57:12.612385   714 raft_consensus.cc:493] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:12.612824   714 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.617220   943 raft_consensus.cc:993] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:12.617841   942 raft_consensus.cc:1081] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Signalling peer 3693351f2d8c4966ace8678c7dee8a0a to start an election
I20260709 12:57:12.619905   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8"
dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:57:12.620463   715 raft_consensus.cc:493] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:12.620775   715 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.636121   714 raft_consensus.cc:515] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.638381   714 leader_election.cc:290] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 3 election: Requested vote from peers b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325), a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681)
I20260709 12:57:12.640306   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:12.640087   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a918679c844e899bba4c4408530bf8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:12.640949   641 raft_consensus.cc:3055] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:12.640960   565 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.641443   641 raft_consensus.cc:740] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:12.642297   641 consensus_queue.cc:260] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.643378   641 raft_consensus.cc:3060] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.663830   943 raft_consensus.cc:993] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:12.664364   942 raft_consensus.cc:1081] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Signalling peer b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:12.666059   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:36602
I20260709 12:57:12.666571   564 raft_consensus.cc:493] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:12.666890   564 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.736809   565 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 3.
I20260709 12:57:12.736842   715 raft_consensus.cc:515] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.738780   679 leader_election.cc:304] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:12.739938   641 raft_consensus.cc:2468] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 3.
I20260709 12:57:12.741122   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
I20260709 12:57:12.741719   566 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.739194   715 leader_election.cc:290] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 3 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325)
I20260709 12:57:12.740345   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c743e3b5dc2a4978bb0148d69b1908b8" candidate_uuid: "3693351f2d8c4966ace8678c7dee8a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:12.740325   900 raft_consensus.cc:2804] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:12.744423   640 raft_consensus.cc:3055] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:12.744788   640 raft_consensus.cc:740] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:12.745747   640 consensus_queue.cc:260] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.747155   640 raft_consensus.cc:3060] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.748250   900 raft_consensus.cc:697] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:12.749439   943 raft_consensus.cc:993] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:12.750023   936 raft_consensus.cc:1081] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Signalling peer b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:12.749460   900 consensus_queue.cc:237] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.752143   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:36602
I20260709 12:57:12.752737   565 raft_consensus.cc:493] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:12.753193   565 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.769899   463 catalog_manager.cc:5697] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 2 to 3, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:12.842473   640 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 3.
I20260709 12:57:12.842506   564 raft_consensus.cc:515] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.845115   564 leader_election.cc:290] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:12.846455   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:12.847067   715 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.851846   678 leader_election.cc:304] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, a0e4768b69624a7688aa2e6571d3612f; no voters: 
I20260709 12:57:12.852377   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a01c8684ff24ab5854ef7950afb8f3d" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:12.852851   900 raft_consensus.cc:2804] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:12.853050   640 raft_consensus.cc:3055] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:12.858965   640 raft_consensus.cc:740] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:12.853586   900 raft_consensus.cc:697] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Becoming Leader. State: Replica: 3693351f2d8c4966ace8678c7dee8a0a, State: Running, Role: LEADER
I20260709 12:57:12.860607   640 consensus_queue.cc:260] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.860736   900 consensus_queue.cc:237] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:12.864400   640 raft_consensus.cc:3060] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.000084   566 raft_consensus.cc:2468] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3693351f2d8c4966ace8678c7dee8a0a in term 3.
I20260709 12:57:13.017125   936 raft_consensus.cc:993] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: : Instructing follower b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:13.018002   942 raft_consensus.cc:1081] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Signalling peer b138f41df8ec40a9b18dbe6f7eecc731 to start an election
I20260709 12:57:13.021118   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1526529dee304f71b1349535c332fd1a"
dest_uuid: "b138f41df8ec40a9b18dbe6f7eecc731"
 from {username='slave'} at 127.0.0.1:36602
I20260709 12:57:13.022006   566 raft_consensus.cc:493] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:13.022543   566 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.041852   715 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:13.041916   565 raft_consensus.cc:515] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.043797   531 leader_election.cc:304] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:13.044679   565 leader_election.cc:290] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:13.045004   461 catalog_manager.cc:5697] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a reported cstate change: term changed from 2 to 3, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3693351f2d8c4966ace8678c7dee8a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:13.045715   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:13.045802   640 raft_consensus.cc:2468] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:13.046473   641 raft_consensus.cc:3055] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:13.046772   641 raft_consensus.cc:740] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:13.047513   641 consensus_queue.cc:260] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.049120   566 raft_consensus.cc:515] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.051083   566 leader_election.cc:290] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Requested vote from peers a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681), 3693351f2d8c4966ace8678c7dee8a0a (127.0.107.195:39501)
I20260709 12:57:13.052537   951 raft_consensus.cc:2804] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:13.052421   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0e4768b69624a7688aa2e6571d3612f"
I20260709 12:57:13.053301   640 raft_consensus.cc:3055] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:13.053705   640 raft_consensus.cc:740] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0e4768b69624a7688aa2e6571d3612f, State: Running, Role: LEADER
I20260709 12:57:13.053629   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0c28da4b254263bee394f5f399ec2a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:13.055049   715 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.054833   640 consensus_queue.cc:260] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.048581   641 raft_consensus.cc:3060] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.056108   951 raft_consensus.cc:697] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:13.057058   951 consensus_queue.cc:237] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.062930   640 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.070135   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1526529dee304f71b1349535c332fd1a" candidate_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3693351f2d8c4966ace8678c7dee8a0a"
I20260709 12:57:13.070849   714 raft_consensus.cc:3060] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.073197   463 catalog_manager.cc:5697] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 2 to 3, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:13.128470   641 raft_consensus.cc:2468] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:13.130250   529 leader_election.cc:304] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e4768b69624a7688aa2e6571d3612f, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:13.131595   715 raft_consensus.cc:2468] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:13.134001   951 raft_consensus.cc:2804] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:13.134688   951 raft_consensus.cc:697] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:13.135257   714 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:13.136466   531 leader_election.cc:304] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3693351f2d8c4966ace8678c7dee8a0a, b138f41df8ec40a9b18dbe6f7eecc731; no voters: 
I20260709 12:57:13.136502   951 consensus_queue.cc:237] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.137449   952 raft_consensus.cc:2804] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:13.139015   952 raft_consensus.cc:697] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Becoming Leader. State: Replica: b138f41df8ec40a9b18dbe6f7eecc731, State: Running, Role: LEADER
I20260709 12:57:13.139976   952 consensus_queue.cc:237] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } }
I20260709 12:57:13.145884   463 catalog_manager.cc:5697] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 2 to 3, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:13.159510   463 catalog_manager.cc:5697] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 reported cstate change: term changed from 2 to 3, leader changed from a0e4768b69624a7688aa2e6571d3612f (127.0.107.194) to b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:13.168311   641 raft_consensus.cc:1275] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.169716   900 consensus_queue.cc:1048] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:13.181639   566 raft_consensus.cc:1275] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.183336   900 consensus_queue.cc:1048] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:13.233661   640 raft_consensus.cc:2468] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b138f41df8ec40a9b18dbe6f7eecc731 in term 3.
I20260709 12:57:13.253376   640 raft_consensus.cc:1275] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.254894   900 consensus_queue.cc:1048] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:13.265268   566 raft_consensus.cc:1275] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Refusing update from remote peer 3693351f2d8c4966ace8678c7dee8a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.268862   964 consensus_queue.cc:1048] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b138f41df8ec40a9b18dbe6f7eecc731" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:13.459813   641 raft_consensus.cc:1275] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.461262   952 consensus_queue.cc:1048] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:13.521102   714 raft_consensus.cc:1275] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.522398   952 consensus_queue.cc:1048] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:13.532320   715 raft_consensus.cc:1275] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.533643   952 consensus_queue.cc:1048] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:13.534855   966 log.cc:927] Time spent T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:57:13.545495   714 raft_consensus.cc:1275] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.546010   641 raft_consensus.cc:1275] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.548297   954 consensus_queue.cc:1048] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3693351f2d8c4966ace8678c7dee8a0a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:13.550390   954 consensus_queue.cc:1048] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:13.559587   640 raft_consensus.cc:1275] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Refusing update from remote peer b138f41df8ec40a9b18dbe6f7eecc731: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:13.561304   969 consensus_queue.cc:1048] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e4768b69624a7688aa2e6571d3612f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:13.628073   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:13.634009   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:57:13.643774   679 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:57:13.647466   679 consensus_peers.cc:597] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a -> Peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Couldn't send request to peer b138f41df8ec40a9b18dbe6f7eecc731. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:13.661775   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:13.662653   431 tablet_replica.cc:333] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.663601   431 raft_consensus.cc:2243] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.664253   431 raft_consensus.cc:2272] T 6f3162d1a46f409cbe48127ff90f9b21 P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.667273   431 tablet_replica.cc:333] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.668190   431 raft_consensus.cc:2243] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.668901   431 raft_consensus.cc:2272] T 796a64ee4e934365a130c0fb135dd6ea P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.671037   431 tablet_replica.cc:333] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.671867   431 raft_consensus.cc:2243] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:13.672919   431 raft_consensus.cc:2272] T 4b0c28da4b254263bee394f5f399ec2a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.676328   431 tablet_replica.cc:333] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
W20260709 12:57:13.677076   605 consensus_peers.cc:597] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f -> Peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Couldn't send request to peer b138f41df8ec40a9b18dbe6f7eecc731. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:13.677147   431 raft_consensus.cc:2243] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.677835   431 raft_consensus.cc:2272] T 2a1e725f90274bcfad511c676e0cd755 P b138f41df8ec40a9b18dbe6f7eecc731 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.680007   431 tablet_replica.cc:333] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.680799   431 raft_consensus.cc:2243] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.681308   431 raft_consensus.cc:2272] T 82a918679c844e899bba4c4408530bf8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.684267   431 tablet_replica.cc:333] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
W20260709 12:57:13.684480   605 consensus_peers.cc:597] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f -> Peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Couldn't send request to peer b138f41df8ec40a9b18dbe6f7eecc731. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:13.684928   431 raft_consensus.cc:2243] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:13.685833   431 raft_consensus.cc:2272] T 1526529dee304f71b1349535c332fd1a P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.688479   431 tablet_replica.cc:333] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.689080   431 raft_consensus.cc:2243] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.689580   431 raft_consensus.cc:2272] T 0bb2796d56824d07b83c91365dd89cae P b138f41df8ec40a9b18dbe6f7eecc731 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.691715   431 tablet_replica.cc:333] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.692263   431 raft_consensus.cc:2243] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:13.693152   431 raft_consensus.cc:2272] T 7a01c8684ff24ab5854ef7950afb8f3d P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.695945   431 tablet_replica.cc:333] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731: stopping tablet replica
I20260709 12:57:13.696817   431 raft_consensus.cc:2243] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.697347   431 raft_consensus.cc:2272] T c743e3b5dc2a4978bb0148d69b1908b8 P b138f41df8ec40a9b18dbe6f7eecc731 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:13.700207   679 consensus_peers.cc:597] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a -> Peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Couldn't send request to peer b138f41df8ec40a9b18dbe6f7eecc731. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:13.815042   679 consensus_peers.cc:597] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a -> Peer b138f41df8ec40a9b18dbe6f7eecc731 (127.0.107.193:41325): Couldn't send request to peer b138f41df8ec40a9b18dbe6f7eecc731. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:13.887341   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:57:13.901746   494 debug-util.cc:398] Leaking SignalData structure 0x7b0800164520 after lost signal to thread 434
W20260709 12:57:13.903007   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1220 after lost signal to thread 497
W20260709 12:57:13.905213   494 debug-util.cc:398] Leaking SignalData structure 0x7b08000cffc0 after lost signal to thread 665
W20260709 12:57:13.906395   494 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7940 after lost signal to thread 739
I20260709 12:57:13.917810   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:57:13.958232   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:13.959210   431 tablet_replica.cc:333] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.959985   431 raft_consensus.cc:2243] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.960502   431 raft_consensus.cc:2272] T 4b0c28da4b254263bee394f5f399ec2a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.963806   431 tablet_replica.cc:333] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.965020   431 raft_consensus.cc:2243] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.965901   431 raft_consensus.cc:2272] T 82a918679c844e899bba4c4408530bf8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.970820   431 tablet_replica.cc:333] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.971685   431 raft_consensus.cc:2243] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.972259   431 raft_consensus.cc:2272] T 2a1e725f90274bcfad511c676e0cd755 P a0e4768b69624a7688aa2e6571d3612f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.974772   431 tablet_replica.cc:333] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.975538   431 raft_consensus.cc:2243] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:13.976418   431 raft_consensus.cc:2272] T 796a64ee4e934365a130c0fb135dd6ea P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.978401   431 tablet_replica.cc:333] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.978967   431 raft_consensus.cc:2243] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:13.979836   431 raft_consensus.cc:2272] T 6f3162d1a46f409cbe48127ff90f9b21 P a0e4768b69624a7688aa2e6571d3612f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.981709   431 tablet_replica.cc:333] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.982267   431 raft_consensus.cc:2243] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.982713   431 raft_consensus.cc:2272] T 1526529dee304f71b1349535c332fd1a P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.985059   431 tablet_replica.cc:333] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.985582   431 raft_consensus.cc:2243] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.986053   431 raft_consensus.cc:2272] T 7a01c8684ff24ab5854ef7950afb8f3d P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.988343   431 tablet_replica.cc:333] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.988845   431 raft_consensus.cc:2243] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:13.989271   431 raft_consensus.cc:2272] T c743e3b5dc2a4978bb0148d69b1908b8 P a0e4768b69624a7688aa2e6571d3612f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:13.992623   431 tablet_replica.cc:333] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f: stopping tablet replica
I20260709 12:57:13.993163   431 raft_consensus.cc:2243] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:13.994005   431 raft_consensus.cc:2272] T 0bb2796d56824d07b83c91365dd89cae P a0e4768b69624a7688aa2e6571d3612f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.029238   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:57:14.052569   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:57:14.087709   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:14.088507   431 tablet_replica.cc:333] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.089179   431 raft_consensus.cc:2243] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:14.089725   431 raft_consensus.cc:2272] T 0bb2796d56824d07b83c91365dd89cae P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.092391   431 tablet_replica.cc:333] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.093122   431 raft_consensus.cc:2243] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:14.094049   431 raft_consensus.cc:2272] T 82a918679c844e899bba4c4408530bf8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.097481   431 tablet_replica.cc:333] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.098346   431 raft_consensus.cc:2243] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:14.099308   431 raft_consensus.cc:2272] T 2a1e725f90274bcfad511c676e0cd755 P 3693351f2d8c4966ace8678c7dee8a0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.101451   431 tablet_replica.cc:333] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.102174   431 raft_consensus.cc:2243] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:14.102833   431 raft_consensus.cc:2272] T 796a64ee4e934365a130c0fb135dd6ea P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.105217   431 tablet_replica.cc:333] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.105914   431 raft_consensus.cc:2243] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:14.106524   431 raft_consensus.cc:2272] T 6f3162d1a46f409cbe48127ff90f9b21 P 3693351f2d8c4966ace8678c7dee8a0a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:14.107985   678 consensus_peers.cc:597] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a -> Peer a0e4768b69624a7688aa2e6571d3612f (127.0.107.194:39681): Couldn't send request to peer a0e4768b69624a7688aa2e6571d3612f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:14.108705   431 tablet_replica.cc:333] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.109266   431 raft_consensus.cc:2243] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:14.109727   431 raft_consensus.cc:2272] T 1526529dee304f71b1349535c332fd1a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.112615   431 tablet_replica.cc:333] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.113166   431 raft_consensus.cc:2243] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:14.113651   431 raft_consensus.cc:2272] T 4b0c28da4b254263bee394f5f399ec2a P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.116060   431 tablet_replica.cc:333] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.116613   431 raft_consensus.cc:2243] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:14.117112   431 raft_consensus.cc:2272] T 7a01c8684ff24ab5854ef7950afb8f3d P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.119405   431 tablet_replica.cc:333] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a: stopping tablet replica
I20260709 12:57:14.120020   431 raft_consensus.cc:2243] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:14.120867   431 raft_consensus.cc:2272] T c743e3b5dc2a4978bb0148d69b1908b8 P 3693351f2d8c4966ace8678c7dee8a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.153918   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:57:14.179235   431 master.cc:562] Master@127.0.107.254:43933 shutting down...
I20260709 12:57:14.345698   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:14.346433   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:14.346838   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 26579fb058554cb5b5ef10819f1b820c: stopping tablet replica
I20260709 12:57:14.486208   431 master.cc:584] Master@127.0.107.254:43933 shutdown complete.
3693351f2d8c4966ace8678c7dee8a0a  1
a0e4768b69624a7688aa2e6571d3612f  4
b138f41df8ec40a9b18dbe6f7eecc731  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (15598 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:57:14.533346   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33063
I20260709 12:57:14.534644   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:14.541344   978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.541481   977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.541805   980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:14.543282   431 server_base.cc:1061] running on GCE node
I20260709 12:57:14.544451   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:14.544653   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:14.544847   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601834544828 us; error 0 us; skew 500 ppm
I20260709 12:57:14.545464   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:14.548607   431 webserver.cc:533] Webserver started at http://127.0.107.254:33677/ using document root <none> and password file <none>
I20260709 12:57:14.549177   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:14.549376   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:14.549702   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:14.550902   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.555707   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:57:14.559271   985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.560146   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:57:14.560480   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.560808   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:14.575220   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:14.576709   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:14.620680   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33063
I20260709 12:57:14.620788  1036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33063 every 8 connection(s)
I20260709 12:57:14.625017  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:14.635532  1037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4: Bootstrap starting.
I20260709 12:57:14.640807  1037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.645432  1037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4: No bootstrap required, opened a new log
I20260709 12:57:14.647753  1037 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" member_type: VOTER }
I20260709 12:57:14.648164  1037 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.648347  1037 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab0b4ff27e74fa6a10b4191f422dbe4, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.648953  1037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" member_type: VOTER }
I20260709 12:57:14.649395  1037 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:14.649597  1037 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:14.649806  1037 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.654341  1037 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" member_type: VOTER }
I20260709 12:57:14.654925  1037 leader_election.cc:304] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ab0b4ff27e74fa6a10b4191f422dbe4; no voters: 
I20260709 12:57:14.656102  1037 leader_election.cc:290] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:14.656476  1040 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.657927  1040 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 1 LEADER]: Becoming Leader. State: Replica: 7ab0b4ff27e74fa6a10b4191f422dbe4, State: Running, Role: LEADER
I20260709 12:57:14.658679  1040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" member_type: VOTER }
I20260709 12:57:14.659515  1037 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:14.663676  1042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ab0b4ff27e74fa6a10b4191f422dbe4. Latest consensus state: current_term: 1 leader_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" member_type: VOTER } }
I20260709 12:57:14.664490  1042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:14.665781  1041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab0b4ff27e74fa6a10b4191f422dbe4" member_type: VOTER } }
I20260709 12:57:14.666445  1041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:14.666684  1047 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:14.672600  1047 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:14.676704   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:14.682895  1047 catalog_manager.cc:1383] Generated new cluster ID: 4bb4354c9f4147e7b0626048a24d3a8f
I20260709 12:57:14.683266  1047 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:14.699169  1047 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:14.700582  1047 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:14.715683  1047 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4: Generated new TSK 0
I20260709 12:57:14.716343  1047 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:14.744232   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:14.750677  1058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.752157  1059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.753791  1061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:14.754278   431 server_base.cc:1061] running on GCE node
I20260709 12:57:14.755323   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:14.755595   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:14.755753   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601834755736 us; error 0 us; skew 500 ppm
I20260709 12:57:14.756276   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:14.758917   431 webserver.cc:533] Webserver started at http://127.0.107.193:41525/ using document root <none> and password file <none>
I20260709 12:57:14.759490   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:14.759775   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:14.760038   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:14.761363   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.766726   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:57:14.770709  1066 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.771661   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:57:14.771963   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.772243   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:14.791829   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:14.793221   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:14.794793   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:14.797376   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:14.797565   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.797892   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:14.798074   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.843986   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39215
I20260709 12:57:14.844077  1128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39215 every 8 connection(s)
I20260709 12:57:14.849516   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:14.858273  1134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.859730  1133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.861660  1136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:14.861928   431 server_base.cc:1061] running on GCE node
I20260709 12:57:14.863478   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:14.863812   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:14.864007   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601834863991 us; error 0 us; skew 500 ppm
I20260709 12:57:14.864589   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:14.868448   431 webserver.cc:533] Webserver started at http://127.0.107.194:36081/ using document root <none> and password file <none>
I20260709 12:57:14.869155   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:14.869431   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:14.869345  1129 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33063
I20260709 12:57:14.869907   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:14.869987  1129 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:14.871001  1129 heartbeater.cc:507] Master 127.0.107.254:33063 requested a full tablet report, sending...
I20260709 12:57:14.871745   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "54b04137abb24f70854bce04efd72fba"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.873567  1002 ts_manager.cc:194] Registered new tserver with Master: f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215)
I20260709 12:57:14.875697  1002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51324
I20260709 12:57:14.877851   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 12:57:14.882112  1141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.883009   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 12:57:14.883364   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "54b04137abb24f70854bce04efd72fba"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.883756   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:14.897729   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:14.899140   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:14.900897   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:14.903311   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:14.903600   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.903874   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:14.904060   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.950682   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38503
I20260709 12:57:14.950788  1203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38503 every 8 connection(s)
I20260709 12:57:14.956403   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:14.965982  1207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:14.967694  1208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:14.970953   431 server_base.cc:1061] running on GCE node
W20260709 12:57:14.971787  1210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:14.972667  1204 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33063
I20260709 12:57:14.972957   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:57:14.973142  1204 heartbeater.cc:461] Registering TS with master...
W20260709 12:57:14.973243   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:14.973518   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601834973477 us; error 0 us; skew 500 ppm
I20260709 12:57:14.974217  1204 heartbeater.cc:507] Master 127.0.107.254:33063 requested a full tablet report, sending...
I20260709 12:57:14.974382   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:14.976917  1002 ts_manager.cc:194] Registered new tserver with Master: 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:14.978507  1002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51326
I20260709 12:57:14.979441   431 webserver.cc:533] Webserver started at http://127.0.107.195:41507/ using document root <none> and password file <none>
I20260709 12:57:14.980257   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:14.980528   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:14.980902   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:14.982456   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.988893   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:57:14.992676  1215 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:14.993533   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:57:14.993904   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
format_stamp: "Formatted at 2026-07-09 12:57:14 on dist-test-slave-fc6v"
I20260709 12:57:14.994220   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:15.009164   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:15.010591   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:15.012251   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:15.014693   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:15.014981   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:15.015244   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:15.015434   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:15.060652   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38901
I20260709 12:57:15.060753  1277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38901 every 8 connection(s)
I20260709 12:57:15.076229  1278 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33063
I20260709 12:57:15.076663  1278 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:15.077492  1278 heartbeater.cc:507] Master 127.0.107.254:33063 requested a full tablet report, sending...
I20260709 12:57:15.079706  1002 ts_manager.cc:194] Registered new tserver with Master: 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.080288   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01592761s
I20260709 12:57:15.081545  1002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51334
I20260709 12:57:15.110008  1002 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51346:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:15.113318  1002 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:15.201448  1169 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbd6121c901487c85a350611aabe168 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:15.202522  1242 tablet_service.cc:1511] Processing CreateTablet for tablet 160bce452acd40e2a0397313b9e49ff8 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:15.203181  1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbd6121c901487c85a350611aabe168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.201448  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbd6121c901487c85a350611aabe168 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:15.205008  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea906c2570c4ff48d16a208bbd65e6a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:15.207412  1240 tablet_service.cc:1511] Processing CreateTablet for tablet f5d0f86aee604187868afe787e7d356a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:15.209897  1239 tablet_service.cc:1511] Processing CreateTablet for tablet c0090850f88a462aa3c696226bb9aa23 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:15.212805  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 9d32c62a8f004707a35084722cd7ffcf (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:15.214778  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160bce452acd40e2a0397313b9e49ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.215492  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d32c62a8f004707a35084722cd7ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.220103  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0090850f88a462aa3c696226bb9aa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.220912  1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d0f86aee604187868afe787e7d356a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.224121  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea906c2570c4ff48d16a208bbd65e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.228228  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbd6121c901487c85a350611aabe168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.236620  1292 tablet_bootstrap.cc:492] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.238713  1166 tablet_service.cc:1511] Processing CreateTablet for tablet f5d0f86aee604187868afe787e7d356a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:15.251523  1163 tablet_service.cc:1511] Processing CreateTablet for tablet 3b08836207ad4314813fec860aca9d47 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:15.252640  1166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d0f86aee604187868afe787e7d356a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.253564  1236 tablet_service.cc:1511] Processing CreateTablet for tablet 3b08836207ad4314813fec860aca9d47 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:15.253942  1162 tablet_service.cc:1511] Processing CreateTablet for tablet 49c68901a062468281aec2a4cb4264d3 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:15.238972  1168 tablet_service.cc:1511] Processing CreateTablet for tablet 160bce452acd40e2a0397313b9e49ff8 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:15.255427  1236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b08836207ad4314813fec860aca9d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.240974  1167 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea906c2570c4ff48d16a208bbd65e6a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:15.256250  1293 tablet_bootstrap.cc:492] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.240974  1165 tablet_service.cc:1511] Processing CreateTablet for tablet c0090850f88a462aa3c696226bb9aa23 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:15.256791  1161 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7313f2d0434889940f3f529ebfb87a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:15.255434  1162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c68901a062468281aec2a4cb4264d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.259001  1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160bce452acd40e2a0397313b9e49ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.259727  1235 tablet_service.cc:1511] Processing CreateTablet for tablet 49c68901a062468281aec2a4cb4264d3 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:15.261196  1165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0090850f88a462aa3c696226bb9aa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.261183  1235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c68901a062468281aec2a4cb4264d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.264015  1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea906c2570c4ff48d16a208bbd65e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.263737  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7313f2d0434889940f3f529ebfb87a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:15.265199  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7313f2d0434889940f3f529ebfb87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.267980  1161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7313f2d0434889940f3f529ebfb87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.245965  1169 tablet_service.cc:1511] Processing CreateTablet for tablet 9d32c62a8f004707a35084722cd7ffcf (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:15.249413  1164 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfdab0be66447dfbd63a6db2a213d35 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:15.250439  1237 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfdab0be66447dfbd63a6db2a213d35 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:15.269491  1094 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbd6121c901487c85a350611aabe168 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:15.272271  1237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfdab0be66447dfbd63a6db2a213d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.272508  1093 tablet_service.cc:1511] Processing CreateTablet for tablet 160bce452acd40e2a0397313b9e49ff8 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:15.276018  1163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b08836207ad4314813fec860aca9d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.272497  1094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbd6121c901487c85a350611aabe168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.280015  1164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfdab0be66447dfbd63a6db2a213d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.282387  1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d32c62a8f004707a35084722cd7ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.283954  1093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160bce452acd40e2a0397313b9e49ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.293869  1092 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea906c2570c4ff48d16a208bbd65e6a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:15.295670  1092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea906c2570c4ff48d16a208bbd65e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.301795  1091 tablet_service.cc:1511] Processing CreateTablet for tablet f5d0f86aee604187868afe787e7d356a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:15.303395  1091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d0f86aee604187868afe787e7d356a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.309725  1090 tablet_service.cc:1511] Processing CreateTablet for tablet c0090850f88a462aa3c696226bb9aa23 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:15.311199  1090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0090850f88a462aa3c696226bb9aa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.317890  1089 tablet_service.cc:1511] Processing CreateTablet for tablet 9d32c62a8f004707a35084722cd7ffcf (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:15.319604  1089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d32c62a8f004707a35084722cd7ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.326794  1088 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfdab0be66447dfbd63a6db2a213d35 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:15.328542  1088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfdab0be66447dfbd63a6db2a213d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.332736  1292 tablet_bootstrap.cc:654] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.333642  1087 tablet_service.cc:1511] Processing CreateTablet for tablet 3b08836207ad4314813fec860aca9d47 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:15.335362  1087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b08836207ad4314813fec860aca9d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.346176  1086 tablet_service.cc:1511] Processing CreateTablet for tablet 49c68901a062468281aec2a4cb4264d3 (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:15.347882  1086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c68901a062468281aec2a4cb4264d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.372908  1085 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7313f2d0434889940f3f529ebfb87a (DEFAULT_TABLE table=test-workload [id=b4303dedfafe4c5bbbca9748b01ccdb3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:15.375074  1085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7313f2d0434889940f3f529ebfb87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:15.381366  1293 tablet_bootstrap.cc:654] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.409752  1292 tablet_bootstrap.cc:492] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.410425  1292 ts_tablet_manager.cc:1403] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.174s	user 0.011s	sys 0.034s
I20260709 12:57:15.414407  1292 raft_consensus.cc:359] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.416846  1292 raft_consensus.cc:385] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.421347  1292 raft_consensus.cc:740] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.422132  1292 consensus_queue.cc:260] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.431533  1296 tablet_bootstrap.cc:492] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.432988  1293 tablet_bootstrap.cc:492] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.433507  1293 ts_tablet_manager.cc:1403] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.178s	user 0.024s	sys 0.007s
I20260709 12:57:15.437556  1293 raft_consensus.cc:359] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.438444  1293 raft_consensus.cc:385] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.438805  1293 raft_consensus.cc:740] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.438961  1296 tablet_bootstrap.cc:654] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.439821  1293 consensus_queue.cc:260] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.440516  1292 ts_tablet_manager.cc:1434] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 12:57:15.441820  1204 heartbeater.cc:499] Master 127.0.107.254:33063 was elected leader, sending a full tablet report...
I20260709 12:57:15.443940  1292 tablet_bootstrap.cc:492] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.451385  1293 ts_tablet_manager.cc:1434] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:57:15.452284  1278 heartbeater.cc:499] Master 127.0.107.254:33063 was elected leader, sending a full tablet report...
I20260709 12:57:15.456878  1293 tablet_bootstrap.cc:492] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.459362  1292 tablet_bootstrap.cc:654] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.464984  1293 tablet_bootstrap.cc:654] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.466745  1296 tablet_bootstrap.cc:492] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.467309  1296 ts_tablet_manager.cc:1403] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.005s
I20260709 12:57:15.468072  1292 tablet_bootstrap.cc:492] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.468623  1292 ts_tablet_manager.cc:1403] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.002s
I20260709 12:57:15.470757  1296 raft_consensus.cc:359] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.471648  1296 raft_consensus.cc:385] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.471987  1296 raft_consensus.cc:740] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.472291  1292 raft_consensus.cc:359] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.473034  1292 raft_consensus.cc:385] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.473487  1292 raft_consensus.cc:740] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.473050  1296 consensus_queue.cc:260] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.477283  1292 consensus_queue.cc:260] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.481037  1292 ts_tablet_manager.cc:1434] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:57:15.482303  1292 tablet_bootstrap.cc:492] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.482177  1129 heartbeater.cc:499] Master 127.0.107.254:33063 was elected leader, sending a full tablet report...
I20260709 12:57:15.483006  1296 ts_tablet_manager.cc:1434] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:57:15.484129  1296 tablet_bootstrap.cc:492] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.490895  1292 tablet_bootstrap.cc:654] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.491638  1296 tablet_bootstrap.cc:654] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.505313  1296 tablet_bootstrap.cc:492] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.505968  1296 ts_tablet_manager.cc:1403] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 12:57:15.509459  1296 raft_consensus.cc:359] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.510356  1296 raft_consensus.cc:385] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.510643  1296 raft_consensus.cc:740] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.511417  1296 consensus_queue.cc:260] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.509953  1292 tablet_bootstrap.cc:492] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.512818  1292 ts_tablet_manager.cc:1403] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.009s
I20260709 12:57:15.514024  1293 tablet_bootstrap.cc:492] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.514518  1293 ts_tablet_manager.cc:1403] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.030s
I20260709 12:57:15.516333  1292 raft_consensus.cc:359] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.516969  1293 raft_consensus.cc:359] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.517210  1292 raft_consensus.cc:385] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.517683  1293 raft_consensus.cc:385] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.517776  1292 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.518102  1293 raft_consensus.cc:740] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.519273  1296 ts_tablet_manager.cc:1434] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:57:15.519063  1293 consensus_queue.cc:260] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.519063  1292 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.520493  1296 tablet_bootstrap.cc:492] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.521926  1293 ts_tablet_manager.cc:1434] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:15.523012  1293 tablet_bootstrap.cc:492] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.521926  1292 ts_tablet_manager.cc:1434] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:57:15.528703  1296 tablet_bootstrap.cc:654] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.528749  1292 tablet_bootstrap.cc:492] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.529826  1293 tablet_bootstrap.cc:654] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.544052  1292 tablet_bootstrap.cc:654] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.572805  1296 tablet_bootstrap.cc:492] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.573416  1296 ts_tablet_manager.cc:1403] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.053s	user 0.034s	sys 0.016s
I20260709 12:57:15.573670  1293 tablet_bootstrap.cc:492] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.574072  1292 tablet_bootstrap.cc:492] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.574230  1293 ts_tablet_manager.cc:1403] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.020s
I20260709 12:57:15.574656  1292 ts_tablet_manager.cc:1403] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.021s
I20260709 12:57:15.577675  1296 raft_consensus.cc:359] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.577924  1293 raft_consensus.cc:359] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.578197  1292 raft_consensus.cc:359] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.578606  1296 raft_consensus.cc:385] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.578701  1293 raft_consensus.cc:385] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.578958  1292 raft_consensus.cc:385] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.578971  1296 raft_consensus.cc:740] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.579128  1293 raft_consensus.cc:740] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.579452  1292 raft_consensus.cc:740] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.580314  1293 consensus_queue.cc:260] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.580214  1296 consensus_queue.cc:260] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.580541  1292 consensus_queue.cc:260] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.582892  1296 ts_tablet_manager.cc:1434] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:15.584167  1296 tablet_bootstrap.cc:492] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.586882  1292 ts_tablet_manager.cc:1434] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:57:15.588035  1293 ts_tablet_manager.cc:1434] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:57:15.589267  1293 tablet_bootstrap.cc:492] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.591374  1296 tablet_bootstrap.cc:654] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.597045  1293 tablet_bootstrap.cc:654] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.597739  1292 tablet_bootstrap.cc:492] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.605409  1296 tablet_bootstrap.cc:492] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.606161  1292 tablet_bootstrap.cc:654] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.606107  1296 ts_tablet_manager.cc:1403] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 12:57:15.607661  1293 tablet_bootstrap.cc:492] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.608217  1293 ts_tablet_manager.cc:1403] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:57:15.611496  1293 raft_consensus.cc:359] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.612409  1293 raft_consensus.cc:385] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.612742  1293 raft_consensus.cc:740] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.613461  1293 consensus_queue.cc:260] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.615971  1293 ts_tablet_manager.cc:1434] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:57:15.617151  1293 tablet_bootstrap.cc:492] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.611874  1296 raft_consensus.cc:359] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.625660  1296 raft_consensus.cc:385] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.626432  1296 raft_consensus.cc:740] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.627506  1298 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.628175  1298 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.628777  1296 consensus_queue.cc:260] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.632539  1293 tablet_bootstrap.cc:654] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.645560  1298 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:15.648211  1296 ts_tablet_manager.cc:1434] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.002s
I20260709 12:57:15.649389  1296 tablet_bootstrap.cc:492] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.650264  1292 tablet_bootstrap.cc:492] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.650887  1292 ts_tablet_manager.cc:1403] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.011s
I20260709 12:57:15.655303  1292 raft_consensus.cc:359] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.656369  1292 raft_consensus.cc:385] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.656714  1292 raft_consensus.cc:740] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.658041  1293 tablet_bootstrap.cc:492] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.657720  1292 consensus_queue.cc:260] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.658671  1293 ts_tablet_manager.cc:1403] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 12:57:15.658133  1296 tablet_bootstrap.cc:654] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.662791  1293 raft_consensus.cc:359] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.663902  1293 raft_consensus.cc:385] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.664278  1293 raft_consensus.cc:740] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.664964  1302 raft_consensus.cc:493] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.665493  1302 raft_consensus.cc:515] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.665316  1293 consensus_queue.cc:260] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.671017  1302 leader_election.cc:290] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
W20260709 12:57:15.672737  1050 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:15.675058  1293 ts_tablet_manager.cc:1434] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:57:15.676174  1292 ts_tablet_manager.cc:1434] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 12:57:15.679349  1293 tablet_bootstrap.cc:492] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.688174  1292 tablet_bootstrap.cc:492] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.689550  1298 raft_consensus.cc:493] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.690155  1298 raft_consensus.cc:515] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.692272  1302 raft_consensus.cc:493] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.692528  1298 leader_election.cc:290] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:15.692898  1302 raft_consensus.cc:515] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.694195  1297 raft_consensus.cc:493] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.694794  1297 raft_consensus.cc:515] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.695235  1302 leader_election.cc:290] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.697887  1297 leader_election.cc:290] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901), f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215)
I20260709 12:57:15.701308  1297 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.702221  1297 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.706215  1296 tablet_bootstrap.cc:492] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.706621  1293 tablet_bootstrap.cc:654] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.706871  1296 ts_tablet_manager.cc:1403] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.001s
I20260709 12:57:15.708920  1297 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.709537  1297 raft_consensus.cc:493] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.710005  1297 raft_consensus.cc:515] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.710244  1296 raft_consensus.cc:359] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.710958  1296 raft_consensus.cc:385] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.711290  1296 raft_consensus.cc:740] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.712330  1296 consensus_queue.cc:260] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.725571  1297 leader_election.cc:290] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.726308  1297 raft_consensus.cc:493] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.727038  1104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.728765  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
W20260709 12:57:15.730644  1219 leader_election.cc:343] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:15.731403  1219 leader_election.cc:343] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.726833  1297 raft_consensus.cc:515] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.734459  1292 tablet_bootstrap.cc:654] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.736430  1297 leader_election.cc:290] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.736680  1296 ts_tablet_manager.cc:1434] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 12:57:15.737869  1296 tablet_bootstrap.cc:492] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.746363  1302 raft_consensus.cc:493] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.746979  1302 raft_consensus.cc:515] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.747700  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.749235  1302 leader_election.cc:290] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.750188  1296 tablet_bootstrap.cc:654] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.751899  1293 tablet_bootstrap.cc:492] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.752568  1293 ts_tablet_manager.cc:1403] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.002s
W20260709 12:57:15.756808  1070 leader_election.cc:343] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.757040  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.751899  1292 tablet_bootstrap.cc:492] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.757517  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.758237  1292 ts_tablet_manager.cc:1403] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.000s
W20260709 12:57:15.758513  1070 leader_election.cc:343] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.759083  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.759418  1293 raft_consensus.cc:359] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.760190  1293 raft_consensus.cc:385] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.760522  1293 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.761196  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.756204  1296 tablet_bootstrap.cc:492] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.756873  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.762037  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.764537  1178 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 0.
W20260709 12:57:15.762861  1219 leader_election.cc:343] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:15.762851  1070 leader_election.cc:343] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.765496  1219 leader_election.cc:304] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0; no voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:15.761655  1292 raft_consensus.cc:359] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
W20260709 12:57:15.766088  1070 leader_election.cc:343] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.766402  1292 raft_consensus.cc:385] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.766804  1292 raft_consensus.cc:740] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.762441  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.767637  1298 raft_consensus.cc:2749] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.766934  1219 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:15.768064  1292 consensus_queue.cc:260] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.766521  1070 leader_election.cc:304] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:15.769173  1298 raft_consensus.cc:2804] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.769272  1302 raft_consensus.cc:2749] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.769598  1298 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.769977  1298 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.770689  1292 ts_tablet_manager.cc:1434] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:57:15.771016  1293 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.771828  1292 tablet_bootstrap.cc:492] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
W20260709 12:57:15.770702  1070 leader_election.cc:343] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.773087  1070 leader_election.cc:304] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:15.773875  1302 raft_consensus.cc:2749] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:15.775043  1070 leader_election.cc:343] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.775511  1070 leader_election.cc:304] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:15.776386  1302 raft_consensus.cc:2749] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.776858  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.777565  1253 raft_consensus.cc:2468] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:15.778787  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.779227  1292 tablet_bootstrap.cc:654] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.780139  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.777496  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.781766  1250 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:15.784158  1145 leader_election.cc:304] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:15.785080  1297 raft_consensus.cc:2804] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:57:15.785380  1145 leader_election.cc:343] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.785583  1297 raft_consensus.cc:493] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.785956  1297 raft_consensus.cc:3060] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.786198  1145 leader_election.cc:304] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:15.763513  1296 ts_tablet_manager.cc:1403] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:57:15.787324  1318 raft_consensus.cc:2804] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.787984  1318 raft_consensus.cc:493] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.788419  1318 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.794677  1297 raft_consensus.cc:515] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.798506  1297 leader_election.cc:290] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.796511  1292 tablet_bootstrap.cc:492] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.799630  1292 ts_tablet_manager.cc:1403] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 12:57:15.800050  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:15.800921  1250 raft_consensus.cc:3060] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.800954  1298 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.803157  1292 raft_consensus.cc:359] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.803812  1252 raft_consensus.cc:2393] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54b04137abb24f70854bce04efd72fba in current term 1: Already voted for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in this term.
I20260709 12:57:15.804000  1292 raft_consensus.cc:385] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.804113  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:15.804608  1292 raft_consensus.cc:740] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
W20260709 12:57:15.805866  1219 leader_election.cc:343] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.805665  1292 consensus_queue.cc:260] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.790995  1296 raft_consensus.cc:359] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.806754  1296 raft_consensus.cc:385] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.807080  1296 raft_consensus.cc:740] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.808126  1296 consensus_queue.cc:260] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.815380  1250 raft_consensus.cc:2468] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:15.820247  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:15.821184  1178 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.824589  1297 raft_consensus.cc:493] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.824819  1145 leader_election.cc:304] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:15.825289  1297 raft_consensus.cc:515] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.827772  1298 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:15.828147  1318 raft_consensus.cc:515] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.828900  1298 raft_consensus.cc:493] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.829381  1298 raft_consensus.cc:515] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.830436  1318 leader_election.cc:290] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.830863  1178 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 1.
I20260709 12:57:15.832769  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.833953  1327 raft_consensus.cc:2804] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.834530  1327 raft_consensus.cc:697] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
W20260709 12:57:15.834600  1219 leader_election.cc:343] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.835316  1292 ts_tablet_manager.cc:1434] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.035s	user 0.025s	sys 0.006s
I20260709 12:57:15.835511  1327 consensus_queue.cc:237] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.836661  1302 raft_consensus.cc:493] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.837153  1302 raft_consensus.cc:515] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.838235  1297 leader_election.cc:290] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.839334  1302 leader_election.cc:290] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.840719  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.841442  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.842171  1292 tablet_bootstrap.cc:492] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.842267  1250 raft_consensus.cc:2393] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:15.811388  1296 ts_tablet_manager.cc:1434] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:57:15.843756  1070 leader_election.cc:304] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:15.844147  1293 ts_tablet_manager.cc:1434] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.091s	user 0.022s	sys 0.023s
I20260709 12:57:15.844662  1302 raft_consensus.cc:3060] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.846927  1293 tablet_bootstrap.cc:492] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.850834  1292 tablet_bootstrap.cc:654] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.854228  1293 tablet_bootstrap.cc:654] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.856385  1302 raft_consensus.cc:2749] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.856947  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:15.857540  1250 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.857586  1292 tablet_bootstrap.cc:492] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.858290  1292 ts_tablet_manager.cc:1403] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:57:15.861920  1292 raft_consensus.cc:359] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.862514  1219 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:15.863112  1292 raft_consensus.cc:385] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.863440  1292 raft_consensus.cc:740] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.864085  1325 raft_consensus.cc:2804] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.864210  1292 consensus_queue.cc:260] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.864732  1325 raft_consensus.cc:697] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:15.865737  1325 consensus_queue.cc:237] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.867177  1292 ts_tablet_manager.cc:1434] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:57:15.868460  1292 tablet_bootstrap.cc:492] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.868351  1250 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:15.867509  1002 catalog_manager.cc:5697] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.870216  1302 raft_consensus.cc:493] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.870666  1302 raft_consensus.cc:515] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.872645  1302 leader_election.cc:290] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.873369  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.876907  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.877892  1252 raft_consensus.cc:2393] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:15.877671  1250 raft_consensus.cc:2468] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:15.878502  1100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:15.879097  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.879412  1298 leader_election.cc:290] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:15.880828  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.881096  1296 tablet_bootstrap.cc:492] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:15.881547  1101 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:15.889254  1100 raft_consensus.cc:2468] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:15.875684  1104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.876143  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.876833  1292 tablet_bootstrap.cc:654] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.896257  1103 raft_consensus.cc:2468] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:15.898305  1296 tablet_bootstrap.cc:654] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.875334  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.891810  1293 tablet_bootstrap.cc:492] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:15.892730  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.900137  1178 raft_consensus.cc:2393] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:15.894011  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:15.901122  1102 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.900151  1293 ts_tablet_manager.cc:1403] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.004s
I20260709 12:57:15.903663  1070 leader_election.cc:304] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:15.900506  1000 catalog_manager.cc:5697] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:15.894866  1145 leader_election.cc:304] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:15.915195  1327 raft_consensus.cc:2804] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.915531  1145 leader_election.cc:304] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:15.915999  1327 raft_consensus.cc:697] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:15.917878  1327 consensus_queue.cc:237] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.919813  1297 raft_consensus.cc:2804] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.920173  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.920394  1297 raft_consensus.cc:493] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.920902  1297 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:15.921711  1145 leader_election.cc:343] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.922292  1145 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54b04137abb24f70854bce04efd72fba; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:15.923300  1329 raft_consensus.cc:2749] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.924646  1145 leader_election.cc:304] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:15.924921  1292 tablet_bootstrap.cc:492] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.925503  1292 ts_tablet_manager.cc:1403] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.057s	user 0.029s	sys 0.003s
I20260709 12:57:15.925463  1329 raft_consensus.cc:2804] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.926019  1329 raft_consensus.cc:493] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.926393  1329 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.929288  1292 raft_consensus.cc:359] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.930294  1292 raft_consensus.cc:385] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.914767  1293 raft_consensus.cc:359] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.930697  1292 raft_consensus.cc:740] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.931018  1293 raft_consensus.cc:385] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.931438  1293 raft_consensus.cc:740] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.931686  1292 consensus_queue.cc:260] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.934077  1292 ts_tablet_manager.cc:1434] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:15.935114  1292 tablet_bootstrap.cc:492] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba: Bootstrap starting.
I20260709 12:57:15.936188  1329 raft_consensus.cc:515] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.938495  1329 leader_election.cc:290] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901), f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215)
W20260709 12:57:15.939795  1145 leader_election.cc:343] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.939991  1293 consensus_queue.cc:260] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.941946  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:15.942627  1292 tablet_bootstrap.cc:654] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.942952  1293 ts_tablet_manager.cc:1434] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:57:15.946324  1297 raft_consensus.cc:515] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.947639  1178 raft_consensus.cc:2393] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:15.947247  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:15.949450  1101 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.950770  1292 tablet_bootstrap.cc:492] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba: No bootstrap required, opened a new log
I20260709 12:57:15.950722  1329 raft_consensus.cc:493] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.950425  1296 tablet_bootstrap.cc:492] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:15.951411  1292 ts_tablet_manager.cc:1403] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:57:15.951680  1296 ts_tablet_manager.cc:1403] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.028s
I20260709 12:57:15.951382  1329 raft_consensus.cc:515] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.956185  1292 raft_consensus.cc:359] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.956920  1292 raft_consensus.cc:385] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:57:15.948957  1145 leader_election.cc:343] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.957849  1329 leader_election.cc:290] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.955380  1296 raft_consensus.cc:359] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.957206  1292 raft_consensus.cc:740] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.959825  1296 raft_consensus.cc:385] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.960139  1296 raft_consensus.cc:740] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.961097  1297 leader_election.cc:290] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.960920  1296 consensus_queue.cc:260] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.958750  1102 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:15.960310  1292 consensus_queue.cc:260] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.963989  1302 raft_consensus.cc:2749] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.964178  1219 leader_election.cc:304] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0; no voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:15.962941  1293 tablet_bootstrap.cc:492] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:15.966069  1292 ts_tablet_manager.cc:1434] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:57:15.967299  1325 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.970082  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:15.972714  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:15.972684  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.973448  1101 raft_consensus.cc:2468] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:15.974308  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:15.978989  1102 raft_consensus.cc:2468] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:15.975297  1302 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:15.977922  1145 leader_election.cc:343] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.979873  1302 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
W20260709 12:57:15.980590  1145 leader_election.cc:343] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.980893  1325 raft_consensus.cc:2749] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.981424  1145 leader_election.cc:304] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:15.982257  1302 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.982808  1293 tablet_bootstrap.cc:654] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.982776  1329 raft_consensus.cc:2804] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.983494  1329 raft_consensus.cc:697] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:15.984485  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:15.985407  1145 leader_election.cc:304] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:15.986465  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:15.987581  1327 raft_consensus.cc:2804] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.988000  1297 raft_consensus.cc:493] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.988278  1327 raft_consensus.cc:493] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.988736  1327 raft_consensus.cc:3060] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.988515  1297 raft_consensus.cc:515] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:15.990875  1297 leader_election.cc:290] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:15.985407  1178 raft_consensus.cc:2393] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in this term.
I20260709 12:57:15.991899  1252 raft_consensus.cc:2468] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:15.977429  1002 catalog_manager.cc:5697] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.984757  1329 consensus_queue.cc:237] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:15.998966  1297 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.998127  1070 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:15.999521  1297 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.001147  1302 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.002419  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.002436  1297 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.002604  1327 raft_consensus.cc:515] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.003290  1102 raft_consensus.cc:2468] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:16.005163  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:16.006129  1252 raft_consensus.cc:2468] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:16.007285  1325 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.006738  1293 tablet_bootstrap.cc:492] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:16.008258  1296 ts_tablet_manager.cc:1434] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.005s
I20260709 12:57:16.007853  1325 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.009047  1293 ts_tablet_manager.cc:1403] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.000s
I20260709 12:57:16.011379  1325 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:16.008450  1145 leader_election.cc:304] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.012753  1297 raft_consensus.cc:2804] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.013257  1297 raft_consensus.cc:697] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.013231  1145 leader_election.cc:304] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:16.013571  1293 raft_consensus.cc:359] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:16.014367  1293 raft_consensus.cc:385] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.014659  1293 raft_consensus.cc:740] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.014998  1297 consensus_queue.cc:237] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.015789  1293 consensus_queue.cc:260] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:16.016311  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.016577  1327 leader_election.cc:290] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.017254  1327 raft_consensus.cc:2804] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.017592  1327 raft_consensus.cc:493] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.017925  1327 raft_consensus.cc:3060] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.018620  1293 ts_tablet_manager.cc:1434] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:57:16.019677  1293 tablet_bootstrap.cc:492] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:16.016764  1296 tablet_bootstrap.cc:492] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:16.029299  1302 raft_consensus.cc:2749] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.034646  1293 tablet_bootstrap.cc:654] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:16.036875  1219 leader_election.cc:343] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.040694  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.041468  1178 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 0.
I20260709 12:57:16.037202  1327 raft_consensus.cc:515] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.043201  1219 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.043512  1327 leader_election.cc:290] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.043915  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.044536  1325 raft_consensus.cc:2804] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.044922  1325 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.045356  1325 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.046237  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:16.047235  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:16.045377  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.048426  1103 raft_consensus.cc:3060] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:16.054279  1145 leader_election.cc:343] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:16.055382  1145 leader_election.cc:343] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.056648  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.056872  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:16.057345  1101 raft_consensus.cc:3060] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.057405  1250 raft_consensus.cc:3060] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.065919  1250 raft_consensus.cc:2468] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:16.067396  1145 leader_election.cc:304] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:16.068572  1296 tablet_bootstrap.cc:654] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.068689  1344 raft_consensus.cc:2804] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.069267  1344 raft_consensus.cc:697] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.070369  1344 consensus_queue.cc:237] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.074179  1325 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.075603  1252 raft_consensus.cc:2393] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54b04137abb24f70854bce04efd72fba in current term 1: Already voted for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in this term.
I20260709 12:57:16.077490  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.078919  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba"
W20260709 12:57:16.079078  1219 leader_election.cc:343] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.079849  1178 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.063475  1001 catalog_manager.cc:5697] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.080988  1145 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54b04137abb24f70854bce04efd72fba; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.080449  1325 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:16.082994  1293 tablet_bootstrap.cc:492] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:16.083571  1293 ts_tablet_manager.cc:1403] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.009s
I20260709 12:57:16.086817  1103 raft_consensus.cc:2468] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:16.086884  1293 raft_consensus.cc:359] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.087836  1293 raft_consensus.cc:385] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.088177  1293 raft_consensus.cc:740] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.088352  1145 leader_election.cc:304] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:16.089264  1297 raft_consensus.cc:2804] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.072134  1101 raft_consensus.cc:2468] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:16.089135  1293 consensus_queue.cc:260] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.090085  1297 raft_consensus.cc:697] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.091012  1297 consensus_queue.cc:237] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.091518  1293 ts_tablet_manager.cc:1434] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:57:16.092530  1293 tablet_bootstrap.cc:492] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: Bootstrap starting.
I20260709 12:57:16.099200  1178 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 1.
I20260709 12:57:16.097368  1001 catalog_manager.cc:5697] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.100440  1327 raft_consensus.cc:2749] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.102029  1293 tablet_bootstrap.cc:654] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.101913  1327 raft_consensus.cc:493] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.102553  1327 raft_consensus.cc:515] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.106106  1219 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.107872  1325 raft_consensus.cc:2804] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.108528  1325 raft_consensus.cc:697] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:16.109778  1325 consensus_queue.cc:237] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.111933  1327 leader_election.cc:290] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.113009  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.113963  1296 tablet_bootstrap.cc:492] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:16.114004  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:16.114567  1296 ts_tablet_manager.cc:1403] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.003s
W20260709 12:57:16.114583  1145 leader_election.cc:343] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.114986  1252 raft_consensus.cc:2468] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 0.
I20260709 12:57:16.117127  1145 leader_election.cc:304] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.117985  1327 raft_consensus.cc:2804] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.118438  1293 tablet_bootstrap.cc:492] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: No bootstrap required, opened a new log
I20260709 12:57:16.118392  1327 raft_consensus.cc:493] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.118184  1296 raft_consensus.cc:359] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.119012  1293 ts_tablet_manager.cc:1403] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.001s
I20260709 12:57:16.118916  1296 raft_consensus.cc:385] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.118887  1327 raft_consensus.cc:3060] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.119423  1296 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.120421  1296 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.122144  1293 raft_consensus.cc:359] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.122865  1293 raft_consensus.cc:385] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.123138  1293 raft_consensus.cc:740] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.124013  1293 consensus_queue.cc:260] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.125440  1296 ts_tablet_manager.cc:1434] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:57:16.126222  1293 ts_tablet_manager.cc:1434] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:57:16.126513  1296 tablet_bootstrap.cc:492] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:16.133117  1296 tablet_bootstrap.cc:654] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.136845  1001 catalog_manager.cc:5697] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.138895  1001 catalog_manager.cc:5697] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.141223  1327 raft_consensus.cc:515] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.142998  1296 tablet_bootstrap.cc:492] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:16.143636  1296 ts_tablet_manager.cc:1403] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:57:16.144796  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.145215  1327 leader_election.cc:290] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.146828  1296 raft_consensus.cc:359] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
W20260709 12:57:16.146757  1145 leader_election.cc:343] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.147723  1296 raft_consensus.cc:385] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.148095  1296 raft_consensus.cc:740] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.148291  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:16.148881  1252 raft_consensus.cc:3060] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.149032  1296 consensus_queue.cc:260] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.151813  1296 ts_tablet_manager.cc:1434] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:16.152892  1296 tablet_bootstrap.cc:492] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: Bootstrap starting.
I20260709 12:57:16.156865  1252 raft_consensus.cc:2468] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 1.
I20260709 12:57:16.158236  1145 leader_election.cc:304] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.159478  1327 raft_consensus.cc:2804] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.156884  1002 catalog_manager.cc:5697] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.160068  1327 raft_consensus.cc:697] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.160943  1327 consensus_queue.cc:237] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.159808  1296 tablet_bootstrap.cc:654] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.188594  1296 tablet_bootstrap.cc:492] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: No bootstrap required, opened a new log
I20260709 12:57:16.189111  1296 ts_tablet_manager.cc:1403] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.009s
I20260709 12:57:16.191174  1296 raft_consensus.cc:359] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.191929  1296 raft_consensus.cc:385] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.191130  1002 catalog_manager.cc:5697] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 0 to 1, leader changed from <none> to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.192186  1296 raft_consensus.cc:740] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.192879  1296 consensus_queue.cc:260] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.196532  1296 ts_tablet_manager.cc:1434] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:16.306435  1302 raft_consensus.cc:493] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.307083  1302 raft_consensus.cc:515] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.308907  1302 leader_election.cc:290] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.310038  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.310186  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:16.310948  1252 raft_consensus.cc:2393] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:16.311362  1325 raft_consensus.cc:493] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.312011  1070 leader_election.cc:304] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:16.311923  1325 raft_consensus.cc:515] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.312879  1302 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.313931  1325 leader_election.cc:290] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:16.314981  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.315153  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.315748  1178 raft_consensus.cc:2468] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 0.
I20260709 12:57:16.315747  1101 raft_consensus.cc:2468] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 0.
I20260709 12:57:16.317046  1219 leader_election.cc:304] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:16.317276  1325 raft_consensus.cc:493] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.317723  1325 raft_consensus.cc:515] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:16.318502  1298 raft_consensus.cc:2804] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.318869  1298 raft_consensus.cc:493] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.319200  1298 raft_consensus.cc:3060] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.319936  1325 leader_election.cc:290] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215)
I20260709 12:57:16.320714  1302 raft_consensus.cc:2749] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.321466  1327 consensus_queue.cc:1048] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.324033  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.323743  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.324834  1101 raft_consensus.cc:2393] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:16.328478  1298 raft_consensus.cc:515] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.331256  1219 leader_election.cc:304] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0; no voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.333882  1325 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.338778  1297 consensus_queue.cc:1048] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.345335  1298 leader_election.cc:290] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:16.345975  1325 raft_consensus.cc:2749] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.346887  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.347582  1103 raft_consensus.cc:3060] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.348249  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:16.348975  1178 raft_consensus.cc:3060] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.349119  1325 raft_consensus.cc:493] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.349642  1325 raft_consensus.cc:515] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.353354  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" is_pre_election: true
I20260709 12:57:16.353399  1328 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.354305  1102 raft_consensus.cc:2393] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:16.356385  1103 raft_consensus.cc:2468] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 1.
I20260709 12:57:16.360383  1219 leader_election.cc:304] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:16.361560  1298 raft_consensus.cc:2804] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.362216  1298 raft_consensus.cc:697] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:16.363160  1298 consensus_queue.cc:237] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.365840  1325 leader_election.cc:290] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:16.366074  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.368957  1219 leader_election.cc:304] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0; no voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.369045  1325 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.370921  1328 raft_consensus.cc:3060] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.378094  1002 catalog_manager.cc:5697] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.381070  1178 raft_consensus.cc:2468] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 1.
I20260709 12:57:16.405117  1328 raft_consensus.cc:2749] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.427143  1302 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.427770  1302 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.429699  1302 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.430521  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.430794  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:16.431212  1176 raft_consensus.cc:2393] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in this term.
I20260709 12:57:16.432410  1070 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:16.433113  1302 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.438796  1302 raft_consensus.cc:2749] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.438670  1297 consensus_queue.cc:1048] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.450022  1297 consensus_queue.cc:1048] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.478380  1297 consensus_queue.cc:1048] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.482240  1176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dbd6121c901487c85a350611aabe168"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:16.483088  1176 raft_consensus.cc:606] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.490919  1176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:16.491597  1176 raft_consensus.cc:606] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.494796  1329 consensus_queue.cc:1048] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.498272  1176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:16.498945  1176 raft_consensus.cc:606] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.500586  1297 consensus_queue.cc:1048] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.510083  1325 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.514650  1297 consensus_queue.cc:1048] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.518499  1329 consensus_queue.cc:1048] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.522538  1327 raft_consensus.cc:993] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:16.524336  1327 raft_consensus.cc:1081] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:16.527699  1101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50056
I20260709 12:57:16.528487  1101 raft_consensus.cc:493] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.529021  1101 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.538518  1325 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.540346  1344 raft_consensus.cc:993] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:16.540964  1344 raft_consensus.cc:1081] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:16.544085  1250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:35870
I20260709 12:57:16.544759  1250 raft_consensus.cc:606] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.545022  1100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50056
I20260709 12:57:16.547860  1100 raft_consensus.cc:493] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.548285  1100 raft_consensus.cc:3060] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.554519  1344 consensus_queue.cc:1048] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.554981  1250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:35870
I20260709 12:57:16.555814  1250 raft_consensus.cc:606] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:16.557937  1101 raft_consensus.cc:515] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.571496  1100 raft_consensus.cc:515] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.577380  1344 consensus_queue.cc:1048] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.584298  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:16.585139  1178 raft_consensus.cc:3055] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.585539  1178 raft_consensus.cc:740] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.586042  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea906c2570c4ff48d16a208bbd65e6a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:16.586719  1252 raft_consensus.cc:3060] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.586504  1178 consensus_queue.cc:260] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.592756  1178 raft_consensus.cc:3060] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.595182  1252 raft_consensus.cc:2468] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:16.596740  1070 leader_election.cc:304] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:16.597807  1341 raft_consensus.cc:2804] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.598256  1302 raft_consensus.cc:493] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.598847  1100 leader_election.cc:290] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.604714  1302 raft_consensus.cc:515] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.611713  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:16.612479  1177 raft_consensus.cc:3055] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.612377  1252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
mode: GRACEFUL
new_leader_uuid: "54b04137abb24f70854bce04efd72fba"
 from {username='slave'} at 127.0.0.1:35870
I20260709 12:57:16.612771  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b04137abb24f70854bce04efd72fba" is_pre_election: true
I20260709 12:57:16.613035  1302 leader_election.cc:290] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.613168  1252 raft_consensus.cc:606] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Received request to transfer leadership to TS 54b04137abb24f70854bce04efd72fba
I20260709 12:57:16.614259  1101 leader_election.cc:290] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.612943  1177 raft_consensus.cc:740] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.615911  1177 consensus_queue.cc:260] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.620771  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" is_pre_election: true
I20260709 12:57:16.623102  1253 raft_consensus.cc:2393] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1b1bf1ab07e4f37a3f99019704d074a in current term 1: Already voted for candidate 54b04137abb24f70854bce04efd72fba in this term.
I20260709 12:57:16.621778  1177 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.624923  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:16.625699  1249 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.625638  1178 raft_consensus.cc:2468] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:16.633098  1341 raft_consensus.cc:697] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:16.635233  1341 consensus_queue.cc:237] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.633445  1344 consensus_queue.cc:1048] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:57:16.640460  1070 leader_election.cc:304] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b1bf1ab07e4f37a3f99019704d074a; no voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba
I20260709 12:57:16.641392  1302 raft_consensus.cc:3060] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.652362  1176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:16.653388  1176 raft_consensus.cc:606] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:16.659113  1302 raft_consensus.cc:2749] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.665300  1249 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:16.666779  1070 leader_election.cc:304] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:16.665858  1000 catalog_manager.cc:5697] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.667748  1302 raft_consensus.cc:2804] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.668625  1302 raft_consensus.cc:697] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:16.669921  1302 consensus_queue.cc:237] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.676651  1177 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:16.680382  1297 raft_consensus.cc:993] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: : Instructing follower 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:16.680917  1297 raft_consensus.cc:1081] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:16.683209  1249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:35854
I20260709 12:57:16.683905  1249 raft_consensus.cc:493] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.684312  1249 raft_consensus.cc:3060] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.690280  1000 catalog_manager.cc:5697] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.692503  1249 raft_consensus.cc:515] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.694424  1252 raft_consensus.cc:1240] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Rejecting Update request from peer 54b04137abb24f70854bce04efd72fba for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.695659  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.696357  1102 raft_consensus.cc:3060] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.698506  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7313f2d0434889940f3f529ebfb87a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:16.698529  1344 consensus_queue.cc:1059] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.699604  1177 raft_consensus.cc:3055] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.700021  1177 raft_consensus.cc:740] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.700949  1177 consensus_queue.cc:260] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.702194  1177 raft_consensus.cc:3060] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.704995  1102 raft_consensus.cc:2468] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 2.
I20260709 12:57:16.706216  1219 leader_election.cc:304] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:16.707023  1325 raft_consensus.cc:2804] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.707617  1325 raft_consensus.cc:697] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:16.708508  1325 consensus_queue.cc:237] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.709156  1249 leader_election.cc:290] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 2 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:16.712450  1177 raft_consensus.cc:2468] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 2.
W20260709 12:57:16.713111  1344 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:57:16.717199  1000 catalog_manager.cc:5697] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.723341  1344 consensus_queue.cc:1048] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.736044  1318 consensus_queue.cc:1048] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.804987  1325 consensus_queue.cc:1048] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.819973  1298 consensus_queue.cc:1048] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.828040  1362 raft_consensus.cc:993] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: : Instructing follower 54b04137abb24f70854bce04efd72fba to start an election
I20260709 12:57:16.828518  1298 raft_consensus.cc:1081] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Signalling peer 54b04137abb24f70854bce04efd72fba to start an election
I20260709 12:57:16.830056  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
 from {username='slave'} at 127.0.0.1:58288
I20260709 12:57:16.830572  1177 raft_consensus.cc:493] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.830890  1177 raft_consensus.cc:3060] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.836256  1177 raft_consensus.cc:515] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.838299  1177 leader_election.cc:290] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 2 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:16.839298  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:16.839532  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c68901a062468281aec2a4cb4264d3" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:16.839990  1102 raft_consensus.cc:3060] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.840157  1249 raft_consensus.cc:3055] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.840580  1249 raft_consensus.cc:740] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:16.841423  1249 consensus_queue.cc:260] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.842760  1249 raft_consensus.cc:3060] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.847905  1102 raft_consensus.cc:2468] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 2.
I20260709 12:57:16.849071  1145 leader_election.cc:304] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:16.849831  1344 raft_consensus.cc:2804] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.849728  1249 raft_consensus.cc:2468] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 2.
I20260709 12:57:16.850440  1344 raft_consensus.cc:697] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 2 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:16.851328  1344 consensus_queue.cc:237] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:16.857607  1002 catalog_manager.cc:5697] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 1 to 2, leader changed from 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195) to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 2 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.992512  1362 raft_consensus.cc:993] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:16.993036  1298 raft_consensus.cc:1081] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:16.994827  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50052
I20260709 12:57:16.995436  1102 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.995815  1102 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.002152  1102 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:17.003201  1362 raft_consensus.cc:993] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:17.003712  1298 raft_consensus.cc:1081] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:17.004160  1102 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:17.005043  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:17.005329  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:17.005707  1177 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.005813  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50052
I20260709 12:57:17.006006  1249 raft_consensus.cc:3055] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.006443  1249 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:17.006467  1102 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:17.007014  1102 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.007422  1249 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:17.008548  1249 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.014178  1249 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:17.014187  1177 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:17.014634  1102 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:17.015820  1070 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:17.016745  1302 raft_consensus.cc:2804] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.017033  1102 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:17.017215  1302 raft_consensus.cc:697] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:17.018409  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:17.018206  1302 consensus_queue.cc:237] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:17.018615  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:17.019055  1177 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.019255  1249 raft_consensus.cc:3055] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.019694  1249 raft_consensus.cc:740] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:17.020463  1249 consensus_queue.cc:260] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:17.021692  1249 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.026566  1177 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:17.027913  1070 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:17.027138  1002 catalog_manager.cc:5697] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.028748  1302 raft_consensus.cc:2804] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.028759  1249 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:17.029393  1302 raft_consensus.cc:697] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:17.030697  1302 consensus_queue.cc:237] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:17.041378  1002 catalog_manager.cc:5697] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.055893  1297 raft_consensus.cc:993] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:17.056419  1344 raft_consensus.cc:1081] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:17.058123  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dbd6121c901487c85a350611aabe168"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50056
I20260709 12:57:17.058735  1102 raft_consensus.cc:493] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:17.059053  1102 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.064163  1177 raft_consensus.cc:1275] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.066020  1302 consensus_queue.cc:1048] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.066181  1102 raft_consensus.cc:515] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:17.068333  1102 leader_election.cc:290] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:17.070228  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:17.071349  1249 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.071381  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:17.072184  1177 raft_consensus.cc:3055] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.072535  1177 raft_consensus.cc:740] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:17.073421  1177 consensus_queue.cc:260] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:17.074806  1177 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.077180  1252 raft_consensus.cc:1275] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.079906  1249 raft_consensus.cc:2468] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:17.081563  1378 consensus_queue.cc:1048] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.082792  1177 raft_consensus.cc:2468] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:17.083948  1070 leader_election.cc:304] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:17.084800  1378 raft_consensus.cc:2804] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.085328  1378 raft_consensus.cc:697] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:17.087586  1378 consensus_queue.cc:237] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:17.094954  1102 raft_consensus.cc:1275] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.096666  1298 consensus_queue.cc:1048] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.100746  1002 catalog_manager.cc:5697] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:17.107712  1176 raft_consensus.cc:1275] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.110406  1362 consensus_queue.cc:1048] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.140798  1176 raft_consensus.cc:1275] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.142261  1378 consensus_queue.cc:1048] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.154902  1249 raft_consensus.cc:1275] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.156774  1302 consensus_queue.cc:1048] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.257951  1249 raft_consensus.cc:1275] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer 54b04137abb24f70854bce04efd72fba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.259430  1318 consensus_queue.cc:1048] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.268306  1102 raft_consensus.cc:1275] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Refusing update from remote peer 54b04137abb24f70854bce04efd72fba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.270907  1297 consensus_queue.cc:1048] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.432545  1249 raft_consensus.cc:1275] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.434053  1302 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.443390  1176 raft_consensus.cc:1275] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.445107  1302 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.461647  1176 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.463038  1378 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.473016  1249 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.474623  1378 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.493572  1249 raft_consensus.cc:1275] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.494657  1378 consensus_queue.cc:1048] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.504262  1176 raft_consensus.cc:1275] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.505759  1378 consensus_queue.cc:1048] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:19.693010   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:57:19.693944   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:19.714177  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
mode: GRACEFUL
new_leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:50062
I20260709 12:57:19.714960  1102 raft_consensus.cc:606] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Received request to transfer leadership to TS 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:19.718014  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
mode: GRACEFUL
new_leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:50062
I20260709 12:57:19.718566  1102 raft_consensus.cc:606] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Received request to transfer leadership to TS 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:19.719879   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:19.720456   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:19.729739  1389 raft_consensus.cc:993] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: : Instructing follower 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:19.731657  1389 raft_consensus.cc:1081] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Signalling peer 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:19.733882  1395 raft_consensus.cc:993] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: : Instructing follower 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:19.734270  1252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:35850
I20260709 12:57:19.734635  1395 raft_consensus.cc:1081] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Signalling peer 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:19.735265  1252 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:19.735898  1252 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.736912  1249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:35850
I20260709 12:57:19.737531  1249 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:19.737896  1249 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.744702  1249 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:19.745079  1252 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:19.747090  1249 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 3 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:19.747206  1252 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 3 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:19.748360  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:19.748963  1101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:19.749485  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:19.750078  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:19.750342  1102 raft_consensus.cc:3055] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:19.750351  1101 raft_consensus.cc:3055] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:19.750355  1177 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.750792  1176 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.750890  1102 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:19.751011  1101 raft_consensus.cc:740] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:19.752422  1101 consensus_queue.cc:260] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:19.752426  1102 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:19.754824  1101 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.754896  1102 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.760557  1176 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 3.
I20260709 12:57:19.761950  1177 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 3.
I20260709 12:57:19.762612  1219 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:19.763814  1298 raft_consensus.cc:2804] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.763865  1219 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:19.765183  1102 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 3.
I20260709 12:57:19.765517  1101 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 3.
I20260709 12:57:19.767320  1298 raft_consensus.cc:697] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:19.768155  1397 raft_consensus.cc:2804] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.769594  1397 raft_consensus.cc:697] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:19.769404  1298 consensus_queue.cc:237] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:19.770735  1397 consensus_queue.cc:237] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:19.781903  1002 catalog_manager.cc:5697] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 2 to 3, leader changed from f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193) to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:19.800979  1002 catalog_manager.cc:5697] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 2 to 3, leader changed from f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193) to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:20.526036  1176 raft_consensus.cc:1275] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:20.531072  1178 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:20.534219  1405 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:20.542197  1102 raft_consensus.cc:1275] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:20.542403  1101 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:20.544678  1405 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:20.546983  1405 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:20.571897  1298 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:20.818411   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:20.838416  1249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:35870
I20260709 12:57:20.838997  1249 raft_consensus.cc:606] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:20.844457  1249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:35870
I20260709 12:57:20.845108  1249 raft_consensus.cc:606] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:20.850952  1178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:20.851722  1178 raft_consensus.cc:606] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:20.857822  1178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:20.858474  1178 raft_consensus.cc:606] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:20.864727  1178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b08836207ad4314813fec860aca9d47"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
mode: GRACEFUL
new_leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:58318
I20260709 12:57:20.865432  1178 raft_consensus.cc:606] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Received request to transfer leadership to TS f1b1bf1ab07e4f37a3f99019704d074a
I20260709 12:57:20.954725  1297 raft_consensus.cc:993] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:20.955200  1406 raft_consensus.cc:1081] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:20.956866  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50056
I20260709 12:57:20.957475  1102 raft_consensus.cc:493] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:20.957832  1102 raft_consensus.cc:3060] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.963207  1102 raft_consensus.cc:515] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:20.964829  1102 leader_election.cc:290] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:20.965938  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:20.966197  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32c62a8f004707a35084722cd7ffcf" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:20.966526  1178 raft_consensus.cc:3055] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:20.966781  1249 raft_consensus.cc:3060] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.966903  1178 raft_consensus.cc:740] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:20.967774  1178 consensus_queue.cc:260] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:20.968869  1178 raft_consensus.cc:3060] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.972575  1249 raft_consensus.cc:2468] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:20.974140  1070 leader_election.cc:304] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:20.974998  1408 raft_consensus.cc:2804] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:20.974970  1178 raft_consensus.cc:2468] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:20.975656  1408 raft_consensus.cc:697] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:20.976612  1408 consensus_queue.cc:237] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:20.985390  1000 catalog_manager.cc:5697] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:21.048475  1417 raft_consensus.cc:993] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.048998  1298 raft_consensus.cc:1081] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.050706  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50052
I20260709 12:57:21.051252  1102 raft_consensus.cc:493] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:21.051607  1102 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.057632  1102 raft_consensus.cc:515] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.059202  1102 leader_election.cc:290] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 4 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:21.060024  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:21.060379  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0090850f88a462aa3c696226bb9aa23" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:21.060703  1178 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.061017  1249 raft_consensus.cc:3055] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:21.061299  1249 raft_consensus.cc:740] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:21.062037  1249 consensus_queue.cc:260] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.062950  1249 raft_consensus.cc:3060] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.066593  1178 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 4.
I20260709 12:57:21.068135  1070 leader_election.cc:304] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:21.069093  1408 raft_consensus.cc:2804] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:21.069047  1249 raft_consensus.cc:2468] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 4.
I20260709 12:57:21.070000  1408 raft_consensus.cc:697] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:21.070878  1408 consensus_queue.cc:237] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.077898  1000 catalog_manager.cc:5697] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 3 to 4, leader changed from 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:21.089227  1417 raft_consensus.cc:993] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.089764  1298 raft_consensus.cc:1081] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.091256  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50052
I20260709 12:57:21.091850  1102 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:21.092157  1102 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.097645  1102 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.099431  1102 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 4 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:21.100564  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:21.100508  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:21.101199  1249 raft_consensus.cc:3055] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:21.101270  1178 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.101471  1249 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:21.102290  1249 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.103322  1249 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.106966  1178 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 4.
I20260709 12:57:21.108278  1070 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54b04137abb24f70854bce04efd72fba, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:21.108517  1249 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 4.
I20260709 12:57:21.109153  1408 raft_consensus.cc:2804] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:21.109793  1408 raft_consensus.cc:697] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:21.110668  1408 consensus_queue.cc:237] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.117923  1000 catalog_manager.cc:5697] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 3 to 4, leader changed from 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:21.119359  1297 raft_consensus.cc:993] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.119933  1406 raft_consensus.cc:1081] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.121577  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50056
I20260709 12:57:21.122073  1102 raft_consensus.cc:493] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:21.122354  1102 raft_consensus.cc:3060] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.128949  1102 raft_consensus.cc:515] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.130895  1102 leader_election.cc:290] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:21.131783  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:21.132414  1178 raft_consensus.cc:3055] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:21.132745  1178 raft_consensus.cc:740] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:21.132882  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfdab0be66447dfbd63a6db2a213d35" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:21.133541  1406 raft_consensus.cc:993] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: : Instructing follower f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.133591  1249 raft_consensus.cc:3060] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.134076  1406 raft_consensus.cc:1081] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Signalling peer f1b1bf1ab07e4f37a3f99019704d074a to start an election
I20260709 12:57:21.133833  1178 consensus_queue.cc:260] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.135229  1178 raft_consensus.cc:3060] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.135795  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b08836207ad4314813fec860aca9d47"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
 from {username='slave'} at 127.0.0.1:50056
I20260709 12:57:21.136299  1102 raft_consensus.cc:493] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:21.136622  1102 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.142413  1249 raft_consensus.cc:2468] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:21.144235  1070 leader_election.cc:304] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:21.144141  1102 raft_consensus.cc:515] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.145007  1178 raft_consensus.cc:2468] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:21.145263  1408 raft_consensus.cc:2804] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:21.146311  1102 leader_election.cc:290] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:21.146744  1408 raft_consensus.cc:697] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:21.147804  1408 consensus_queue.cc:237] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.148365  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:21.148607  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:21.149215  1249 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.149219  1178 raft_consensus.cc:3055] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:21.149792  1178 raft_consensus.cc:740] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:21.150643  1178 consensus_queue.cc:260] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.152127  1178 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.157311  1249 raft_consensus.cc:2468] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:21.157471  1000 catalog_manager.cc:5697] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:21.158658  1070 leader_election.cc:304] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:21.159605  1408 raft_consensus.cc:2804] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:21.160380  1408 raft_consensus.cc:697] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Leader. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:21.161284  1408 consensus_queue.cc:237] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:21.164290  1178 raft_consensus.cc:2468] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b1bf1ab07e4f37a3f99019704d074a in term 2.
I20260709 12:57:21.173492  1000 catalog_manager.cc:5697] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a reported cstate change: term changed from 1 to 2, leader changed from 54b04137abb24f70854bce04efd72fba (127.0.107.194) to f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:21.361438  1178 raft_consensus.cc:1275] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:21.362869  1408 consensus_queue.cc:1048] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:21.374774  1249 raft_consensus.cc:1275] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:21.376546  1432 consensus_queue.cc:1048] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:21.522105  1274 debug-util.cc:398] Leaking SignalData structure 0x7b08001b45c0 after lost signal to thread 434
W20260709 12:57:21.523065  1274 debug-util.cc:398] Leaking SignalData structure 0x7b080018cea0 after lost signal to thread 1036
W20260709 12:57:21.524150  1274 debug-util.cc:398] Leaking SignalData structure 0x7b08001cc480 after lost signal to thread 1128
W20260709 12:57:21.524997  1274 debug-util.cc:398] Leaking SignalData structure 0x7b08001bdfe0 after lost signal to thread 1203
W20260709 12:57:21.525815  1274 debug-util.cc:398] Leaking SignalData structure 0x7b0800172f60 after lost signal to thread 1277
I20260709 12:57:21.577476  1178 raft_consensus.cc:1275] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:21.579257  1408 consensus_queue.cc:1048] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:21.594144  1249 raft_consensus.cc:1275] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:21.598464  1249 raft_consensus.cc:1275] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:21.601832  1432 consensus_queue.cc:1048] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:21.603283  1407 consensus_queue.cc:1048] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:21.609161  1252 raft_consensus.cc:1275] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:21.610877  1253 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:21.612980  1432 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:21.615427  1432 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:21.641503  1178 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:21.644382  1178 raft_consensus.cc:1275] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:21.645442  1432 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:21.648669  1432 consensus_queue.cc:1048] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:21.702167  1177 raft_consensus.cc:1275] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Refusing update from remote peer f1b1bf1ab07e4f37a3f99019704d074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:21.704434  1432 consensus_queue.cc:1048] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:23.874541   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:23.883023  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
mode: GRACEFUL
new_leader_uuid: "54b04137abb24f70854bce04efd72fba"
 from {username='slave'} at 127.0.0.1:50062
I20260709 12:57:23.883845  1102 raft_consensus.cc:606] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Received request to transfer leadership to TS 54b04137abb24f70854bce04efd72fba
I20260709 12:57:23.886826  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dbd6121c901487c85a350611aabe168"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
mode: GRACEFUL
new_leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:50062
I20260709 12:57:23.887460  1102 raft_consensus.cc:606] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Received request to transfer leadership to TS 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:23.890504  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b08836207ad4314813fec860aca9d47"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
mode: GRACEFUL
new_leader_uuid: "54b04137abb24f70854bce04efd72fba"
 from {username='slave'} at 127.0.0.1:50062
I20260709 12:57:23.891137  1102 raft_consensus.cc:606] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Received request to transfer leadership to TS 54b04137abb24f70854bce04efd72fba
I20260709 12:57:23.893775  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
mode: GRACEFUL
new_leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:50062
I20260709 12:57:23.894383  1102 raft_consensus.cc:606] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Received request to transfer leadership to TS 4be4a452a7c14d7cb6db0a53f1766bb0
I20260709 12:57:23.895668   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:57:23.896350   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:24.055622  1448 raft_consensus.cc:993] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: : Instructing follower 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:24.056262  1448 raft_consensus.cc:1081] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Signalling peer 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:24.058269  1250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dbd6121c901487c85a350611aabe168"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:35850
I20260709 12:57:24.058830  1250 raft_consensus.cc:493] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:24.059156  1250 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.065026  1250 raft_consensus.cc:515] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:24.067090  1250 leader_election.cc:290] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 3 election: Requested vote from peers 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503), f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215)
I20260709 12:57:24.068519  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:24.069258  1177 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.069432  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbd6121c901487c85a350611aabe168" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:24.070041  1102 raft_consensus.cc:3055] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.070346  1102 raft_consensus.cc:740] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:24.071165  1102 consensus_queue.cc:260] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:24.072271  1102 raft_consensus.cc:3060] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.077476  1102 raft_consensus.cc:2468] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 3.
I20260709 12:57:24.077775  1177 raft_consensus.cc:2468] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 3.
I20260709 12:57:24.078720  1219 leader_election.cc:304] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, f1b1bf1ab07e4f37a3f99019704d074a; no voters: 
I20260709 12:57:24.079659  1438 raft_consensus.cc:2804] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.080964  1438 raft_consensus.cc:697] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:24.081844  1438 consensus_queue.cc:237] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } }
I20260709 12:57:24.091391  1001 catalog_manager.cc:5697] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 2 to 3, leader changed from f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193) to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.114399  1407 raft_consensus.cc:993] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: : Instructing follower 54b04137abb24f70854bce04efd72fba to start an election
I20260709 12:57:24.115012  1407 raft_consensus.cc:1081] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Signalling peer 54b04137abb24f70854bce04efd72fba to start an election
I20260709 12:57:24.116945  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b08836207ad4314813fec860aca9d47"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
 from {username='slave'} at 127.0.0.1:58304
I20260709 12:57:24.117568  1177 raft_consensus.cc:493] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:24.117902  1177 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.123605  1177 raft_consensus.cc:515] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.125500  1177 leader_election.cc:290] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 3 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:24.126545  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:24.127188  1102 raft_consensus.cc:3055] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.127164  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08836207ad4314813fec860aca9d47" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:24.127676  1102 raft_consensus.cc:740] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:24.127871  1250 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.128558  1102 consensus_queue.cc:260] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.130016  1102 raft_consensus.cc:3060] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.136602  1250 raft_consensus.cc:2468] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 3.
I20260709 12:57:24.138093  1102 raft_consensus.cc:2468] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 3.
I20260709 12:57:24.138312  1145 leader_election.cc:304] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:24.139277  1297 raft_consensus.cc:2804] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.140645  1297 raft_consensus.cc:697] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 3 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:24.141656  1297 consensus_queue.cc:237] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.148955  1001 catalog_manager.cc:5697] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 2 to 3, leader changed from f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193) to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 3 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.260159  1407 raft_consensus.cc:993] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: : Instructing follower 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:24.260699  1448 raft_consensus.cc:1081] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Signalling peer 4be4a452a7c14d7cb6db0a53f1766bb0 to start an election
I20260709 12:57:24.262553  1253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a"
dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
 from {username='slave'} at 127.0.0.1:35850
I20260709 12:57:24.263093  1253 raft_consensus.cc:493] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:24.263393  1253 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:24.269806  1253 raft_consensus.cc:515] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.271993  1253 leader_election.cc:290] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 5 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 54b04137abb24f70854bce04efd72fba (127.0.107.194:38503)
I20260709 12:57:24.272811  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:24.273166  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d0f86aee604187868afe787e7d356a" candidate_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "54b04137abb24f70854bce04efd72fba"
I20260709 12:57:24.273469  1102 raft_consensus.cc:3055] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:24.273782  1177 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:24.273833  1102 raft_consensus.cc:740] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:24.274751  1102 consensus_queue.cc:260] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.275756  1102 raft_consensus.cc:3060] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:24.279278  1177 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 5.
I20260709 12:57:24.280694  1219 leader_election.cc:304] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:24.280890  1102 raft_consensus.cc:2468] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be4a452a7c14d7cb6db0a53f1766bb0 in term 5.
I20260709 12:57:24.281548  1438 raft_consensus.cc:2804] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:24.282032  1438 raft_consensus.cc:697] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 5 LEADER]: Becoming Leader. State: Replica: 4be4a452a7c14d7cb6db0a53f1766bb0, State: Running, Role: LEADER
I20260709 12:57:24.282868  1438 consensus_queue.cc:237] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.290247  1001 catalog_manager.cc:5697] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 reported cstate change: term changed from 4 to 5, leader changed from f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193) to 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.388264  1407 raft_consensus.cc:993] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: : Instructing follower 54b04137abb24f70854bce04efd72fba to start an election
I20260709 12:57:24.388882  1448 raft_consensus.cc:1081] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Signalling peer 54b04137abb24f70854bce04efd72fba to start an election
I20260709 12:57:24.390767  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8"
dest_uuid: "54b04137abb24f70854bce04efd72fba"
 from {username='slave'} at 127.0.0.1:58304
I20260709 12:57:24.391489  1177 raft_consensus.cc:493] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:24.391817  1177 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.397272  1177 raft_consensus.cc:515] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.398907  1177 leader_election.cc:290] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 3 election: Requested vote from peers f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215), 4be4a452a7c14d7cb6db0a53f1766bb0 (127.0.107.195:38901)
I20260709 12:57:24.400151  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0"
I20260709 12:57:24.400732  1253 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.401651  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160bce452acd40e2a0397313b9e49ff8" candidate_uuid: "54b04137abb24f70854bce04efd72fba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b1bf1ab07e4f37a3f99019704d074a"
I20260709 12:57:24.402374  1102 raft_consensus.cc:3055] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.402681  1102 raft_consensus.cc:740] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1b1bf1ab07e4f37a3f99019704d074a, State: Running, Role: LEADER
I20260709 12:57:24.403424  1102 consensus_queue.cc:260] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.404420  1102 raft_consensus.cc:3060] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.407160  1253 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 3.
I20260709 12:57:24.408463  1145 leader_election.cc:304] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be4a452a7c14d7cb6db0a53f1766bb0, 54b04137abb24f70854bce04efd72fba; no voters: 
I20260709 12:57:24.409224  1297 raft_consensus.cc:2804] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.409736  1297 raft_consensus.cc:697] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 3 LEADER]: Becoming Leader. State: Replica: 54b04137abb24f70854bce04efd72fba, State: Running, Role: LEADER
I20260709 12:57:24.409818  1102 raft_consensus.cc:2468] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54b04137abb24f70854bce04efd72fba in term 3.
I20260709 12:57:24.410627  1297 consensus_queue.cc:237] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } }
I20260709 12:57:24.419308  1001 catalog_manager.cc:5697] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba reported cstate change: term changed from 2 to 3, leader changed from f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193) to 54b04137abb24f70854bce04efd72fba (127.0.107.194). New cstate: current_term: 3 leader_uuid: "54b04137abb24f70854bce04efd72fba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.504076  1177 raft_consensus.cc:1275] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:24.505467  1438 consensus_queue.cc:1048] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:24.518395  1102 raft_consensus.cc:1275] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:24.520555  1449 consensus_queue.cc:1048] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:24.562573  1253 raft_consensus.cc:1275] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Refusing update from remote peer 54b04137abb24f70854bce04efd72fba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:24.563990  1297 consensus_queue.cc:1048] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:24.566731  1102 raft_consensus.cc:1275] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Refusing update from remote peer 54b04137abb24f70854bce04efd72fba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:24.568245  1455 consensus_queue.cc:1048] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:24.832419  1102 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 5 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:24.834695  1449 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:24.841997  1253 raft_consensus.cc:1275] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Refusing update from remote peer 54b04137abb24f70854bce04efd72fba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:24.844465  1177 raft_consensus.cc:1275] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 5 FOLLOWER]: Refusing update from remote peer 4be4a452a7c14d7cb6db0a53f1766bb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:24.846632  1101 raft_consensus.cc:1275] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Refusing update from remote peer 54b04137abb24f70854bce04efd72fba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:24.847774  1456 consensus_queue.cc:1048] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be4a452a7c14d7cb6db0a53f1766bb0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:24.848018  1469 consensus_queue.cc:1048] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b04137abb24f70854bce04efd72fba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:24.848738  1455 consensus_queue.cc:1048] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b1bf1ab07e4f37a3f99019704d074a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:24.897377   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:24.904922   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:57:24.934423   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:24.935245   431 tablet_replica.cc:333] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.936064   431 raft_consensus.cc:2243] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:24.936964   431 raft_consensus.cc:2272] T 9d32c62a8f004707a35084722cd7ffcf P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.939118   431 tablet_replica.cc:333] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.939824   431 raft_consensus.cc:2243] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:24.940323   431 raft_consensus.cc:2272] T f5d0f86aee604187868afe787e7d356a P f1b1bf1ab07e4f37a3f99019704d074a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.942873   431 tablet_replica.cc:333] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.943800   431 raft_consensus.cc:2243] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:24.944646   431 raft_consensus.cc:2272] T c0090850f88a462aa3c696226bb9aa23 P f1b1bf1ab07e4f37a3f99019704d074a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.947397   431 tablet_replica.cc:333] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.948148   431 raft_consensus.cc:2243] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:24.948585   431 raft_consensus.cc:2272] T 3b08836207ad4314813fec860aca9d47 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:24.951388  1219 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:57:24.953006   431 tablet_replica.cc:333] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.953869   431 raft_consensus.cc:2243] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:24.954429   431 raft_consensus.cc:2272] T 160bce452acd40e2a0397313b9e49ff8 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.957938   431 tablet_replica.cc:333] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.958688   431 raft_consensus.cc:2243] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:57:24.958782  1219 consensus_peers.cc:597] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 -> Peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Couldn't send request to peer f1b1bf1ab07e4f37a3f99019704d074a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:24.959374   431 raft_consensus.cc:2272] T 2dbd6121c901487c85a350611aabe168 P f1b1bf1ab07e4f37a3f99019704d074a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.961907   431 tablet_replica.cc:333] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.962607   431 raft_consensus.cc:2243] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:24.963502   431 raft_consensus.cc:2272] T 6ea906c2570c4ff48d16a208bbd65e6a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.965711   431 tablet_replica.cc:333] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.966275   431 raft_consensus.cc:2243] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:24.966732   431 raft_consensus.cc:2272] T 49c68901a062468281aec2a4cb4264d3 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.968863   431 tablet_replica.cc:333] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.969396   431 raft_consensus.cc:2243] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:24.969872   431 raft_consensus.cc:2272] T 7e7313f2d0434889940f3f529ebfb87a P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:24.972002   431 tablet_replica.cc:333] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a: stopping tablet replica
I20260709 12:57:24.972465   431 raft_consensus.cc:2243] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:24.973173   431 raft_consensus.cc:2272] T 4dfdab0be66447dfbd63a6db2a213d35 P f1b1bf1ab07e4f37a3f99019704d074a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.000389   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:57:25.023259   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:57:25.050454   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:25.051195   431 tablet_replica.cc:333] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.052024   431 raft_consensus.cc:2243] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.052978   431 raft_consensus.cc:2272] T 49c68901a062468281aec2a4cb4264d3 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.055202   431 tablet_replica.cc:333] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.055872   431 raft_consensus.cc:2243] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.056417   431 raft_consensus.cc:2272] T 6ea906c2570c4ff48d16a208bbd65e6a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.058491   431 tablet_replica.cc:333] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.059042   431 raft_consensus.cc:2243] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.059525   431 raft_consensus.cc:2272] T 7e7313f2d0434889940f3f529ebfb87a P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.061488   431 tablet_replica.cc:333] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.062049   431 raft_consensus.cc:2243] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.062507   431 raft_consensus.cc:2272] T 9d32c62a8f004707a35084722cd7ffcf P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.064702   431 tablet_replica.cc:333] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.065284   431 raft_consensus.cc:2243] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.065781   431 raft_consensus.cc:2272] T f5d0f86aee604187868afe787e7d356a P 54b04137abb24f70854bce04efd72fba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.068979   431 tablet_replica.cc:333] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.069643   431 raft_consensus.cc:2243] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.070212   431 raft_consensus.cc:2272] T c0090850f88a462aa3c696226bb9aa23 P 54b04137abb24f70854bce04efd72fba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.072474   431 tablet_replica.cc:333] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.073055   431 raft_consensus.cc:2243] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.073501   431 raft_consensus.cc:2272] T 4dfdab0be66447dfbd63a6db2a213d35 P 54b04137abb24f70854bce04efd72fba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:25.074855  1145 consensus_peers.cc:597] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba -> Peer f1b1bf1ab07e4f37a3f99019704d074a (127.0.107.193:39215): Couldn't send request to peer f1b1bf1ab07e4f37a3f99019704d074a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:25.075495   431 tablet_replica.cc:333] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.076215   431 raft_consensus.cc:2243] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.077050   431 raft_consensus.cc:2272] T 3b08836207ad4314813fec860aca9d47 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.079298   431 tablet_replica.cc:333] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.079928   431 raft_consensus.cc:2243] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.080775   431 raft_consensus.cc:2272] T 160bce452acd40e2a0397313b9e49ff8 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.083029   431 tablet_replica.cc:333] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba: stopping tablet replica
I20260709 12:57:25.083695   431 raft_consensus.cc:2243] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.084240   431 raft_consensus.cc:2272] T 2dbd6121c901487c85a350611aabe168 P 54b04137abb24f70854bce04efd72fba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.115892   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:57:25.139705   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:57:25.168107   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:25.168952   431 tablet_replica.cc:333] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.169611   431 raft_consensus.cc:2243] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.170439   431 raft_consensus.cc:2272] T 7e7313f2d0434889940f3f529ebfb87a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.172793   431 tablet_replica.cc:333] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.173326   431 raft_consensus.cc:2243] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.174109   431 raft_consensus.cc:2272] T 2dbd6121c901487c85a350611aabe168 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.176433   431 tablet_replica.cc:333] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.176945   431 raft_consensus.cc:2243] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.177421   431 raft_consensus.cc:2272] T 49c68901a062468281aec2a4cb4264d3 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.179350   431 tablet_replica.cc:333] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.179951   431 raft_consensus.cc:2243] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.180377   431 raft_consensus.cc:2272] T 6ea906c2570c4ff48d16a208bbd65e6a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.182302   431 tablet_replica.cc:333] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.182797   431 raft_consensus.cc:2243] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.183187   431 raft_consensus.cc:2272] T 4dfdab0be66447dfbd63a6db2a213d35 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.185297   431 tablet_replica.cc:333] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.185884   431 raft_consensus.cc:2243] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.186300   431 raft_consensus.cc:2272] T 160bce452acd40e2a0397313b9e49ff8 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.188552   431 tablet_replica.cc:333] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.189109   431 raft_consensus.cc:2243] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.189491   431 raft_consensus.cc:2272] T 3b08836207ad4314813fec860aca9d47 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.191859   431 tablet_replica.cc:333] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.192438   431 raft_consensus.cc:2243] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.193274   431 raft_consensus.cc:2272] T f5d0f86aee604187868afe787e7d356a P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.195508   431 tablet_replica.cc:333] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.196138   431 raft_consensus.cc:2243] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.196606   431 raft_consensus.cc:2272] T c0090850f88a462aa3c696226bb9aa23 P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.198624   431 tablet_replica.cc:333] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0: stopping tablet replica
I20260709 12:57:25.199134   431 raft_consensus.cc:2243] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:25.199651   431 raft_consensus.cc:2272] T 9d32c62a8f004707a35084722cd7ffcf P 4be4a452a7c14d7cb6db0a53f1766bb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.243134   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:57:25.265122   431 master.cc:562] Master@127.0.107.254:33063 shutting down...
I20260709 12:57:25.289805   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:25.290392   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:25.290694   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7ab0b4ff27e74fa6a10b4191f422dbe4: stopping tablet replica
I20260709 12:57:25.312572   431 master.cc:584] Master@127.0.107.254:33063 shutdown complete.
4be4a452a7c14d7cb6db0a53f1766bb0  1
54b04137abb24f70854bce04efd72fba  4
f1b1bf1ab07e4f37a3f99019704d074a  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10827 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:57:25.361253   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:44561
I20260709 12:57:25.362717   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:25.369585  1477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.369719  1476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.370612  1479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:25.371963   431 server_base.cc:1061] running on GCE node
I20260709 12:57:25.372956   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:25.373179   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:25.373297   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601845373285 us; error 0 us; skew 500 ppm
I20260709 12:57:25.373826   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:25.377200   431 webserver.cc:533] Webserver started at http://127.0.107.254:41863/ using document root <none> and password file <none>
I20260709 12:57:25.377843   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:25.378039   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:25.378309   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:25.380913   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "de45a76180d64c6884c212bcc9eaa1c0"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.386986   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:57:25.391378  1484 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.392478   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:57:25.392897   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "de45a76180d64c6884c212bcc9eaa1c0"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.393270   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:25.409288   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:25.410804   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:25.456552   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:44561
I20260709 12:57:25.456601  1535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:44561 every 8 connection(s)
I20260709 12:57:25.461531  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:25.472779  1536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Bootstrap starting.
I20260709 12:57:25.478109  1536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:25.483234  1536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: No bootstrap required, opened a new log
I20260709 12:57:25.485785  1536 raft_consensus.cc:359] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de45a76180d64c6884c212bcc9eaa1c0" member_type: VOTER }
I20260709 12:57:25.486259  1536 raft_consensus.cc:385] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:25.486581  1536 raft_consensus.cc:740] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de45a76180d64c6884c212bcc9eaa1c0, State: Initialized, Role: FOLLOWER
I20260709 12:57:25.487291  1536 consensus_queue.cc:260] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de45a76180d64c6884c212bcc9eaa1c0" member_type: VOTER }
I20260709 12:57:25.487829  1536 raft_consensus.cc:399] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:25.488070  1536 raft_consensus.cc:493] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:25.488335  1536 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:25.498919  1536 raft_consensus.cc:515] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de45a76180d64c6884c212bcc9eaa1c0" member_type: VOTER }
I20260709 12:57:25.499686  1536 leader_election.cc:304] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de45a76180d64c6884c212bcc9eaa1c0; no voters: 
I20260709 12:57:25.501125  1536 leader_election.cc:290] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:25.501541  1539 raft_consensus.cc:2804] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:25.503307  1539 raft_consensus.cc:697] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 1 LEADER]: Becoming Leader. State: Replica: de45a76180d64c6884c212bcc9eaa1c0, State: Running, Role: LEADER
I20260709 12:57:25.504051  1539 consensus_queue.cc:237] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de45a76180d64c6884c212bcc9eaa1c0" member_type: VOTER }
I20260709 12:57:25.504690  1536 sys_catalog.cc:565] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:25.509006  1540 sys_catalog.cc:455] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de45a76180d64c6884c212bcc9eaa1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de45a76180d64c6884c212bcc9eaa1c0" member_type: VOTER } }
I20260709 12:57:25.509927  1540 sys_catalog.cc:458] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:25.511663  1541 sys_catalog.cc:455] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de45a76180d64c6884c212bcc9eaa1c0. Latest consensus state: current_term: 1 leader_uuid: "de45a76180d64c6884c212bcc9eaa1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de45a76180d64c6884c212bcc9eaa1c0" member_type: VOTER } }
I20260709 12:57:25.512091  1546 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:25.512351  1541 sys_catalog.cc:458] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:25.517398  1546 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:25.522699   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:25.527150  1546 catalog_manager.cc:1383] Generated new cluster ID: 4cf5497694a840bdb824919d24665da7
I20260709 12:57:25.527484  1546 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:25.577143  1546 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:25.578600  1546 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:25.594240  1546 catalog_manager.cc:6070] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Generated new TSK 0
I20260709 12:57:25.595047  1546 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:25.655155   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:25.662272  1557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.663602  1558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.665154  1560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:25.665334   431 server_base.cc:1061] running on GCE node
I20260709 12:57:25.666473   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:25.666707   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:25.666913   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601845666872 us; error 0 us; skew 500 ppm
I20260709 12:57:25.667651   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:25.670455   431 webserver.cc:533] Webserver started at http://127.0.107.193:35657/ using document root <none> and password file <none>
I20260709 12:57:25.670987   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:25.671201   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:25.671500   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:25.672744   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "693257b3078444e0bd26d3e82159d452"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.677922   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:57:25.682307  1565 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.683789   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:57:25.684151   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "693257b3078444e0bd26d3e82159d452"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.684505   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:25.708617   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:25.710107   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:25.712077   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:25.714675   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:25.714929   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.715184   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:25.715390   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.763401   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37007
I20260709 12:57:25.763506  1627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37007 every 8 connection(s)
I20260709 12:57:25.769217   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:25.776782  1632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.778115  1633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.780076  1635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:25.782238   431 server_base.cc:1061] running on GCE node
I20260709 12:57:25.783032  1628 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44561
I20260709 12:57:25.783456  1628 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:25.784039   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:25.784271   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:25.784471   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601845784432 us; error 0 us; skew 500 ppm
I20260709 12:57:25.784461  1628 heartbeater.cc:507] Master 127.0.107.254:44561 requested a full tablet report, sending...
I20260709 12:57:25.785228   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:25.787350  1501 ts_manager.cc:194] Registered new tserver with Master: 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 12:57:25.788646   431 webserver.cc:533] Webserver started at http://127.0.107.194:33025/ using document root <none> and password file <none>
I20260709 12:57:25.789374   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:25.789630   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:25.789932   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:25.790131  1501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56632
I20260709 12:57:25.791712   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "1a40ab12c220464db732562e88c32c11"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.796999   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:57:25.800611  1640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.801448   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:57:25.801797   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "1a40ab12c220464db732562e88c32c11"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.802127   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:25.821152   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:25.822570   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:25.824334   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:25.827099   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:25.827359   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.827657   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:25.827847   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.874945   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39729
I20260709 12:57:25.875079  1702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39729 every 8 connection(s)
I20260709 12:57:25.880250   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:25.888967  1706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:25.889793  1707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:25.892693   431 server_base.cc:1061] running on GCE node
W20260709 12:57:25.893813  1710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:25.895071   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:57:25.895123  1703 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44561
W20260709 12:57:25.895408   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:25.895680  1703 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:25.895689   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601845895672 us; error 0 us; skew 500 ppm
I20260709 12:57:25.896487   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:25.896639  1703 heartbeater.cc:507] Master 127.0.107.254:44561 requested a full tablet report, sending...
I20260709 12:57:25.899197  1501 ts_manager.cc:194] Registered new tserver with Master: 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:25.899585   431 webserver.cc:533] Webserver started at http://127.0.107.195:41861/ using document root <none> and password file <none>
I20260709 12:57:25.900254   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:25.900506   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:25.900840   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:25.901270  1501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56640
I20260709 12:57:25.902427   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "fab19506de7242869c29d70c9fffb739"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.907891   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:57:25.911968  1714 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.912942   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:57:25.913293   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "fab19506de7242869c29d70c9fffb739"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-fc6v"
I20260709 12:57:25.913671   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:25.936215   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:25.937693   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:25.939465   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:25.942106   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:25.942351   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.942654   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:25.942845   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.992590   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43001
I20260709 12:57:25.992707  1776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43001 every 8 connection(s)
I20260709 12:57:26.009594  1777 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44561
I20260709 12:57:26.010073  1777 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:26.011266  1777 heartbeater.cc:507] Master 127.0.107.254:44561 requested a full tablet report, sending...
I20260709 12:57:26.014173  1501 ts_manager.cc:194] Registered new tserver with Master: fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:26.014369   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017635111s
I20260709 12:57:26.016276  1501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56644
I20260709 12:57:26.044545  1501 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56658:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:26.051381  1501 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:26.278445  1593 tablet_service.cc:1511] Processing CreateTablet for tablet ae709ecc740b452bbba5c6360b053347 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:26.279448  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 88f288076c934a55b8d0dfe7855d4db9 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:26.280157  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae709ecc740b452bbba5c6360b053347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.280916  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f288076c934a55b8d0dfe7855d4db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.284715  1590 tablet_service.cc:1511] Processing CreateTablet for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:26.286294  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.288729  1587 tablet_service.cc:1511] Processing CreateTablet for tablet c1c6eb4be18b446b8252b29274f2b941 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:26.290272  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c6eb4be18b446b8252b29274f2b941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.295928  1589 tablet_service.cc:1511] Processing CreateTablet for tablet bc29da50f1424c238eee239d451aab3c (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:26.297509  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29da50f1424c238eee239d451aab3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.300928  1588 tablet_service.cc:1511] Processing CreateTablet for tablet e922046ac7c0490f8b70ef22b66bfc6b (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:26.302482  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922046ac7c0490f8b70ef22b66bfc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.304906  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 22178ca5cca34225bf0682753c951fb7 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:26.307444  1585 tablet_service.cc:1511] Processing CreateTablet for tablet 75dc4812cc534228899ce2b7b14d2237 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:26.310002  1742 tablet_service.cc:1511] Processing CreateTablet for tablet ae709ecc740b452bbba5c6360b053347 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:26.311509  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae709ecc740b452bbba5c6360b053347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.317705  1737 tablet_service.cc:1511] Processing CreateTablet for tablet e922046ac7c0490f8b70ef22b66bfc6b (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:26.282310  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 19b0503746074acbb6bd55ef700df0ae (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:26.319355  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922046ac7c0490f8b70ef22b66bfc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.312907  1741 tablet_service.cc:1511] Processing CreateTablet for tablet 19b0503746074acbb6bd55ef700df0ae (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:26.325321  1741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b0503746074acbb6bd55ef700df0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.328938  1735 tablet_service.cc:1511] Processing CreateTablet for tablet 22178ca5cca34225bf0682753c951fb7 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:26.330608  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22178ca5cca34225bf0682753c951fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.333330  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 75dc4812cc534228899ce2b7b14d2237 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:26.335073  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc4812cc534228899ce2b7b14d2237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.340180  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b0503746074acbb6bd55ef700df0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.343966  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc4812cc534228899ce2b7b14d2237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.347043  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22178ca5cca34225bf0682753c951fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.353263  1733 tablet_service.cc:1511] Processing CreateTablet for tablet d53e959bd0a14b21aa72696bbf6d090d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:26.314309  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 88f288076c934a55b8d0dfe7855d4db9 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:26.314718  1736 tablet_service.cc:1511] Processing CreateTablet for tablet c1c6eb4be18b446b8252b29274f2b941 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:26.317446  1739 tablet_service.cc:1511] Processing CreateTablet for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:26.316854  1738 tablet_service.cc:1511] Processing CreateTablet for tablet bc29da50f1424c238eee239d451aab3c (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:26.317041  1584 tablet_service.cc:1511] Processing CreateTablet for tablet d53e959bd0a14b21aa72696bbf6d090d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:26.358796  1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e959bd0a14b21aa72696bbf6d090d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.314592  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 32a3fe9094ec43a1a21a897a8aa2513d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:26.365337  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a3fe9094ec43a1a21a897a8aa2513d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.355180  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e959bd0a14b21aa72696bbf6d090d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.368512  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29da50f1424c238eee239d451aab3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.369334  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c6eb4be18b446b8252b29274f2b941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.370040  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.376021  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f288076c934a55b8d0dfe7855d4db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.384298  1668 tablet_service.cc:1511] Processing CreateTablet for tablet ae709ecc740b452bbba5c6360b053347 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:26.386044  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae709ecc740b452bbba5c6360b053347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.385576  1664 tablet_service.cc:1511] Processing CreateTablet for tablet bc29da50f1424c238eee239d451aab3c (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:26.387701  1659 tablet_service.cc:1511] Processing CreateTablet for tablet d53e959bd0a14b21aa72696bbf6d090d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:26.388782  1662 tablet_service.cc:1511] Processing CreateTablet for tablet c1c6eb4be18b446b8252b29274f2b941 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:26.390260  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 19b0503746074acbb6bd55ef700df0ae (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:26.392911  1660 tablet_service.cc:1511] Processing CreateTablet for tablet 75dc4812cc534228899ce2b7b14d2237 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:26.394256  1665 tablet_service.cc:1511] Processing CreateTablet for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:26.395744  1663 tablet_service.cc:1511] Processing CreateTablet for tablet e922046ac7c0490f8b70ef22b66bfc6b (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:26.397141  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b0503746074acbb6bd55ef700df0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.399827  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e959bd0a14b21aa72696bbf6d090d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.392911  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 88f288076c934a55b8d0dfe7855d4db9 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:26.391317  1661 tablet_service.cc:1511] Processing CreateTablet for tablet 22178ca5cca34225bf0682753c951fb7 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:26.406503  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c6eb4be18b446b8252b29274f2b941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.408361  1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc4812cc534228899ce2b7b14d2237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.412518  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29da50f1424c238eee239d451aab3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.413340  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f288076c934a55b8d0dfe7855d4db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.416162  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.417096  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922046ac7c0490f8b70ef22b66bfc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.418619  1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22178ca5cca34225bf0682753c951fb7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:26.518123  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:26.524482  1792 tablet_bootstrap.cc:492] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:26.533643  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 22373089b38b498393c2161e53b5f016 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:26.540091  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 03d13a42db4a4920828af42492055735 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:26.541611  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d13a42db4a4920828af42492055735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.542351  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22373089b38b498393c2161e53b5f016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.549978  1793 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:26.572716  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 03d13a42db4a4920828af42492055735 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:26.574302  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d13a42db4a4920828af42492055735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.577942  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 32a3fe9094ec43a1a21a897a8aa2513d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:26.555303  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 46080b3c17204e34b7cfa66296431876 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:26.585062  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46080b3c17204e34b7cfa66296431876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.585939  1587 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7ba20be4524b828e4259656531c103 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:26.587392  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7ba20be4524b828e4259656531c103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.596024  1792 tablet_bootstrap.cc:654] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:26.600703  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 32a3fe9094ec43a1a21a897a8aa2513d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:26.596812  1585 tablet_service.cc:1511] Processing CreateTablet for tablet a60f7d5f008b4c6f8ee8b707a5916f7d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:26.601245  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 22373089b38b498393c2161e53b5f016 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:26.601470  1742 tablet_service.cc:1511] Processing CreateTablet for tablet 22373089b38b498393c2161e53b5f016 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:26.602422  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a3fe9094ec43a1a21a897a8aa2513d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.605321  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60f7d5f008b4c6f8ee8b707a5916f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.579442  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a3fe9094ec43a1a21a897a8aa2513d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.613179  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 46080b3c17204e34b7cfa66296431876 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:26.614697  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46080b3c17204e34b7cfa66296431876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.619882  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22373089b38b498393c2161e53b5f016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.621131  1741 tablet_service.cc:1511] Processing CreateTablet for tablet 46080b3c17204e34b7cfa66296431876 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:26.622555  1741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46080b3c17204e34b7cfa66296431876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.624639  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8238df60414b3d8b25f82937649e9a (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:26.625967  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8238df60414b3d8b25f82937649e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.632236  1794 tablet_bootstrap.cc:492] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:26.631994  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 03d13a42db4a4920828af42492055735 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:26.634181  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7ba20be4524b828e4259656531c103 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:26.638201  1793 tablet_bootstrap.cc:654] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:26.643591  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22373089b38b498393c2161e53b5f016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.648587  1660 tablet_service.cc:1511] Processing CreateTablet for tablet a60f7d5f008b4c6f8ee8b707a5916f7d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:26.649417  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8238df60414b3d8b25f82937649e9a (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:26.650108  1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60f7d5f008b4c6f8ee8b707a5916f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.650728  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8238df60414b3d8b25f82937649e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.652215  1792 tablet_bootstrap.cc:492] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:26.652807  1792 ts_tablet_manager.cc:1403] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.129s	user 0.005s	sys 0.013s
I20260709 12:57:26.663844  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d13a42db4a4920828af42492055735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.664505  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7ba20be4524b828e4259656531c103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.665287  1735 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8238df60414b3d8b25f82937649e9a (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:26.666822  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8238df60414b3d8b25f82937649e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.667799  1661 tablet_service.cc:1511] Processing CreateTablet for tablet 583de7d6884c4f96b1f47ff7066c2da9 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:26.668540  1733 tablet_service.cc:1511] Processing CreateTablet for tablet a60f7d5f008b4c6f8ee8b707a5916f7d (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:26.669415  1584 tablet_service.cc:1511] Processing CreateTablet for tablet 583de7d6884c4f96b1f47ff7066c2da9 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:26.688565  1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583de7d6884c4f96b1f47ff7066c2da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.670266  1740 tablet_service.cc:1511] Processing CreateTablet for tablet fcd92efcb3084fe59e6f16a5467bcd9e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:26.663023  1593 tablet_service.cc:1511] Processing CreateTablet for tablet fcd92efcb3084fe59e6f16a5467bcd9e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:26.692366  1792 raft_consensus.cc:359] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:26.693118  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd92efcb3084fe59e6f16a5467bcd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.693320  1792 raft_consensus.cc:385] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:26.693816  1792 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:26.682695  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 583de7d6884c4f96b1f47ff7066c2da9 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:26.683847  1666 tablet_service.cc:1511] Processing CreateTablet for tablet fcd92efcb3084fe59e6f16a5467bcd9e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:26.701985  1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583de7d6884c4f96b1f47ff7066c2da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.704031  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd92efcb3084fe59e6f16a5467bcd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.646929  1659 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7ba20be4524b828e4259656531c103 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:26.679034  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 27da507a1bb04525952847c678820e4e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:26.724606  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27da507a1bb04525952847c678820e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.708098  1792 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:26.709211  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 27da507a1bb04525952847c678820e4e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:26.719964  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60f7d5f008b4c6f8ee8b707a5916f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.732210  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd92efcb3084fe59e6f16a5467bcd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.736318  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27da507a1bb04525952847c678820e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.736222  1585 tablet_service.cc:1511] Processing CreateTablet for tablet e88aab1e8ec54d79b537a6d2dfbacdac (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:26.737839  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88aab1e8ec54d79b537a6d2dfbacdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.745716  1794 tablet_bootstrap.cc:654] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:26.747905  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583de7d6884c4f96b1f47ff7066c2da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.762367  1668 tablet_service.cc:1511] Processing CreateTablet for tablet e88aab1e8ec54d79b537a6d2dfbacdac (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:26.769573  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7ba20be4524b828e4259656531c103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.769193  1742 tablet_service.cc:1511] Processing CreateTablet for tablet e88aab1e8ec54d79b537a6d2dfbacdac (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:26.781337  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88aab1e8ec54d79b537a6d2dfbacdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.782124  1793 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:26.782680  1793 ts_tablet_manager.cc:1403] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.233s	user 0.009s	sys 0.005s
I20260709 12:57:26.786913  1793 raft_consensus.cc:359] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:26.788170  1793 raft_consensus.cc:385] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:26.788677  1793 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:26.790549  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 2eac534aa8b349bc923752022b0b9ab6 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:26.792536  1733 tablet_service.cc:1511] Processing CreateTablet for tablet 69370730433544db93e2c777aba2b9b2 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:26.793785  1628 heartbeater.cc:499] Master 127.0.107.254:44561 was elected leader, sending a full tablet report...
I20260709 12:57:26.792881  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eac534aa8b349bc923752022b0b9ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.793977  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69370730433544db93e2c777aba2b9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.800064  1792 ts_tablet_manager.cc:1434] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.147s	user 0.009s	sys 0.013s
I20260709 12:57:26.801303  1792 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:26.811992  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88aab1e8ec54d79b537a6d2dfbacdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.817180  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 27da507a1bb04525952847c678820e4e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:26.831219  1660 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8de6698b474b218d672997f3c708e3 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:26.832973  1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8de6698b474b218d672997f3c708e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.767834  1587 tablet_service.cc:1511] Processing CreateTablet for tablet a5eeee076cc0489bb6f13e55dbc52d06 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:26.844949  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27da507a1bb04525952847c678820e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.854204  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 69370730433544db93e2c777aba2b9b2 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:26.855003  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 2eac534aa8b349bc923752022b0b9ab6 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:26.856240  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69370730433544db93e2c777aba2b9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.861320  1735 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8de6698b474b218d672997f3c708e3 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:26.844983  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 2eac534aa8b349bc923752022b0b9ab6 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:26.872206  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5eeee076cc0489bb6f13e55dbc52d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.875625  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eac534aa8b349bc923752022b0b9ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.875159  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 15c13780577e4e7f939bed39d7e72045 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:26.876802  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c13780577e4e7f939bed39d7e72045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.881862  1663 tablet_service.cc:1511] Processing CreateTablet for tablet a5eeee076cc0489bb6f13e55dbc52d06 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:26.887878  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5eeee076cc0489bb6f13e55dbc52d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.831219  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 69370730433544db93e2c777aba2b9b2 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:26.896030  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69370730433544db93e2c777aba2b9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.897197  1794 tablet_bootstrap.cc:492] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:26.896939  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 3eaa544af67a451a8d99cb7cc0f7e452 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:26.897730  1794 ts_tablet_manager.cc:1403] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.266s	user 0.010s	sys 0.004s
I20260709 12:57:26.898406  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eaa544af67a451a8d99cb7cc0f7e452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.904068  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8de6698b474b218d672997f3c708e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.822911  1793 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:26.908217  1703 heartbeater.cc:499] Master 127.0.107.254:44561 was elected leader, sending a full tablet report...
I20260709 12:57:26.932188  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eac534aa8b349bc923752022b0b9ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.923013  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8de6698b474b218d672997f3c708e3 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:26.942610  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8de6698b474b218d672997f3c708e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.929240  1585 tablet_service.cc:1511] Processing CreateTablet for tablet 15c13780577e4e7f939bed39d7e72045 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:26.943771  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 3eaa544af67a451a8d99cb7cc0f7e452 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:26.944900  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c13780577e4e7f939bed39d7e72045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.945082  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eaa544af67a451a8d99cb7cc0f7e452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.918128  1659 tablet_service.cc:1511] Processing CreateTablet for tablet 5e60b8714c5d46e8a8676914b0595721 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:26.960922  1800 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.961903  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b8714c5d46e8a8676914b0595721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.916229  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 15c13780577e4e7f939bed39d7e72045 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:26.963240  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c13780577e4e7f939bed39d7e72045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.961475  1800 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:26.906262  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53081.3us
I20260709 12:57:26.969879  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 5e60b8714c5d46e8a8676914b0595721 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:26.973521  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 5e60b8714c5d46e8a8676914b0595721 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:26.974994  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b8714c5d46e8a8676914b0595721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.976207  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 86ec86569a4e46149249e63cfbd61fa4 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:26.977631  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ec86569a4e46149249e63cfbd61fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.977540  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 8f356989b6064ce99355e7583b2314ec (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:26.971469  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b8714c5d46e8a8676914b0595721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:26.996196  1800 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:26.997314  1777 heartbeater.cc:499] Master 127.0.107.254:44561 was elected leader, sending a full tablet report...
I20260709 12:57:26.913652  1741 tablet_service.cc:1511] Processing CreateTablet for tablet a5eeee076cc0489bb6f13e55dbc52d06 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:27.003474  1741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5eeee076cc0489bb6f13e55dbc52d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.003329  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 33f3320caa9849f893ce5125d17a0d48 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:27.004791  1792 tablet_bootstrap.cc:654] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.010946  1742 tablet_service.cc:1511] Processing CreateTablet for tablet 86ec86569a4e46149249e63cfbd61fa4 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:27.044101  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ec86569a4e46149249e63cfbd61fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.033493  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f356989b6064ce99355e7583b2314ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.062466  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 33f3320caa9849f893ce5125d17a0d48 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:27.064908  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f3320caa9849f893ce5125d17a0d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.067974  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f3320caa9849f893ce5125d17a0d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.057873  1794 raft_consensus.cc:359] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.068557  1794 raft_consensus.cc:385] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:27.068935  1794 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:27.070176  1794 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.086030  1793 ts_tablet_manager.cc:1434] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.303s	user 0.012s	sys 0.002s
I20260709 12:57:27.087478  1793 tablet_bootstrap.cc:492] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:27.045102  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 3eaa544af67a451a8d99cb7cc0f7e452 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:27.088953  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eaa544af67a451a8d99cb7cc0f7e452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.089581  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 86ec86569a4e46149249e63cfbd61fa4 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:27.092813  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 33f3320caa9849f893ce5125d17a0d48 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:27.096589  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1cbc949b954ba587e016d3b0db3715 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:27.097996  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1cbc949b954ba587e016d3b0db3715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.091341  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ec86569a4e46149249e63cfbd61fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.108645  1660 tablet_service.cc:1511] Processing CreateTablet for tablet ff5b3fd375a24b8cbcadef3f01d01da0 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:27.107486  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f3320caa9849f893ce5125d17a0d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.110594  1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5b3fd375a24b8cbcadef3f01d01da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.117988  1792 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:27.118585  1792 ts_tablet_manager.cc:1403] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.318s	user 0.017s	sys 0.014s
I20260709 12:57:27.121874  1792 raft_consensus.cc:359] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.122704  1792 raft_consensus.cc:385] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:27.123023  1792 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:27.124007  1792 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.126224  1792 ts_tablet_manager.cc:1434] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:27.136682  1792 tablet_bootstrap.cc:492] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:27.151139  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 57f6af13b3ef4faca52c6c12ac945d51 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:27.153677  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7e0c6a13bf4ad685049c44899c240e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:27.159056  1587 tablet_service.cc:1511] Processing CreateTablet for tablet ff5b3fd375a24b8cbcadef3f01d01da0 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:27.164829  1738 tablet_service.cc:1511] Processing CreateTablet for tablet ff5b3fd375a24b8cbcadef3f01d01da0 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:27.165817  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5b3fd375a24b8cbcadef3f01d01da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.166113  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5b3fd375a24b8cbcadef3f01d01da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.160017  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7e0c6a13bf4ad685049c44899c240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.167297  1733 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1cbc949b954ba587e016d3b0db3715 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:27.169180  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1cbc949b954ba587e016d3b0db3715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.168874  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 57f6af13b3ef4faca52c6c12ac945d51 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:27.170418  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6af13b3ef4faca52c6c12ac945d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.186949  1797 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.187637  1797 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.126072  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 8f356989b6064ce99355e7583b2314ec (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:27.144222  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 8f356989b6064ce99355e7583b2314ec (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:27.201594  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f356989b6064ce99355e7583b2314ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.207398  1797 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:27.207422  1793 tablet_bootstrap.cc:654] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.224583  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 57f6af13b3ef4faca52c6c12ac945d51 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:27.226346  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6af13b3ef4faca52c6c12ac945d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.254829  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f356989b6064ce99355e7583b2314ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.255199  1585 tablet_service.cc:1511] Processing CreateTablet for tablet 979e85778d254fc7a74198c589e12967 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:27.253851  1588 tablet_service.cc:1511] Processing CreateTablet for tablet c3c15f4148e94b83a318e5a513f2f769 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:27.259047  1794 ts_tablet_manager.cc:1434] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.361s	user 0.014s	sys 0.014s
I20260709 12:57:27.259275  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7e0c6a13bf4ad685049c44899c240e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:27.260295  1794 tablet_bootstrap.cc:492] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:27.260753  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7e0c6a13bf4ad685049c44899c240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.276568  1806 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.211056  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7e0c6a13bf4ad685049c44899c240e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:27.277922  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6af13b3ef4faca52c6c12ac945d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.289470  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c15f4148e94b83a318e5a513f2f769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.299914  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979e85778d254fc7a74198c589e12967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.302029  1735 tablet_service.cc:1511] Processing CreateTablet for tablet c3c15f4148e94b83a318e5a513f2f769 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:27.307585  1792 tablet_bootstrap.cc:654] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.310757  1794 tablet_bootstrap.cc:654] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.313378  1584 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1cbc949b954ba587e016d3b0db3715 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:27.294000  1806 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.316819  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7e0c6a13bf4ad685049c44899c240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.329339  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c15f4148e94b83a318e5a513f2f769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.344764  1659 tablet_service.cc:1511] Processing CreateTablet for tablet 979e85778d254fc7a74198c589e12967 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:27.346402  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979e85778d254fc7a74198c589e12967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.369519  1793 tablet_bootstrap.cc:492] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:27.369784  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:27.370232  1793 ts_tablet_manager.cc:1403] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.283s	user 0.015s	sys 0.021s
W20260709 12:57:27.371742  1715 leader_election.cc:343] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:27.374311  1806 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:27.374599  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3690a974c249a88aaacf8c89e51b93 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:27.376161  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3690a974c249a88aaacf8c89e51b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.376920  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 8507985adb5b47a187ad9f20a3c73870 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:27.378314  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8507985adb5b47a187ad9f20a3c73870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.382723  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3690a974c249a88aaacf8c89e51b93 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:27.340118  1666 tablet_service.cc:1511] Processing CreateTablet for tablet c3c15f4148e94b83a318e5a513f2f769 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:27.336377  1661 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3690a974c249a88aaacf8c89e51b93 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:27.389061  1792 tablet_bootstrap.cc:492] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:27.389674  1792 ts_tablet_manager.cc:1403] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.008s
I20260709 12:57:27.393548  1742 tablet_service.cc:1511] Processing CreateTablet for tablet 979e85778d254fc7a74198c589e12967 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:27.395150  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979e85778d254fc7a74198c589e12967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.398581  1793 raft_consensus.cc:359] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.399632  1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1cbc949b954ba587e016d3b0db3715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.401347  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3690a974c249a88aaacf8c89e51b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.407256  1741 tablet_service.cc:1511] Processing CreateTablet for tablet acc3d6e391b54e51aa1381c0d66b3edb (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:27.419450  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c15f4148e94b83a318e5a513f2f769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.399461  1793 raft_consensus.cc:385] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:27.420120  1793 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:27.386611  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a777ed30740c3a60219dad4a4a6ad (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:27.423976  1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3690a974c249a88aaacf8c89e51b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.429692  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a777ed30740c3a60219dad4a4a6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.432304  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 8507985adb5b47a187ad9f20a3c73870 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:27.432639  1587 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a777ed30740c3a60219dad4a4a6ad (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:27.433782  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8507985adb5b47a187ad9f20a3c73870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.446274  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a777ed30740c3a60219dad4a4a6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.440577  1662 tablet_service.cc:1511] Processing CreateTablet for tablet acc3d6e391b54e51aa1381c0d66b3edb (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:27.448288  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3d6e391b54e51aa1381c0d66b3edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.451781  1590 tablet_service.cc:1511] Processing CreateTablet for tablet acc3d6e391b54e51aa1381c0d66b3edb (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:27.453258  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3d6e391b54e51aa1381c0d66b3edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.457001  1660 tablet_service.cc:1511] Processing CreateTablet for tablet 3c468e528ecc447f9d2154d473a93b16 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:27.458729  1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c468e528ecc447f9d2154d473a93b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.460990  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 3c468e528ecc447f9d2154d473a93b16 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:27.435096  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a777ed30740c3a60219dad4a4a6ad (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:27.427943  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 24407d61d8d743c58663bb69b069d26e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:27.491684  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 51d41e7558f84fa1b99e709cb935e448 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:27.440578  1793 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.491793  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 8507985adb5b47a187ad9f20a3c73870 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:27.493392  1585 tablet_service.cc:1511] Processing CreateTablet for tablet 3c468e528ecc447f9d2154d473a93b16 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:27.494392  1793 ts_tablet_manager.cc:1434] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.001s
I20260709 12:57:27.495242  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c468e528ecc447f9d2154d473a93b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.478466  1741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3d6e391b54e51aa1381c0d66b3edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.495052  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 24407d61d8d743c58663bb69b069d26e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:27.505184  1739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 26) took 1053 ms. Trace:
I20260709 12:57:27.505843  1739 rpcz_store.cc:276] 0709 12:57:26.452142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.942708 (+490566us) service_pool.cc:224] Handling call
0709 12:57:26.944592 (+  1884us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:26.944692 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.309056 (+364364us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:27.473975 (+164919us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:27.505097 (+ 31122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.508460  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca72d2d43264fe99a56d5f4c01ed5f1 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:27.511933  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24407d61d8d743c58663bb69b069d26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.516901  1794 tablet_bootstrap.cc:492] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:27.568746  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:27.570179  1659 tablet_service.cc:1511] Processing CreateTablet for tablet 51d41e7558f84fa1b99e709cb935e448 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:27.570969  1752 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:27.550346  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 24407d61d8d743c58663bb69b069d26e (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:27.572587  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24407d61d8d743c58663bb69b069d26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.524200  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c468e528ecc447f9d2154d473a93b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.570226  1792 raft_consensus.cc:359] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.571426  1794 ts_tablet_manager.cc:1403] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.311s	user 0.025s	sys 0.003s
I20260709 12:57:27.576687  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:27.576666  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 51d41e7558f84fa1b99e709cb935e448 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:27.532869  1797 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.575573  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca72d2d43264fe99a56d5f4c01ed5f1 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:27.579237  1793 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:27.574086  1792 raft_consensus.cc:385] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:27.589071  1792 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:27.590128  1792 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.589705  1797 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.579825  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d41e7558f84fa1b99e709cb935e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.581161  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd71f19da3340e6aae32a3f83215159 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:27.558895  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:27.594385  1661 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd71f19da3340e6aae32a3f83215159 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:27.597818  1663 tablet_service.cc:1511] Processing CreateTablet for tablet caa550f278b34a45a3bc714fdc04e95c (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:27.599305  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:27.600759  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed6b8afa01f4aeaacc7cf39d3bdffeb (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:57:27.601717  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:27.604363  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca72d2d43264fe99a56d5f4c01ed5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.604131  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca72d2d43264fe99a56d5f4c01ed5f1 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:27.605270  1591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54650 (request call id 29) took 1010 ms. Trace:
I20260709 12:57:27.625999  1591 rpcz_store.cc:276] 0709 12:57:26.595230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.091767 (+496537us) service_pool.cc:224] Handling call
0709 12:57:27.093723 (+  1956us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.093838 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.488825 (+394987us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:27.604629 (+115804us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:27.605194 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.628221  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 516703d5c9f14537854665616191b5aa (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:27.613350  1797 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:27.630106  1797 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:27.630463  1797 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.630803  1797 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:27.632103  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d41e7558f84fa1b99e709cb935e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.625487  1678 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:27.634574  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca72d2d43264fe99a56d5f4c01ed5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.638572  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516703d5c9f14537854665616191b5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.640059  1586 tablet_service.cc:1511] Processing CreateTablet for tablet caa550f278b34a45a3bc714fdc04e95c (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:27.641527  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa550f278b34a45a3bc714fdc04e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.634835  1733 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd71f19da3340e6aae32a3f83215159 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:27.594815  1794 raft_consensus.cc:359] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.679813  1794 raft_consensus.cc:385] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:27.656991  1587 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed6b8afa01f4aeaacc7cf39d3bdffeb (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:27.680493  1794 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:27.681854  1794 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.668903  1584 tablet_service.cc:1511] Processing CreateTablet for tablet 0193c6e20d1c4a33997d268895b8c083 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:27.621464  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a777ed30740c3a60219dad4a4a6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.689499  1794 ts_tablet_manager.cc:1434] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.002s
I20260709 12:57:27.690778  1794 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:27.691493  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca72d2d43264fe99a56d5f4c01ed5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.693912  1667 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46970 (request call id 33) took 1001 ms. Trace:
I20260709 12:57:27.694380  1667 rpcz_store.cc:276] 0709 12:57:26.692905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.147291 (+454386us) service_pool.cc:224] Handling call
0709 12:57:27.193376 (+ 46085us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.198217 (+  4841us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.454237 (+256020us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:27.693361 (+239124us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:27.693848 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.696766  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 516703d5c9f14537854665616191b5aa (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:27.672765  1797 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.676415  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd71f19da3340e6aae32a3f83215159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.652287  1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd71f19da3340e6aae32a3f83215159. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:27.699909  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 123479us
I20260709 12:57:27.702943  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:27.703198  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:27.705541  1715 leader_election.cc:343] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:27.707033  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:27.707877  1566 leader_election.cc:343] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:27.708644  1566 leader_election.cc:343] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:27.709028  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:27.709928  1799 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:27.713721  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 852e1e3fa7a448bf924920b2d2b47558 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:27.715160  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e1e3fa7a448bf924920b2d2b47558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.721572  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:27.722409  1752 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:27.727630  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:27.728084  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:27.728947  1752 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:27.728700  1806 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:27.728710  1662 tablet_service.cc:1511] Processing CreateTablet for tablet d05c68d760d04910b7ffad46dd2ec819 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:27.729476  1806 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.729875  1806 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:27.733384  1817 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:27.726678  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24407d61d8d743c58663bb69b069d26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.741164  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d41e7558f84fa1b99e709cb935e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.743516  1735 tablet_service.cc:1511] Processing CreateTablet for tablet caa550f278b34a45a3bc714fdc04e95c (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:27.744349  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa550f278b34a45a3bc714fdc04e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.745131  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa550f278b34a45a3bc714fdc04e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.745350  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed6b8afa01f4aeaacc7cf39d3bdffeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.745754  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:27.746695  1603 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:27.750214  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd71f19da3340e6aae32a3f83215159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.752013  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516703d5c9f14537854665616191b5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.753756  1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0193c6e20d1c4a33997d268895b8c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.754601  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed6b8afa01f4aeaacc7cf39d3bdffeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.697269  1585 tablet_service.cc:1511] Processing CreateTablet for tablet d05c68d760d04910b7ffad46dd2ec819 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:27.757123  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c68d760d04910b7ffad46dd2ec819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.761144  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8507985adb5b47a187ad9f20a3c73870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.768992  1797 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:27.769830  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:27.770673  1665 tablet_service.cc:1511] Processing CreateTablet for tablet e85f5002455b4bc4bc385d3b81511511 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:27.778524  1792 ts_tablet_manager.cc:1434] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.389s	user 0.012s	sys 0.013s
I20260709 12:57:27.813651  1797 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.814386  1797 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.795258  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c68d760d04910b7ffad46dd2ec819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.818468  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:27.820566  1566 leader_election.cc:343] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:27.821973  1792 tablet_bootstrap.cc:492] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:27.823000  1588 tablet_service.cc:1511] Processing CreateTablet for tablet e85f5002455b4bc4bc385d3b81511511 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:27.769043  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 852e1e3fa7a448bf924920b2d2b47558 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:27.804713  1806 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.826525  1678 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:27.824947  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f5002455b4bc4bc385d3b81511511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.769026  1659 tablet_service.cc:1511] Processing CreateTablet for tablet 0193c6e20d1c4a33997d268895b8c083 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:27.831502  1806 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:27.832406  1806 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.833058  1806 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:27.834447  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:27.835322  1603 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:27.835644  1752 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:27.835887  1797 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:27.837019  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:27.863008  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:27.857103  1593 tablet_service.cc:1511] Processing CreateTablet for tablet a9a24b102b5d4949a5dd73c9f7d069ad (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:57:27.873785  1566 leader_election.cc:343] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:27.874337  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:27.875522  1797 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:27.837690  1794 tablet_bootstrap.cc:654] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.839226  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:27.880241  1750 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:27.840989  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:27.905555  1641 leader_election.cc:343] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:27.906787  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:27.909235  1819 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:27.912488  1792 tablet_bootstrap.cc:654] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.913878  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:27.914912  1797 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:27.916419  1797 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:27.917295  1797 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:27.844105  1793 tablet_bootstrap.cc:654] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:27.845288  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e1e3fa7a448bf924920b2d2b47558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.845538  1664 tablet_service.cc:1511] Processing CreateTablet for tablet a9a24b102b5d4949a5dd73c9f7d069ad (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:27.930047  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a24b102b5d4949a5dd73c9f7d069ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.856415  1806 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:27.868443  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f5002455b4bc4bc385d3b81511511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.931982  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a24b102b5d4949a5dd73c9f7d069ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.870896  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 077713cf7fff4fb39be348e99943d26f (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:57:27.868986  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44864us
I20260709 12:57:27.934713  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0193c6e20d1c4a33997d268895b8c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.938163  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077713cf7fff4fb39be348e99943d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.938498  1591 tablet_service.cc:1511] Processing CreateTablet for tablet c8ce4edad7b14292b8c162db2d204922 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:27.940042  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ce4edad7b14292b8c162db2d204922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.963199  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed6b8afa01f4aeaacc7cf39d3bdffeb (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:27.965291  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed6b8afa01f4aeaacc7cf39d3bdffeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.971776  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 813e209bb7f848ca8067e613c9ef43a1 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:27.973826  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e209bb7f848ca8067e613c9ef43a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:27.980880  1740 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 40) took 1013 ms. Trace:
I20260709 12:57:27.981668  1740 rpcz_store.cc:276] 0709 12:57:26.967631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.434109 (+466478us) service_pool.cc:224] Handling call
0709 12:57:27.498272 (+ 64163us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.501035 (+  2763us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.789667 (+288632us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:27.914093 (+124426us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:27.980782 (+ 66689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.000348  1737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 43) took 1011 ms. Trace:
W20260709 12:57:28.000456  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 93782.3us
W20260709 12:57:28.004498  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69247.2us
I20260709 12:57:28.026487  1499 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:28.028434  1641 leader_election.cc:343] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.029201  1660 tablet_service.cc:1511] Processing CreateTablet for tablet 077713cf7fff4fb39be348e99943d26f (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:28.033083  1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077713cf7fff4fb39be348e99943d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.031181  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:28.007181  1737 rpcz_store.cc:276] 0709 12:57:26.989022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.484022 (+495000us) service_pool.cc:224] Handling call
0709 12:57:27.541485 (+ 57463us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864c1831 00007f948649eac3 00007f948644d400 00007f947f8d2af4 00007f947f8d2a82 00007f947f8d29b1
0709 12:57:27.572124 (+ 30639us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368e9c 00007f947e368a5b 00007f9487281c09 00007f94863dbee0 00007f94864c1831 00007f948649eac3 00007f948644d400 00007f947f8d2af4 00007f947f8d2a82 00007f947f8d29b1
0709 12:57:27.587897 (+ 15773us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.593602 (+  5705us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.861902 (+268300us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:27.999489 (+137587us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.000263 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66686592}
I20260709 12:57:28.036937  1806 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:28.038750  1737 tablet_service.cc:1511] Processing CreateTablet for tablet d05c68d760d04910b7ffad46dd2ec819 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:28.030112  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 813e209bb7f848ca8067e613c9ef43a1 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:28.041307  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e209bb7f848ca8067e613c9ef43a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.059757  1592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54650 (request call id 45) took 1062 ms. Trace:
I20260709 12:57:28.104530  1592 rpcz_store.cc:276] 0709 12:57:26.997616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.580078 (+582462us) service_pool.cc:224] Handling call
0709 12:57:27.675778 (+ 95700us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.675907 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.793514 (+117607us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.059129 (+265615us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.059686 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.059422  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 0193c6e20d1c4a33997d268895b8c083 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:28.063784  1792 tablet_bootstrap.cc:492] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.067071  1734 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 42) took 1094 ms. Trace:
I20260709 12:57:28.069181  1794 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.068831  1735 tablet_service.cc:1511] Processing CreateTablet for tablet 516703d5c9f14537854665616191b5aa (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:28.104995  1659 tablet_service.cc:1511] Processing CreateTablet for tablet 60a0f19eac6047fdb1fd191d07ab7355 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:28.083456  1742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 37) took 1304 ms. Trace:
I20260709 12:57:28.108515  1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a0f19eac6047fdb1fd191d07ab7355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.108451  1742 rpcz_store.cc:276] 0709 12:57:26.783721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.392373 (+608652us) service_pool.cc:224] Handling call
0709 12:57:27.394568 (+  2195us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.394681 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:28.049924 (+655243us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.082795 (+ 32871us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.083369 (+   574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.111939  1742 tablet_service.cc:1511] Processing CreateTablet for tablet 852e1e3fa7a448bf924920b2d2b47558 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:28.092988  1587 tablet_service.cc:1511] Processing CreateTablet for tablet 60a0f19eac6047fdb1fd191d07ab7355 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:28.114137  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a0f19eac6047fdb1fd191d07ab7355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.116130  1661 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46970 (request call id 45) took 1117 ms. Trace:
I20260709 12:57:28.092990  1665 tablet_service.cc:1511] Processing CreateTablet for tablet c8ce4edad7b14292b8c162db2d204922 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:28.120508  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ce4edad7b14292b8c162db2d204922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.095835  1666 tablet_service.cc:1511] Processing CreateTablet for tablet bbe0e89474f14ac0be0bd7343e0f4601 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:28.123871  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe0e89474f14ac0be0bd7343e0f4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.125649  1741 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 38) took 1335 ms. Trace:
I20260709 12:57:28.126065  1741 rpcz_store.cc:276] 0709 12:57:26.790321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.394672 (+604351us) service_pool.cc:224] Handling call
0709 12:57:27.408348 (+ 13676us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.408464 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:28.071834 (+663370us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.125069 (+ 53235us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.125576 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.093328  1590 tablet_service.cc:1511] Processing CreateTablet for tablet bbe0e89474f14ac0be0bd7343e0f4601 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:28.106640  1792 ts_tablet_manager.cc:1403] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.285s	user 0.032s	sys 0.028s
I20260709 12:57:28.133392  1792 raft_consensus.cc:359] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.134214  1792 raft_consensus.cc:385] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.134531  1792 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.106427  1734 rpcz_store.cc:276] 0709 12:57:26.972934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.423150 (+450216us) service_pool.cc:224] Handling call
0709 12:57:27.506967 (+ 83817us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864c1831 00007f948649eac3 00007f948644d400 00007f947f8d2af4 00007f947f8d2a82 00007f947f8d29b1
0709 12:57:27.507189 (+   222us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.507357 (+   168us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.869987 (+362630us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.066473 (+196486us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.066994 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29832064}
I20260709 12:57:28.112988  1794 ts_tablet_manager.cc:1403] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.422s	user 0.016s	sys 0.013s
I20260709 12:57:28.105814  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c68d760d04910b7ffad46dd2ec819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.139019  1792 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.139984  1734 tablet_service.cc:1511] Processing CreateTablet for tablet e85f5002455b4bc4bc385d3b81511511 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:28.142874  1792 ts_tablet_manager.cc:1434] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:57:28.148574  1792 tablet_bootstrap.cc:492] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.143782  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe0e89474f14ac0be0bd7343e0f4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.117228  1661 rpcz_store.cc:276] 0709 12:57:26.998741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.586212 (+587471us) service_pool.cc:224] Handling call
0709 12:57:27.651738 (+ 65526us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.651851 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.926005 (+274154us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.114490 (+188485us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.115910 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.156663  1741 tablet_service.cc:1511] Processing CreateTablet for tablet a9a24b102b5d4949a5dd73c9f7d069ad (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:28.159324  1733 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 45) took 1158 ms. Trace:
I20260709 12:57:28.164925  1736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 39) took 1328 ms. Trace:
I20260709 12:57:28.165407  1794 raft_consensus.cc:359] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.175530  1793 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.175957  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f5002455b4bc4bc385d3b81511511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.176251  1793 ts_tablet_manager.cc:1403] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.597s	user 0.026s	sys 0.022s
I20260709 12:57:28.168797  1736 rpcz_store.cc:276] 0709 12:57:26.836377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.418391 (+582014us) service_pool.cc:224] Handling call
0709 12:57:27.509706 (+ 91315us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864c1831 00007f948649eac3 00007f948644d400 00007f947f8d2af4 00007f947f8d2a82 00007f947f8d29b1
0709 12:57:27.569740 (+ 60034us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368e9c 00007f947e368a5b 00007f9487281c09 00007f94863dbee0 00007f94864c1831 00007f948649eac3 00007f948644d400 00007f947f8d2af4 00007f947f8d2a82 00007f947f8d29b1
0709 12:57:27.582235 (+ 12495us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.582369 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:28.062072 (+479703us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.164230 (+102158us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.164851 (+   621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139320960}
I20260709 12:57:28.178778  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 077713cf7fff4fb39be348e99943d26f (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:28.173700  1794 raft_consensus.cc:385] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.179903  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0193c6e20d1c4a33997d268895b8c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.179913  1794 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.180583  1738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48436 (request call id 41) took 1210 ms. Trace:
I20260709 12:57:28.181272  1741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a24b102b5d4949a5dd73c9f7d069ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.181190  1794 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.169092  1733 rpcz_store.cc:276] 0709 12:57:27.022486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.633780 (+611294us) service_pool.cc:224] Handling call
0709 12:57:27.648037 (+ 14257us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.648150 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:28.003270 (+355120us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.150306 (+147036us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.158263 (+  7957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.182065  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516703d5c9f14537854665616191b5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.181103  1738 rpcz_store.cc:276] 0709 12:57:26.970189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.458758 (+488569us) service_pool.cc:224] Handling call
0709 12:57:27.477015 (+ 18257us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:27.487229 (+ 10214us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:27.865283 (+378054us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:28.128466 (+263183us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:28.180155 (+ 51689us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e3691a2 00007f94872aabb9 00007f94863dbd88 00007f94864a2973 00007f948649e70f 00007f948649eecd 00007f948644d400 00007f947f8d2af4 00007f947f8d2a82
0709 12:57:28.180497 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17724800}
I20260709 12:57:28.180657  1793 raft_consensus.cc:359] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.184990  1793 raft_consensus.cc:385] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.185341  1793 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.185200  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e1e3fa7a448bf924920b2d2b47558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.185802  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 813e209bb7f848ca8067e613c9ef43a1 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:28.187263  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e209bb7f848ca8067e613c9ef43a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.189870  1794 ts_tablet_manager.cc:1434] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 12:57:28.192607  1794 tablet_bootstrap.cc:492] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.204864  1733 tablet_service.cc:1511] Processing CreateTablet for tablet bbe0e89474f14ac0be0bd7343e0f4601 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:28.212641  1793 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.213778  1792 tablet_bootstrap.cc:654] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.222806  1739 tablet_service.cc:1511] Processing CreateTablet for tablet c8ce4edad7b14292b8c162db2d204922 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:28.226716  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077713cf7fff4fb39be348e99943d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.236140  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe0e89474f14ac0be0bd7343e0f4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.243064  1793 ts_tablet_manager.cc:1434] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 12:57:28.243683  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ce4edad7b14292b8c162db2d204922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.250119  1806 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.250747  1806 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.253084  1806 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.254004  1793 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.254489  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.255913  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.256680  1750 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:28.257961  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:28.259056  1641 leader_election.cc:343] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.261015  1806 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.262112  1806 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.262564  1806 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.279970  1793 tablet_bootstrap.cc:654] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.296679  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 60a0f19eac6047fdb1fd191d07ab7355 (DEFAULT_TABLE table=test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:28.304436  1792 tablet_bootstrap.cc:492] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.305042  1792 ts_tablet_manager.cc:1403] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.157s	user 0.003s	sys 0.017s
I20260709 12:57:28.311383  1797 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:28.318374  1792 raft_consensus.cc:359] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.319407  1792 raft_consensus.cc:385] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.319844  1792 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.320297  1793 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.321044  1793 ts_tablet_manager.cc:1403] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.007s
I20260709 12:57:28.321004  1792 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.326227  1793 raft_consensus.cc:359] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.327898  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a0f19eac6047fdb1fd191d07ab7355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:28.327382  1793 raft_consensus.cc:385] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.317517  1806 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.336067  1792 ts_tablet_manager.cc:1434] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:57:28.337100  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:28.337472  1806 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.329782  1794 tablet_bootstrap.cc:654] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:28.339565  1641 leader_election.cc:343] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.343567  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:28.344487  1750 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.336777  1793 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.348310  1793 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.351593  1792 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.352182  1793 ts_tablet_manager.cc:1434] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.002s
I20260709 12:57:28.353633  1793 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.359326  1750 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:28.392757  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:28.394595  1806 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:28.395267  1806 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:28.396485  1806 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.399614  1793 tablet_bootstrap.cc:654] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.407199  1792 tablet_bootstrap.cc:654] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.409678  1817 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.410422  1817 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.412401  1794 tablet_bootstrap.cc:492] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.413165  1794 ts_tablet_manager.cc:1403] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.023s
I20260709 12:57:28.414083  1817 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.414827  1817 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.418365  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.415409  1817 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:28.422879  1566 leader_election.cc:343] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.418416  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.421010  1794 raft_consensus.cc:359] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.424022  1677 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:28.423271  1817 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.424077  1794 raft_consensus.cc:385] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.426772  1794 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.425170  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.428799  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.426278  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:57:28.430187  1566 leader_election.cc:343] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.430874  1817 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.431246  1817 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.431605  1817 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.428558  1794 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.433245  1500 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.435660  1794 ts_tablet_manager.cc:1434] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:57:28.435880  1676 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:28.436830  1794 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.438338  1793 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.439018  1793 ts_tablet_manager.cc:1403] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.004s
I20260709 12:57:28.443441  1793 raft_consensus.cc:359] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.444581  1793 raft_consensus.cc:385] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.444955  1793 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.445991  1793 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.449205  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:28.451450  1817 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.453737  1817 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.454320  1817 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.457208  1794 tablet_bootstrap.cc:654] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.459465  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:28.460187  1676 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.455446  1817 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.460778  1817 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.464812  1826 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.465541  1826 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.467978  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:57:28.469599  1566 leader_election.cc:343] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.469419  1817 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.477849  1826 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:28.481096  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.481845  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.483203  1793 ts_tablet_manager.cc:1434] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.001s
W20260709 12:57:28.484174  1715 leader_election.cc:343] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:28.485883  1715 leader_election.cc:343] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.486682  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:28.487932  1826 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:28.490137  1793 tablet_bootstrap.cc:492] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.494810  1676 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:28.497901  1817 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.499689  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:28.506975  1678 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.507220  1792 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.507884  1792 ts_tablet_manager.cc:1403] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.157s	user 0.065s	sys 0.028s
I20260709 12:57:28.512773  1792 raft_consensus.cc:359] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.513795  1792 raft_consensus.cc:385] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.514183  1792 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.515120  1793 tablet_bootstrap.cc:654] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.515432  1792 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.518179  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:28.518630  1792 ts_tablet_manager.cc:1434] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:57:28.522197  1792 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.505617  1794 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.524524  1794 ts_tablet_manager.cc:1403] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.088s	user 0.027s	sys 0.011s
I20260709 12:57:28.499748  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:28.519639  1840 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:28.519263  1797 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:28.528175  1840 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:57:28.529081  1566 leader_election.cc:343] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.529738  1840 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.538231  1794 raft_consensus.cc:359] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.539281  1794 raft_consensus.cc:385] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.539717  1794 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.541474  1794 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.544781  1794 ts_tablet_manager.cc:1434] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:57:28.546154  1792 tablet_bootstrap.cc:654] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.546586  1794 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.550282  1793 tablet_bootstrap.cc:492] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.551079  1793 ts_tablet_manager.cc:1403] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.011s
I20260709 12:57:28.556178  1794 tablet_bootstrap.cc:654] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.558718  1793 raft_consensus.cc:359] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.559738  1793 raft_consensus.cc:385] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.560089  1793 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.561789  1678 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:28.562175  1792 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.562795  1792 ts_tablet_manager.cc:1403] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.007s
I20260709 12:57:28.563827  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:28.565510  1840 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:28.565343  1793 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.566223  1840 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:28.566522  1792 raft_consensus.cc:359] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.568159  1792 raft_consensus.cc:385] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.568500  1792 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.567902  1840 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.568992  1793 ts_tablet_manager.cc:1434] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:57:28.569469  1792 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.570143  1793 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.572328  1792 ts_tablet_manager.cc:1434] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 12:57:28.574882  1792 tablet_bootstrap.cc:492] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.579463  1793 tablet_bootstrap.cc:654] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.583117  1792 tablet_bootstrap.cc:654] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.596905  1498 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.605384  1793 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.606304  1793 ts_tablet_manager.cc:1403] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.002s
I20260709 12:57:28.610878  1793 raft_consensus.cc:359] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.612030  1793 raft_consensus.cc:385] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.612468  1793 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.614033  1794 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.613582  1793 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.615026  1794 ts_tablet_manager.cc:1403] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.069s	user 0.029s	sys 0.024s
I20260709 12:57:28.618153  1792 tablet_bootstrap.cc:492] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.618381  1793 ts_tablet_manager.cc:1434] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:57:28.618738  1792 ts_tablet_manager.cc:1403] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.024s
I20260709 12:57:28.619611  1793 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.622802  1794 raft_consensus.cc:359] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.624722  1794 raft_consensus.cc:385] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.625128  1794 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.626102  1794 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.629601  1794 ts_tablet_manager.cc:1434] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:57:28.630841  1794 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
W20260709 12:57:28.633016  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:28.635069  1792 raft_consensus.cc:359] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.636003  1792 raft_consensus.cc:385] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.636361  1792 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.637306  1792 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.639523  1792 ts_tablet_manager.cc:1434] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:57:28.639830  1794 tablet_bootstrap.cc:654] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.640620  1792 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.632890  1501 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.647061  1794 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.647432  1792 tablet_bootstrap.cc:654] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.647728  1794 ts_tablet_manager.cc:1403] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 12:57:28.652102  1794 raft_consensus.cc:359] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.652990  1794 raft_consensus.cc:385] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.653280  1794 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.654533  1794 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.655085  1793 tablet_bootstrap.cc:654] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.656471  1794 ts_tablet_manager.cc:1434] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:28.657550  1794 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.659662  1792 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.660178  1792 ts_tablet_manager.cc:1403] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 12:57:28.663084  1792 raft_consensus.cc:359] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.663897  1792 raft_consensus.cc:385] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.664222  1792 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.665133  1792 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.666255  1794 tablet_bootstrap.cc:654] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.667138  1793 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.667584  1792 ts_tablet_manager.cc:1434] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:28.667711  1793 ts_tablet_manager.cc:1403] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.008s
I20260709 12:57:28.668668  1792 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.670421  1793 raft_consensus.cc:359] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.672148  1793 raft_consensus.cc:385] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.672524  1793 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.673420  1793 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.674882  1794 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.675438  1794 ts_tablet_manager.cc:1403] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:57:28.676008  1793 ts_tablet_manager.cc:1434] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:28.677350  1793 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.678620  1794 raft_consensus.cc:359] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.679437  1794 raft_consensus.cc:385] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.679792  1794 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.680716  1794 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.686108  1793 tablet_bootstrap.cc:654] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.687601  1794 ts_tablet_manager.cc:1434] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:57:28.688707  1794 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.696663  1792 tablet_bootstrap.cc:654] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.698868  1793 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.699565  1793 ts_tablet_manager.cc:1403] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:57:28.702065  1794 tablet_bootstrap.cc:654] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.702857  1793 raft_consensus.cc:359] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.703423  1792 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.703773  1793 raft_consensus.cc:385] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.704133  1792 ts_tablet_manager.cc:1403] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.000s
I20260709 12:57:28.704114  1793 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.705190  1793 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.707533  1792 raft_consensus.cc:359] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.708388  1794 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.708441  1792 raft_consensus.cc:385] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.708902  1793 ts_tablet_manager.cc:1434] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:28.708988  1794 ts_tablet_manager.cc:1403] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 12:57:28.708997  1792 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.709926  1793 tablet_bootstrap.cc:492] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.710042  1792 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.713023  1794 raft_consensus.cc:359] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.713773  1794 raft_consensus.cc:385] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.714074  1794 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.714828  1794 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.717047  1794 ts_tablet_manager.cc:1434] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:57:28.718125  1793 tablet_bootstrap.cc:654] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.718403  1794 tablet_bootstrap.cc:492] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.723419  1792 ts_tablet_manager.cc:1434] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 12:57:28.725196  1792 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:28.725602  1794 tablet_bootstrap.cc:654] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.726121  1806 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.726989  1806 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.731189  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.731688  1793 tablet_bootstrap.cc:492] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.732378  1793 ts_tablet_manager.cc:1403] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 12:57:28.732249  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:28.734854  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:28.735944  1819 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.736387  1819 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.736837  1819 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.736546  1793 raft_consensus.cc:359] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.737413  1793 raft_consensus.cc:385] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.737772  1793 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.738662  1793 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.739916  1840 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.740500  1840 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.741568  1793 ts_tablet_manager.cc:1434] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:57:28.742830  1793 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.743189  1840 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.745344  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.747866  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.746266  1797 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.749944  1793 tablet_bootstrap.cc:654] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.750195  1797 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.754034  1797 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:28.754782  1566 leader_election.cc:343] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.756762  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.757736  1678 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
W20260709 12:57:28.758960  1566 leader_election.cc:343] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.759747  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:28.760828  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.765645  1749 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:28.762862  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.754036  1806 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.773196  1750 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:28.773325  1806 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.774252  1806 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.776003  1797 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:28.780861  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:28.783303  1641 leader_election.cc:343] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.786598  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:28.788352  1797 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.788897  1797 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.789336  1797 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.790179  1840 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.790957  1840 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.799640  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.800836  1750 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:28.802523  1840 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.806232  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.807479  1750 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:28.789415  1806 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.817189  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:28.821619  1826 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.822639  1806 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.826148  1806 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.823155  1826 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.824826  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.830520  1826 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:28.822798  1840 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.831851  1840 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.832609  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.833902  1678 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:28.835500  1840 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.837060  1806 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.822156  1819 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.842893  1819 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.844921  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.848850  1603 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:28.848683  1797 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.850210  1794 tablet_bootstrap.cc:492] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:28.845598  1792 tablet_bootstrap.cc:654] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.850692  1794 ts_tablet_manager.cc:1403] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.133s	user 0.049s	sys 0.064s
I20260709 12:57:28.851150  1793 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.826886  1859 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.851679  1793 ts_tablet_manager.cc:1403] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.109s	user 0.034s	sys 0.069s
I20260709 12:57:28.852022  1859 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.852384  1859 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.853675  1794 raft_consensus.cc:359] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.854449  1794 raft_consensus.cc:385] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.854719  1794 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.855192  1793 raft_consensus.cc:359] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.856204  1793 raft_consensus.cc:385] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.856559  1793 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.857643  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.857542  1793 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.858705  1750 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:28.861493  1793 ts_tablet_manager.cc:1434] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:57:28.862344  1794 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.863746  1793 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:28.864651  1794 ts_tablet_manager.cc:1434] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:57:28.870296  1794 tablet_bootstrap.cc:492] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:28.870976  1797 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.871187  1826 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.871734  1826 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.874090  1793 tablet_bootstrap.cc:654] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.877067  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:28.877238  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.878082  1750 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
W20260709 12:57:28.879204  1715 leader_election.cc:343] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.881160  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:28.881373  1794 tablet_bootstrap.cc:654] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:28.881922  1603 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.875876  1826 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:28.882905  1826 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.883607  1826 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.885764  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:28.886850  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.887208  1641 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:28.888864  1678 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:28.891165  1819 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.891884  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:28.892582  1676 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.888876  1750 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.897150  1819 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.900337  1819 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.902522  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.905313  1676 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:28.907245  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.912351  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:28.913779  1750 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:28.907174  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:28.895391  1641 consensus_peers.cc:597] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:28.927978  1797 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.929917  1797 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.930401  1797 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.932480  1792 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:28.961467  1792 ts_tablet_manager.cc:1403] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.237s	user 0.024s	sys 0.012s
I20260709 12:57:28.963768  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:28.965341  1826 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:28.966800  1566 leader_election.cc:343] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.967844  1859 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.968428  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:28.970126  1859 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.971748  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:28.972638  1676 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:28.973631  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:28.974524  1750 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.975965  1837 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:28.977808  1793 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:28.977569  1797 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.978286  1793 ts_tablet_manager.cc:1403] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.006s
I20260709 12:57:28.979712  1797 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:28.968230  1840 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:28.981088  1840 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.981173  1793 raft_consensus.cc:359] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:28.981521  1840 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.979256  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:28.981846  1793 raft_consensus.cc:385] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:28.982175  1793 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:28.982769  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:28.983743  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:28.982934  1793 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:28.985396  1715 leader_election.cc:343] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:28.986562  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:28.987373  1826 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.989341  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:28.989645  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:28.990072  1752 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.990299  1751 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:28.992700  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:28.993891  1859 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:28.994374  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:28.994407  1859 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:28.996421  1859 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.000111  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.002440  1792 raft_consensus.cc:359] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.003180  1792 raft_consensus.cc:385] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.004462  1840 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.010540  1793 ts_tablet_manager.cc:1434] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
W20260709 12:57:29.005131  1641 leader_election.cc:343] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.011637  1793 tablet_bootstrap.cc:492] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:29.005185  1566 leader_election.cc:343] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.007361  1752 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:29.016508  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:29.017087  1861 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.017570  1806 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.017570  1817 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.007429  1867 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.003458  1792 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.021709  1806 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:29.021443  1792 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.022809  1806 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.024197  1792 ts_tablet_manager.cc:1434] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:57:29.025264  1792 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.008340  1868 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.008697  1869 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.027014  1869 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.009127  1826 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.031240  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.032105  1603 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:29.033190  1819 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.034201  1869 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.034409  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.037339  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.038067  1676 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:29.038936  1869 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.039382  1869 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.039765  1869 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.045061  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:29.045946  1840 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.047909  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.049091  1603 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:29.046067  1752 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.053516  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.054440  1676 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:29.063172  1819 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.046548  1792 tablet_bootstrap.cc:654] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.046901  1793 tablet_bootstrap.cc:654] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.079056  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:29.067561  1868 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.096238  1752 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:29.067001  1751 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:29.109079  1869 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.115345  1869 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.151171  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:29.153416  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.154718  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:29.155105  1603 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.164347  1603 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:29.168830  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.169911  1676 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.169515  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.175462  1750 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:29.167222  1641 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:29.182041  1794 tablet_bootstrap.cc:492] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:29.184556  1794 ts_tablet_manager.cc:1403] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.315s	user 0.023s	sys 0.013s
I20260709 12:57:29.188135  1797 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.191603  1806 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.193272  1879 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.214751  1793 tablet_bootstrap.cc:492] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.215358  1792 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:29.215803  1793 ts_tablet_manager.cc:1403] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.010s
I20260709 12:57:29.216502  1792 ts_tablet_manager.cc:1403] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.010s
I20260709 12:57:29.195485  1819 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.204628  1676 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:29.206588  1881 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.117784  1837 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:29.213369  1806 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.193691  1817 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.216789  1868 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.220947  1868 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:29.222895  1806 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.222661  1868 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.230109  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.231444  1603 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:29.229737  1837 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.236629  1797 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:29.238771  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:29.240422  1806 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.246467  1797 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.248828  1806 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.249385  1806 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.209630  1498 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.244534  1792 raft_consensus.cc:359] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.264796  1792 raft_consensus.cc:385] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.265841  1792 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.263303  1879 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:29.266891  1793 raft_consensus.cc:359] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.269586  1793 raft_consensus.cc:385] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.263978  1866 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:57:29.270043  1793 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.269331  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:29.270231  1792 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.273113  1793 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.276289  1792 ts_tablet_manager.cc:1434] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.001s
I20260709 12:57:29.277182  1794 raft_consensus.cc:359] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.278272  1794 raft_consensus.cc:385] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.278425  1793 ts_tablet_manager.cc:1434] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:57:29.278640  1794 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.283214  1792 tablet_bootstrap.cc:492] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.283705  1793 tablet_bootstrap.cc:492] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:29.284293  1879 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.286818  1794 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.309720  1868 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.313511  1794 ts_tablet_manager.cc:1434] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.001s
W20260709 12:57:29.290239  1641 leader_election.cc:343] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.310581  1868 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.289230  1501 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.321828  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.322750  1603 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:29.325851  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.326156  1794 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:29.330276  1869 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.333843  1869 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.334415  1869 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.341763  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.342149  1868 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:29.343745  1715 leader_election.cc:343] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.345885  1793 tablet_bootstrap.cc:654] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.348446  1866 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.349706  1866 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.355334  1866 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.356222  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.358877  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:29.360252  1792 tablet_bootstrap.cc:654] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.361297  1566 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:29.362587  1866 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.359795  1499 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.364387  1869 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.372738  1793 tablet_bootstrap.cc:492] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.375401  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.375900  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.376155  1603 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:29.377286  1715 leader_election.cc:343] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.374075  1869 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.373884  1806 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.381462  1794 tablet_bootstrap.cc:654] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.397248  1806 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.398932  1793 ts_tablet_manager.cc:1403] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.006s
I20260709 12:57:29.390444  1603 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:29.402060  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.403816  1869 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.403909  1793 raft_consensus.cc:359] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.404366  1869 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.404748  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:29.403208  1602 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.406827  1869 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.408527  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:29.410574  1715 leader_election.cc:343] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:29.412264  1641 leader_election.cc:343] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.414469  1792 tablet_bootstrap.cc:492] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:29.415269  1792 ts_tablet_manager.cc:1403] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.011s
I20260709 12:57:29.404841  1793 raft_consensus.cc:385] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.419801  1793 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.420717  1793 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.423624  1793 ts_tablet_manager.cc:1434] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.006s
I20260709 12:57:29.424954  1793 tablet_bootstrap.cc:492] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:29.426935  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:29.427918  1869 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.428457  1869 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:29.429518  1869 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.430258  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.435040  1792 raft_consensus.cc:359] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.435993  1792 raft_consensus.cc:385] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.436393  1792 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.437170  1792 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.437739  1793 tablet_bootstrap.cc:654] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.439957  1792 ts_tablet_manager.cc:1434] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:57:29.441294  1792 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.441502  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:29.444286  1715 leader_election.cc:343] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.444851  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:29.445621  1869 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.440284  1602 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:29.447366  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:29.449345  1819 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.450009  1819 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:29.451110  1792 tablet_bootstrap.cc:654] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.451364  1819 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.454224  1794 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:29.454712  1794 ts_tablet_manager.cc:1403] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.022s
I20260709 12:57:29.458540  1602 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:29.482529  1641 consensus_peers.cc:597] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:29.483372  1498 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.489349  1794 raft_consensus.cc:359] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.490495  1794 raft_consensus.cc:385] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.490870  1794 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.492280  1794 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.494628  1794 ts_tablet_manager.cc:1434] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.010s
I20260709 12:57:29.495146  1793 tablet_bootstrap.cc:492] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.495704  1793 ts_tablet_manager.cc:1403] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.029s
I20260709 12:57:29.496048  1794 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:29.498785  1793 raft_consensus.cc:359] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.499526  1793 raft_consensus.cc:385] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.499840  1793 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.500355  1792 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:29.500567  1793 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.501122  1792 ts_tablet_manager.cc:1403] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 12:57:29.503255  1793 ts_tablet_manager.cc:1434] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:29.505188  1793 tablet_bootstrap.cc:492] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:29.506283  1499 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.508366  1499 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.510239  1794 tablet_bootstrap.cc:654] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.512094  1793 tablet_bootstrap.cc:654] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.510279  1792 raft_consensus.cc:359] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.514966  1792 raft_consensus.cc:385] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.515239  1792 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.516494  1792 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.519251  1792 ts_tablet_manager.cc:1434] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:57:29.520437  1792 tablet_bootstrap.cc:492] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.527180  1792 tablet_bootstrap.cc:654] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.530404  1501 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.545475  1806 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.550294  1793 tablet_bootstrap.cc:492] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.550961  1793 ts_tablet_manager.cc:1403] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.007s
I20260709 12:57:29.551635  1881 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.552295  1881 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.554621  1881 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.558557  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.565781  1676 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:29.564042  1819 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:57:29.556424  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:29.568356  1793 raft_consensus.cc:359] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.568668  1750 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:29.570207  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.557015  1794 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:29.576587  1794 ts_tablet_manager.cc:1403] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.004s
I20260709 12:57:29.580367  1794 raft_consensus.cc:359] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.581152  1794 raft_consensus.cc:385] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.581455  1794 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.581152  1881 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.582072  1881 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.582455  1881 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.582379  1794 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.590165  1793 raft_consensus.cc:385] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.590770  1793 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.591861  1793 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.593323  1794 ts_tablet_manager.cc:1434] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:57:29.594632  1794 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:29.596868  1871 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.602514  1794 tablet_bootstrap.cc:654] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.602766  1881 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.605170  1881 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.607684  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:29.607893  1792 tablet_bootstrap.cc:492] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:29.608310  1751 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.608588  1792 ts_tablet_manager.cc:1403] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.026s
I20260709 12:57:29.612604  1792 raft_consensus.cc:359] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.613547  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.614282  1676 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.613562  1792 raft_consensus.cc:385] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.620131  1792 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.624990  1676 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:29.626732  1792 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.629406  1793 ts_tablet_manager.cc:1434] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.003s
I20260709 12:57:29.630074  1792 ts_tablet_manager.cc:1434] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:57:29.631458  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:29.632495  1881 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.632732  1792 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.636584  1793 tablet_bootstrap.cc:492] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:29.633255  1881 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:29.644899  1881 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.653103  1793 tablet_bootstrap.cc:654] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.629522  1751 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:29.658601  1792 tablet_bootstrap.cc:654] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.665848  1794 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:29.666360  1794 ts_tablet_manager.cc:1403] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.072s	user 0.037s	sys 0.026s
I20260709 12:57:29.667193  1869 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.669430  1794 raft_consensus.cc:359] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.670154  1794 raft_consensus.cc:385] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.670431  1794 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.671242  1794 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.674439  1794 ts_tablet_manager.cc:1434] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:29.680783  1794 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:29.698925  1869 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.699870  1794 tablet_bootstrap.cc:654] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.699621  1869 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.705214  1869 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:29.705605  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:29.708467  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.708837  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:29.717284  1715 leader_election.cc:343] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:29.718057  1715 leader_election.cc:343] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.718519  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:29.721079  1868 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.721854  1868 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:29.728626  1793 tablet_bootstrap.cc:492] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.729475  1793 ts_tablet_manager.cc:1403] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.019s
I20260709 12:57:29.729564  1499 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.728688  1792 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:29.734444  1792 ts_tablet_manager.cc:1403] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.034s
I20260709 12:57:29.738850  1879 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.738714  1792 raft_consensus.cc:359] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.739853  1792 raft_consensus.cc:385] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.740263  1792 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.741261  1792 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.744753  1868 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.745308  1868 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.745826  1793 raft_consensus.cc:359] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.746912  1793 raft_consensus.cc:385] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.747310  1793 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.748492  1793 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.751670  1793 ts_tablet_manager.cc:1434] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:57:29.753273  1793 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:29.754249  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.754982  1603 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:29.756603  1792 ts_tablet_manager.cc:1434] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:57:29.757230  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.758282  1792 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.760567  1879 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.763530  1869 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.763995  1869 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.764357  1869 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.768750  1792 tablet_bootstrap.cc:654] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.777267  1868 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.778692  1793 tablet_bootstrap.cc:654] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.780221  1879 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.780085  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.780748  1879 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.786722  1866 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.789552  1879 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:29.791859  1715 leader_election.cc:343] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.796258  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.813024  1869 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.828806  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:29.829634  1751 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:29.830405  1794 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:29.830943  1794 ts_tablet_manager.cc:1403] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.151s	user 0.036s	sys 0.056s
I20260709 12:57:29.834288  1794 raft_consensus.cc:359] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.835083  1794 raft_consensus.cc:385] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.835393  1794 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.836303  1794 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:29.839704  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:29.841781  1566 leader_election.cc:343] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.838722  1794 ts_tablet_manager.cc:1434] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:57:29.844594  1794 tablet_bootstrap.cc:492] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:29.852501  1869 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.853114  1792 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:29.853694  1792 ts_tablet_manager.cc:1403] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.003s
I20260709 12:57:29.857121  1793 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.856734  1792 raft_consensus.cc:359] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.857532  1792 raft_consensus.cc:385] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.857650  1793 ts_tablet_manager.cc:1403] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.004s
I20260709 12:57:29.857839  1792 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.858646  1792 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.860885  1792 ts_tablet_manager.cc:1434] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:29.860562  1793 raft_consensus.cc:359] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.861275  1793 raft_consensus.cc:385] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:29.861565  1793 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:29.862078  1792 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:29.863344  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.864697  1794 tablet_bootstrap.cc:654] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.866029  1861 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.866557  1861 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.868546  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:29.870639  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.871454  1602 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:29.872777  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:29.873083  1881 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.872658  1793 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.873497  1881 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.873939  1881 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.874006  1859 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.874410  1859 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.874733  1859 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.875221  1793 ts_tablet_manager.cc:1434] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 12:57:29.876093  1861 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.876376  1793 tablet_bootstrap.cc:492] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:29.877192  1715 leader_election.cc:343] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.875460  1792 tablet_bootstrap.cc:654] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.880185  1868 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.880722  1868 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.883016  1868 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.883212  1881 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.886425  1861 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.883212  1859 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.886982  1861 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.885710  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:29.889329  1751 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:29.889655  1861 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.889755  1859 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.892114  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.892535  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.893103  1603 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.893178  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:29.893888  1752 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.895210  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:29.895916  1677 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:29.897768  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.900065  1869 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:29.900496  1869 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.900856  1869 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.904670  1793 tablet_bootstrap.cc:654] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:29.906582  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:29.907883  1641 leader_election.cc:343] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.911842  1752 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:29.913569  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:29.914876  1603 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:29.915053  1859 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:29.917745  1859 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:29.922224  1859 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.924732  1861 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.925458  1861 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.927229  1869 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.931520  1861 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.932896  1751 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:29.935480  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:29.941005  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:29.943814  1806 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:29.943907  1861 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.941952  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:29.915984  1881 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:29.949767  1879 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.952955  1806 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.957516  1869 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:29.963732  1793 tablet_bootstrap.cc:492] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:29.964507  1793 ts_tablet_manager.cc:1403] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.001s
I20260709 12:57:29.965549  1794 tablet_bootstrap.cc:492] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:29.966115  1794 ts_tablet_manager.cc:1403] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.035s
I20260709 12:57:29.965070  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:29.969419  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:29.984680  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.985884  1881 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:29.986424  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:29.976598  1859 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:29.967998  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:30.152668  1794 raft_consensus.cc:359] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.153558  1794 raft_consensus.cc:385] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.153918  1794 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.024539  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:30.154855  1794 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.157856  1676 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:30.158614  1792 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:30.046092  1600 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.159190  1792 ts_tablet_manager.cc:1403] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.297s	user 0.038s	sys 0.045s
I20260709 12:57:30.035387  1869 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.127s
I20260709 12:57:30.162510  1792 raft_consensus.cc:359] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.163007  1792 raft_consensus.cc:385] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.163170  1792 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.087826  1498 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:30.164484  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:30.165516  1869 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:30.149345  1793 raft_consensus.cc:359] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.167376  1793 raft_consensus.cc:385] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.167904  1793 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.167353  1792 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.168598  1793 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:29.992699  1602 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.170050  1677 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.171566  1793 ts_tablet_manager.cc:1434] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.207s	user 0.010s	sys 0.012s
I20260709 12:57:30.172827  1793 tablet_bootstrap.cc:492] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:30.152436  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61173.9us
W20260709 12:57:30.176249  1715 leader_election.cc:343] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:29.988076  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:30.177403  1794 ts_tablet_manager.cc:1434] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.211s	user 0.010s	sys 0.007s
I20260709 12:57:30.178875  1794 tablet_bootstrap.cc:492] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:30.166569  1869 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:30.177501  1752 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.187288  1792 ts_tablet_manager.cc:1434] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
W20260709 12:57:30.179886  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:30.190096  1879 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:57:30.190155  1566 leader_election.cc:343] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:30.196250  1715 leader_election.cc:343] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.186532  1869 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.201058  1792 tablet_bootstrap.cc:492] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:30.203701  1879 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.179509  1602 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:30.225024  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:30.226217  1917 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:30.226755  1917 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:30.227671  1917 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.230839  1752 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:30.213284  1879 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.243805  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:30.246968  1866 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:30.250288  1859 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.253862  1866 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:30.254454  1936 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:30.250870  1859 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.254906  1866 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.260910  1859 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.268328  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.274482  1793 tablet_bootstrap.cc:654] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.275775  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:30.278580  1641 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:30.279663  1792 tablet_bootstrap.cc:654] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.279819  1794 tablet_bootstrap.cc:654] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.281035  1871 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:30.302711  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:30.303136  1676 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:30.311262  1566 leader_election.cc:343] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.324456  1879 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.326973  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:30.329146  1566 leader_election.cc:343] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.329699  1566 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:30.331300  1879 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:30.341289  1935 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:57:30.340922  1936 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:30.340270  1881 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:30.343252  1881 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.356490  1881 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.361745  1499 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.379994  1792 tablet_bootstrap.cc:492] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:30.385722  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:30.386169  1794 tablet_bootstrap.cc:492] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:30.386332  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.393944  1794 ts_tablet_manager.cc:1403] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.025s
I20260709 12:57:30.387709  1793 tablet_bootstrap.cc:492] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:30.395598  1792 ts_tablet_manager.cc:1403] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.195s	user 0.037s	sys 0.027s
I20260709 12:57:30.397352  1794 raft_consensus.cc:359] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.397605  1859 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:30.398137  1794 raft_consensus.cc:385] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.398461  1794 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.399760  1793 ts_tablet_manager.cc:1403] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.227s	user 0.023s	sys 0.025s
I20260709 12:57:30.399572  1792 raft_consensus.cc:359] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.400944  1792 raft_consensus.cc:385] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.401630  1792 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.402737  1792 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.403590  1501 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:30.403350  1794 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.409994  1794 ts_tablet_manager.cc:1434] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:57:30.413061  1566 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:30.414979  1866 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.412236  1794 tablet_bootstrap.cc:492] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:30.416152  1793 raft_consensus.cc:359] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.416922  1793 raft_consensus.cc:385] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.417187  1793 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.417939  1793 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.419480  1792 ts_tablet_manager.cc:1434] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:57:30.422158  1866 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.422699  1866 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.424974  1866 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.425750  1793 ts_tablet_manager.cc:1434] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:57:30.427073  1793 tablet_bootstrap.cc:492] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:30.429008  1792 tablet_bootstrap.cc:492] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:30.433396  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:30.436885  1566 leader_election.cc:343] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.438755  1793 tablet_bootstrap.cc:654] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.438385  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.444802  1859 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:30.446127  1566 leader_election.cc:343] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.445420  1859 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.447695  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:30.448698  1879 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:30.450716  1859 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.452394  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:30.451867  1500 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:30.456805  1641 leader_election.cc:343] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.458493  1794 tablet_bootstrap.cc:654] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.466805  1869 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.467412  1869 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.468052  1793 tablet_bootstrap.cc:492] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:30.469622  1793 ts_tablet_manager.cc:1403] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.015s
I20260709 12:57:30.480365  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.481155  1749 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:30.491809  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:30.498827  1793 raft_consensus.cc:359] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.500187  1793 raft_consensus.cc:385] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.500515  1793 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.501245  1793 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.502990  1793 ts_tablet_manager.cc:1434] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.033s	user 0.016s	sys 0.011s
I20260709 12:57:30.504703  1793 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:30.506433  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:30.507972  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:30.508961  1917 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:30.488642  1869 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:30.518136  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:30.518467  1793 tablet_bootstrap.cc:654] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.519173  1819 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:30.520416  1871 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:30.524258  1819 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.524705  1819 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.529829  1749 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.544636  1794 tablet_bootstrap.cc:492] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:30.545147  1794 ts_tablet_manager.cc:1403] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.030s
I20260709 12:57:30.547256  1794 raft_consensus.cc:359] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.547955  1794 raft_consensus.cc:385] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.548220  1794 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.549038  1794 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.556563  1794 ts_tablet_manager.cc:1434] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:57:30.557508  1792 tablet_bootstrap.cc:654] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.558153  1794 tablet_bootstrap.cc:492] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:30.564208  1819 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.572822  1819 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.574084  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:30.575950  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:30.576629  1750 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.574918  1793 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:30.577893  1793 ts_tablet_manager.cc:1403] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.014s
W20260709 12:57:30.577227  1641 leader_election.cc:343] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.581027  1792 tablet_bootstrap.cc:492] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:30.581696  1792 ts_tablet_manager.cc:1403] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.011s
I20260709 12:57:30.582437  1794 tablet_bootstrap.cc:654] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.585297  1793 raft_consensus.cc:359] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.585574  1792 raft_consensus.cc:359] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.586246  1793 raft_consensus.cc:385] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.586407  1792 raft_consensus.cc:385] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.586609  1793 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.587446  1793 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.591948  1793 ts_tablet_manager.cc:1434] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:57:30.587003  1792 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.592533  1750 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:30.593688  1793 tablet_bootstrap.cc:492] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:30.594076  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:30.593191  1792 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.594928  1819 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:30.595923  1819 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:30.597100  1792 ts_tablet_manager.cc:1434] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:57:30.596800  1819 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.600795  1792 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:30.603842  1794 tablet_bootstrap.cc:492] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:30.604542  1794 ts_tablet_manager.cc:1403] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.007s
I20260709 12:57:30.609632  1792 tablet_bootstrap.cc:654] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.610003  1793 tablet_bootstrap.cc:654] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.608980  1794 raft_consensus.cc:359] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.610754  1794 raft_consensus.cc:385] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.611123  1794 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.612264  1794 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.623435  1794 ts_tablet_manager.cc:1434] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:57:30.623625  1499 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:30.624739  1794 tablet_bootstrap.cc:492] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:30.635071  1869 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:30.639629  1793 tablet_bootstrap.cc:492] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:30.640204  1793 ts_tablet_manager.cc:1403] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.017s
I20260709 12:57:30.640851  1794 tablet_bootstrap.cc:654] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.640321  1792 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:30.643992  1792 ts_tablet_manager.cc:1403] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.010s
I20260709 12:57:30.643302  1793 raft_consensus.cc:359] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.644840  1793 raft_consensus.cc:385] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.645131  1793 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
W20260709 12:57:30.645212  1715 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:30.646013  1793 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.649385  1793 ts_tablet_manager.cc:1434] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:57:30.650774  1793 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:30.653919  1792 raft_consensus.cc:359] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.654826  1792 raft_consensus.cc:385] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.655234  1792 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.656210  1792 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.658963  1793 tablet_bootstrap.cc:654] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.659019  1792 ts_tablet_manager.cc:1434] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 12:57:30.661171  1792 tablet_bootstrap.cc:492] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:30.661639  1794 tablet_bootstrap.cc:492] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:30.662161  1794 ts_tablet_manager.cc:1403] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 12:57:30.664633  1819 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.665223  1819 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.665946  1794 raft_consensus.cc:359] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.666694  1794 raft_consensus.cc:385] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.666942  1794 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.668139  1819 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.668372  1792 tablet_bootstrap.cc:654] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.670430  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.671104  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:30.671247  1750 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:30.672885  1879 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:30.672983  1641 leader_election.cc:343] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.673537  1879 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.673817  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:30.674973  1819 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:30.675364  1819 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.675745  1819 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.684098  1602 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.686517  1879 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.686847  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:30.690459  1917 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:30.694227  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.697211  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:30.719864  1794 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.715507  1819 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.731134  1819 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.732007  1794 ts_tablet_manager.cc:1434] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.002s
I20260709 12:57:30.775357  1793 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:30.776257  1793 ts_tablet_manager.cc:1403] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.126s	user 0.034s	sys 0.031s
I20260709 12:57:30.733675  1794 tablet_bootstrap.cc:492] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:30.732971  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:30.786144  1793 raft_consensus.cc:359] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.787037  1793 raft_consensus.cc:385] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.787334  1793 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.754017  1819 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.788178  1793 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.733103  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:30.753891  1866 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:57:30.792035  1750 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:30.813207  1641 leader_election.cc:343] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.828328  1922 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.791873  1819 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.836254  1922 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.837855  1792 tablet_bootstrap.cc:492] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:30.844513  1792 ts_tablet_manager.cc:1403] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.184s	user 0.026s	sys 0.033s
I20260709 12:57:30.843166  1794 tablet_bootstrap.cc:654] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:30.858047  1819 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.863159  1678 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:30.863255  1793 ts_tablet_manager.cc:1434] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.086s	user 0.046s	sys 0.029s
I20260709 12:57:30.865818  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:30.867904  1641 leader_election.cc:343] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.868777  1859 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.869606  1859 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.873416  1859 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:30.889968  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:30.890410  1793 tablet_bootstrap.cc:492] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:30.910135  1641 leader_election.cc:343] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:30.913100  1879 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:30.941069  1794 tablet_bootstrap.cc:492] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:30.941728  1794 ts_tablet_manager.cc:1403] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.208s	user 0.032s	sys 0.041s
W20260709 12:57:30.950019  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:30.951385  1917 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:30.952852  1794 raft_consensus.cc:359] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.953759  1794 raft_consensus.cc:385] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.954061  1794 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.956238  1792 raft_consensus.cc:359] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:30.957051  1792 raft_consensus.cc:385] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:30.957324  1792 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:30.939450  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:30.990911  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.000034  1922 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.008733  1922 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.008586  1794 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.009347  1922 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.010607  1819 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.011071  1794 ts_tablet_manager.cc:1434] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.004s
I20260709 12:57:31.011166  1819 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.011878  1922 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.012172  1794 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:31.014511  1972 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.015021  1972 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.017138  1972 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.013870  1792 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.011468  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.020376  1602 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
W20260709 12:57:31.021544  1641 leader_election.cc:343] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.022249  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.007696  1917 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.024361  1871 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.029117  1792 ts_tablet_manager.cc:1434] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.184s	user 0.010s	sys 0.005s
I20260709 12:57:31.032265  1793 tablet_bootstrap.cc:654] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.035787  1917 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.036047  1879 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:31.029028  1967 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.038591  1750 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:31.038314  1967 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.045689  1792 tablet_bootstrap.cc:492] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:31.046357  1917 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.045583  1971 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:31.048445  1566 leader_election.cc:343] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.051045  1871 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:31.048784  1971 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.049428  1967 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.057113  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:31.058570  1871 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:31.059142  1871 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:31.063309  1871 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.064510  1971 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.066704  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.073200  1806 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:31.073657  1806 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.074002  1806 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.074430  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.076558  1794 tablet_bootstrap.cc:654] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.076046  1861 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.076761  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.077135  1861 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.087885  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.104238  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:31.162290  1566 leader_election.cc:343] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.175257  1752 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:31.199506  1793 tablet_bootstrap.cc:492] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:31.200376  1793 ts_tablet_manager.cc:1403] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.313s	user 0.031s	sys 0.023s
I20260709 12:57:31.114653  1819 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.112337  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.113813  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.205302  1792 tablet_bootstrap.cc:654] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.195581  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.213315  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.213766  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.212371  1861 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.197232  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.212159  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:31.232821  1974 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:57:31.233079  1599 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:31.214538  1598 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:31.240132  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.243040  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.243686  1794 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:31.244256  1794 ts_tablet_manager.cc:1403] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.232s	user 0.031s	sys 0.017s
I20260709 12:57:31.263361  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.265034  1793 raft_consensus.cc:359] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.266098  1793 raft_consensus.cc:385] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.266467  1793 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.266659  1965 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:31.268603  1641 leader_election.cc:343] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.269721  1793 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.286679  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.258698  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.289407  1794 raft_consensus.cc:359] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:31.291623  1641 leader_election.cc:343] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:31.260123  1715 leader_election.cc:343] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.292662  1794 raft_consensus.cc:385] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.292762  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.296106  1793 ts_tablet_manager.cc:1434] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.004s
I20260709 12:57:31.294093  1794 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.296815  1794 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.289073  1859 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:31.292487  1806 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.304852  1794 ts_tablet_manager.cc:1434] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
W20260709 12:57:31.304620  1715 leader_election.cc:343] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.309422  1793 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:31.310258  1715 leader_election.cc:343] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.316221  1806 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.298547  1871 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:31.318969  1981 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:57:31.321796  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 177289us
I20260709 12:57:31.333877  1793 tablet_bootstrap.cc:654] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.322367  1600 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.327415  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:31.330040  1498 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.331692  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.336045  1750 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:31.337196  1715 leader_election.cc:343] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.333323  1792 tablet_bootstrap.cc:492] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:31.339736  1792 ts_tablet_manager.cc:1403] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.019s
I20260709 12:57:31.340303  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.351640  1792 raft_consensus.cc:359] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.352489  1792 raft_consensus.cc:385] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.352900  1794 tablet_bootstrap.cc:492] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:31.352849  1792 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.362349  1792 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.367931  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:31.368736  1598 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.368986  1792 ts_tablet_manager.cc:1434] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:57:31.370215  1792 tablet_bootstrap.cc:492] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
W20260709 12:57:31.386524  1715 leader_election.cc:343] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.387158  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:31.388141  1971 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.389111  1962 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.389837  1962 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.411048  1962 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.427599  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:31.428593  1715 leader_election.cc:343] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.428946  1793 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:31.429302  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:31.434130  1598 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:31.434417  1750 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:31.435384  1793 ts_tablet_manager.cc:1403] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.009s
I20260709 12:57:31.435910  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:31.436915  1979 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:31.437448  1979 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:31.438338  1979 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.440757  1922 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.444653  1793 raft_consensus.cc:359] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.445504  1793 raft_consensus.cc:385] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.445830  1793 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.445616  1859 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:31.446523  1793 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.447639  1794 tablet_bootstrap.cc:654] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.448232  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.448982  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:31.453807  1792 tablet_bootstrap.cc:654] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.457408  1793 ts_tablet_manager.cc:1434] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:57:31.458614  1793 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:31.459273  1971 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.461129  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:31.466179  1793 tablet_bootstrap.cc:654] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:31.467494  1641 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:31.467962  1971 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:31.468647  1971 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.469215  1971 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.480692  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:31.482201  1962 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:31.482676  1962 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.483086  1962 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.493045  1971 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.494792  1962 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.498919  1962 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.502528  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:31.521373  1967 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:31.521951  1967 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.523185  1967 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.529481  1792 tablet_bootstrap.cc:492] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:31.530087  1792 ts_tablet_manager.cc:1403] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.004s
I20260709 12:57:31.530452  1793 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:31.530961  1793 ts_tablet_manager.cc:1403] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.016s
I20260709 12:57:31.531841  1794 tablet_bootstrap.cc:492] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:31.532379  1794 ts_tablet_manager.cc:1403] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.029s
I20260709 12:57:31.534026  1793 raft_consensus.cc:359] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.534819  1793 raft_consensus.cc:385] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.535162  1793 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.535352  1794 raft_consensus.cc:359] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.536137  1794 raft_consensus.cc:385] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.536432  1794 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.537281  1794 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.542097  1794 ts_tablet_manager.cc:1434] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:31.542699  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:31.542366  1500 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.543244  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:31.543922  1597 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.544296  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:31.544935  1598 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.544663  1792 raft_consensus.cc:359] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.545384  1792 raft_consensus.cc:385] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.551004  1792 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.551810  1792 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.554119  1792 ts_tablet_manager.cc:1434] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:57:31.555279  1792 tablet_bootstrap.cc:492] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:31.556607  1967 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.549393  1793 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.555215  1598 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:31.550532  1971 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.543211  1794 tablet_bootstrap.cc:492] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:31.560181  1793 ts_tablet_manager.cc:1434] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:57:31.562990  1967 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.571801  1793 tablet_bootstrap.cc:492] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:31.574414  1715 leader_election.cc:343] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:31.576833  1715 leader_election.cc:343] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.582559  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:31.585816  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:31.586573  1598 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.587893  1793 tablet_bootstrap.cc:654] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.588030  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:31.590970  1672 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.596225  1967 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.596859  1967 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.599237  1792 tablet_bootstrap.cc:654] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.599973  1967 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.600940  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:31.607825  1967 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.608433  1967 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.610698  1967 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.611635  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:31.612658  1967 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:31.613266  1967 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:31.614518  1967 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.619124  1794 tablet_bootstrap.cc:654] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.620285  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:31.621145  1968 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:31.621625  1968 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:31.623051  1977 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:31.622903  1968 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.639946  1672 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:31.641299  1597 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:31.648432  1792 tablet_bootstrap.cc:492] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:31.649735  1793 tablet_bootstrap.cc:492] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:31.650302  1793 ts_tablet_manager.cc:1403] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.012s
I20260709 12:57:31.649760  1792 ts_tablet_manager.cc:1403] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.008s
I20260709 12:57:31.653388  1793 raft_consensus.cc:359] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.654189  1793 raft_consensus.cc:385] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.654500  1793 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.653898  1792 raft_consensus.cc:359] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.655864  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.655980  1792 raft_consensus.cc:385] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.657825  1792 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.655400  1793 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.662411  1793 ts_tablet_manager.cc:1434] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:57:31.663772  1793 tablet_bootstrap.cc:492] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:31.670774  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.658602  1792 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.672943  1793 tablet_bootstrap.cc:654] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.677644  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:31.678483  1678 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
W20260709 12:57:31.680881  1715 leader_election.cc:343] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.682103  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:31.682651  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.683375  1967 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:31.683440  1597 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:31.684123  1967 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:31.685173  1967 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.684863  1794 tablet_bootstrap.cc:492] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:31.687186  1794 ts_tablet_manager.cc:1403] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.007s
I20260709 12:57:31.673981  1792 ts_tablet_manager.cc:1434] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.003s
I20260709 12:57:31.693869  1792 tablet_bootstrap.cc:492] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:31.694943  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:31.696851  1972 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:31.697288  1972 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.697693  1972 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:31.709263  1715 leader_election.cc:343] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.713229  1792 tablet_bootstrap.cc:654] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.713786  1794 raft_consensus.cc:359] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.714540  1794 raft_consensus.cc:385] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.714841  1794 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.708261  1972 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:31.716301  1715 leader_election.cc:343] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.718751  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:31.719858  1968 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.718438  1972 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.723474  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:31.724195  1597 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.724728  1793 tablet_bootstrap.cc:492] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:31.725418  1793 ts_tablet_manager.cc:1403] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.062s	user 0.034s	sys 0.016s
I20260709 12:57:31.722371  1794 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.729307  1793 raft_consensus.cc:359] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.730144  1793 raft_consensus.cc:385] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.730482  1793 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.731256  1793 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.733893  1794 ts_tablet_manager.cc:1434] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:57:31.738742  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:31.739522  1672 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:31.740059  1793 ts_tablet_manager.cc:1434] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:57:31.741304  1793 tablet_bootstrap.cc:492] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:31.748574  1793 tablet_bootstrap.cc:654] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:31.751677  1672 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:31.761292  1597 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:31.763722  1499 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:31.766073  1499 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:31.768462  1793 tablet_bootstrap.cc:492] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:31.769063  1793 ts_tablet_manager.cc:1403] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.003s
I20260709 12:57:31.769989  1794 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:31.772809  1793 raft_consensus.cc:359] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.772019  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:31.774736  1793 raft_consensus.cc:385] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:31.775123  1793 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:31.775894  1793 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.777561  1972 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:31.778273  1793 ts_tablet_manager.cc:1434] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:57:31.779476  1793 tablet_bootstrap.cc:492] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:31.778378  1972 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:31.784165  1972 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.784166  1792 tablet_bootstrap.cc:492] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:31.785964  1792 ts_tablet_manager.cc:1403] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.005s
I20260709 12:57:31.839370  1859 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.840267  1859 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.845846  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.864840  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.865434  1922 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.866226  1922 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.868865  1879 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.869550  1879 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.870285  1922 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.868206  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:31.873821  1879 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:31.874449  1979 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:31.889571  1968 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.890758  1968 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:31.895315  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:31.897437  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:31.901599  1715 leader_election.cc:343] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:31.902719  1715 leader_election.cc:343] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:31.903362  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:31.907992  1968 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:31.911158  1967 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.843248  1859 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:31.923170  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55087.7us
I20260709 12:57:31.922981  1979 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:31.950889  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.952157  1749 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:31.954414  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:31.983168  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.010280  1793 tablet_bootstrap.cc:654] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.012107  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.013983  1792 raft_consensus.cc:359] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.019579  1859 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:31.963462  1750 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:32.026412  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:32.029593  1792 raft_consensus.cc:385] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.031021  1792 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.033596  1792 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.037775  1794 tablet_bootstrap.cc:654] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.032889  1879 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:32.040288  1879 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.040695  1879 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.031766  1672 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
W20260709 12:57:32.062940  1566 leader_election.cc:343] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.064826  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:32.066977  1971 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:32.071969  1672 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.073907  1792 ts_tablet_manager.cc:1434] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.288s	user 0.091s	sys 0.125s
I20260709 12:57:32.075134  1792 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:32.067471  2012 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:32.086824  1793 tablet_bootstrap.cc:492] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:32.095356  1793 ts_tablet_manager.cc:1403] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.081s
I20260709 12:57:32.095050  2012 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.097193  2012 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.103282  1879 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.122313  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:32.133571  1566 leader_election.cc:343] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.136221  1879 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:32.138691  1715 consensus_peers.cc:597] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:32.139946  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:32.133455  1793 raft_consensus.cc:359] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.144872  1793 raft_consensus.cc:385] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.145210  1793 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.146950  1794 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:32.147480  1794 ts_tablet_manager.cc:1403] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.413s	user 0.010s	sys 0.019s
I20260709 12:57:32.146745  1793 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.145426  1749 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.154253  1499 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:32.156881  1972 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.157006  1499 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:32.157505  1972 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:32.157950  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:32.158823  1967 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:32.159745  1972 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:32.160657  1792 tablet_bootstrap.cc:654] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.160812  1967 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:32.164450  1793 ts_tablet_manager.cc:1434] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.007s
I20260709 12:57:32.165750  1793 tablet_bootstrap.cc:492] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:32.166481  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.174844  1749 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:32.183763  1794 raft_consensus.cc:359] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.185948  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:32.186273  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.174875  2012 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.191450  1964 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:32.191994  1964 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:32.192906  1964 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.194096  2012 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.195024  1972 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:32.195902  1793 tablet_bootstrap.cc:654] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:32.197109  1715 leader_election.cc:343] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:32.197932  1715 leader_election.cc:343] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.198367  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:32.199177  1967 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.187040  1794 raft_consensus.cc:385] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.212157  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:32.212844  1794 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.218765  1794 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.213101  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:32.248620  1678 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.247897  1977 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.251149  1977 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.253757  1793 tablet_bootstrap.cc:492] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:32.255502  1793 ts_tablet_manager.cc:1403] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.090s	user 0.027s	sys 0.010s
I20260709 12:57:32.247294  1794 ts_tablet_manager.cc:1434] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 12:57:32.241709  1749 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.268451  1794 tablet_bootstrap.cc:492] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:32.280632  1977 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:32.289995  1704 tablet.cc:2406] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:32.290472  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.292743  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.303313  1794 tablet_bootstrap.cc:654] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.309514  1793 raft_consensus.cc:359] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.310433  1793 raft_consensus.cc:385] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.310384  1749 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:32.311064  1793 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.312142  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:32.312930  1964 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:32.313416  1964 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:32.311893  1793 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.314309  1964 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.316071  1793 ts_tablet_manager.cc:1434] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.003s
I20260709 12:57:32.321827  1678 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:32.326412  2012 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.326611  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:32.330705  2007 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.338181  1793 tablet_bootstrap.cc:492] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:32.340559  1792 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:32.341125  1792 ts_tablet_manager.cc:1403] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.266s	user 0.038s	sys 0.031s
I20260709 12:57:32.327519  2012 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.346246  2012 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.348860  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:32.330988  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 74757.4us
I20260709 12:57:32.351177  1792 raft_consensus.cc:359] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.352692  1792 raft_consensus.cc:385] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.353004  1792 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.350523  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.353662  1792 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.355500  1793 tablet_bootstrap.cc:654] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.364073  1794 tablet_bootstrap.cc:492] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:32.364704  1794 ts_tablet_manager.cc:1403] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.011s
I20260709 12:57:32.360889  1501 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:32.355523  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:32.369136  1794 raft_consensus.cc:359] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.371831  1794 raft_consensus.cc:385] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.372202  1794 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.357764  1792 ts_tablet_manager.cc:1434] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:57:32.375931  1964 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.377193  1792 tablet_bootstrap.cc:492] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:32.373029  1794 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.380549  1972 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.381289  1972 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.384213  1971 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:57:32.390894  1972 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:32.398655  1794 ts_tablet_manager.cc:1434] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:57:32.413872  2024 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:32.416734  1715 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:32.415977  1794 tablet_bootstrap.cc:492] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:32.419623  1793 tablet_bootstrap.cc:492] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:32.420181  1793 ts_tablet_manager.cc:1403] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.008s
I20260709 12:57:32.422223  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.421543  1501 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:32.427402  1794 tablet_bootstrap.cc:654] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.428656  1792 tablet_bootstrap.cc:654] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.431051  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.423133  1793 raft_consensus.cc:359] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.431911  1793 raft_consensus.cc:385] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.432210  1793 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.432964  1793 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.435369  2024 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.436053  2024 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.439097  2024 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:32.441272  1793 ts_tablet_manager.cc:1434] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:57:32.443847  1793 tablet_bootstrap.cc:492] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:32.458989  1793 tablet_bootstrap.cc:654] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:32.477249  1715 leader_election.cc:343] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.478164  1792 tablet_bootstrap.cc:492] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:32.478376  1602 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.478713  1792 ts_tablet_manager.cc:1403] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.015s
I20260709 12:57:32.479799  1794 tablet_bootstrap.cc:492] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:32.480248  1794 ts_tablet_manager.cc:1403] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.028s
I20260709 12:57:32.482941  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.483844  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.484349  1676 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.507486  1792 raft_consensus.cc:359] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.508337  1792 raft_consensus.cc:385] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.508635  1792 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.509460  1792 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.511433  1792 ts_tablet_manager.cc:1434] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 12:57:32.512643  1792 tablet_bootstrap.cc:492] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:32.525684  1794 raft_consensus.cc:359] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.526353  1794 raft_consensus.cc:385] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.526533  1794 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.527149  1794 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:32.528298  1715 leader_election.cc:343] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.528604  1879 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.528816  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:32.529171  1879 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.529623  2024 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:32.530052  1715 leader_election.cc:343] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.533037  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:32.533108  1715 leader_election.cc:343] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.533944  1859 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.534657  1859 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.535230  1794 ts_tablet_manager.cc:1434] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:57:32.536419  1794 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:32.537122  1859 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.538193  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:32.537981  1964 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.539963  2024 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.540352  1964 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.540735  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.546422  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.546677  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.547652  1749 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:32.550374  1793 tablet_bootstrap.cc:492] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:32.550916  1793 ts_tablet_manager.cc:1403] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.015s
I20260709 12:57:32.552987  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:32.553719  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.533885  1674 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
W20260709 12:57:32.558283  1566 leader_election.cc:343] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.558979  2007 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.560338  1792 tablet_bootstrap.cc:654] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.555581  1859 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.552565  1964 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.542739  1879 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.569065  1859 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.573374  1859 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.574232  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:32.582707  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.584378  1964 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:32.584933  1964 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.585372  1964 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:32.587474  1566 leader_election.cc:343] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.605988  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.609094  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.609846  1752 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:32.611086  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:32.612370  1859 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.615190  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:32.607523  1793 raft_consensus.cc:359] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.615907  1793 raft_consensus.cc:385] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.616194  1793 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.616972  1879 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:32.617359  1879 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.617677  1879 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.620174  1793 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.629074  1793 ts_tablet_manager.cc:1434] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 12:57:32.630283  1793 tablet_bootstrap.cc:492] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:32.632825  1792 tablet_bootstrap.cc:492] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:32.634348  1792 ts_tablet_manager.cc:1403] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.009s
I20260709 12:57:32.627830  1879 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.638995  1879 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.638753  1964 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.640887  1964 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:32.638830  1792 raft_consensus.cc:359] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.642120  1792 raft_consensus.cc:385] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.642393  1792 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.641557  2007 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.647996  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:32.648241  1794 tablet_bootstrap.cc:654] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.648470  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:32.649849  1752 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.650098  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:32.650682  1674 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:32.649865  1566 leader_election.cc:343] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.643144  1792 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.653256  1792 ts_tablet_manager.cc:1434] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:57:32.655488  1792 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:32.662272  1674 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:32.668076  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:32.668592  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:57:32.670181  1566 leader_election.cc:343] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.671265  1964 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:32.672576  1792 tablet_bootstrap.cc:654] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.672688  1964 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:32.673835  1964 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.682040  1793 tablet_bootstrap.cc:654] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.683238  1752 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:32.684806  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:32.685679  1792 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:32.685602  1879 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:32.686223  1879 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:32.686246  1792 ts_tablet_manager.cc:1403] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.001s
I20260709 12:57:32.687219  1879 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.689616  1674 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.689790  1792 raft_consensus.cc:359] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.690519  1792 raft_consensus.cc:385] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.691677  1792 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.692662  1792 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.697044  1792 ts_tablet_manager.cc:1434] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:57:32.698150  1792 tablet_bootstrap.cc:492] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:32.709393  1879 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:32.711323  1794 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:32.711892  1794 ts_tablet_manager.cc:1403] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.003s
I20260709 12:57:32.715072  1794 raft_consensus.cc:359] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.715821  1794 raft_consensus.cc:385] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.716032  1971 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.717666  1971 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.719823  1793 tablet_bootstrap.cc:492] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:32.720396  1793 ts_tablet_manager.cc:1403] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.010s
I20260709 12:57:32.721314  1792 tablet_bootstrap.cc:654] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.722625  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.723557  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.725174  1964 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.725719  1964 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:32.726703  1715 leader_election.cc:343] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.726372  1499 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:32.723642  1971 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:32.728108  1964 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:32.729283  1715 leader_election.cc:343] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.725207  1793 raft_consensus.cc:359] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.730409  1793 raft_consensus.cc:385] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:32.730129  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:32.731217  1971 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.731493  1793 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.732637  1971 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.732597  1793 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.733357  1971 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.735920  1793 ts_tablet_manager.cc:1434] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:57:32.737124  1793 tablet_bootstrap.cc:492] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:32.716079  1794 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:32.740073  1794 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.742337  1794 ts_tablet_manager.cc:1434] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:57:32.743571  1792 tablet_bootstrap.cc:492] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:32.744321  1792 ts_tablet_manager.cc:1403] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.008s
I20260709 12:57:32.742776  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.743808  1971 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:32.747954  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.749580  1792 raft_consensus.cc:359] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.750778  1792 raft_consensus.cc:385] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:57:32.750983  1715 leader_election.cc:343] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.751200  1792 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
W20260709 12:57:32.752115  1715 leader_election.cc:343] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.752525  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:32.755518  1792 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.758148  1792 ts_tablet_manager.cc:1434] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:57:32.761652  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.763821  1794 tablet_bootstrap.cc:492] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:32.754660  1971 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.764961  1879 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:32.768918  1792 tablet_bootstrap.cc:492] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
W20260709 12:57:32.770015  1566 leader_election.cc:343] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.777303  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.779742  1500 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:32.785211  1566 leader_election.cc:343] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.785734  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:32.787684  1964 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:32.793500  1793 tablet_bootstrap.cc:654] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.821347  2012 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.822125  2012 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.834177  2012 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:32.899636  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 114442us
I20260709 12:57:32.902524  1792 tablet_bootstrap.cc:654] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.913946  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.914825  1749 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:32.918042  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:32.932267  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:32.939432  2007 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.938767  2024 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.940246  2024 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.940153  2007 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:32.946913  1964 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:32.947398  1964 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.949038  1964 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:32.950624  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:32.946465  2007 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:32.967836  1566 leader_election.cc:343] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:32.973122  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:32.974139  1794 tablet_bootstrap.cc:654] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:32.974581  1750 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:32.980229  2024 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:32.990744  1793 tablet_bootstrap.cc:492] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:32.991273  1793 ts_tablet_manager.cc:1403] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.254s	user 0.039s	sys 0.029s
I20260709 12:57:32.985301  2012 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:57:32.997746  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:32.998656  1859 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.000797  1792 tablet_bootstrap.cc:492] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.001384  1792 ts_tablet_manager.cc:1403] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.237s	user 0.035s	sys 0.026s
I20260709 12:57:33.008533  1794 tablet_bootstrap.cc:492] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.009194  1794 ts_tablet_manager.cc:1403] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.246s	user 0.036s	sys 0.016s
I20260709 12:57:33.012178  1793 raft_consensus.cc:359] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.013028  1793 raft_consensus.cc:385] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.013347  1793 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.014297  1793 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.015475  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.016479  1673 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:33.018461  1964 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.022363  1964 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.023489  1793 ts_tablet_manager.cc:1434] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:57:33.024931  1793 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:33.037370  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50377.4us
I20260709 12:57:33.039108  1794 raft_consensus.cc:359] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.040236  1794 raft_consensus.cc:385] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.040617  1794 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.043066  1794 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.046501  1794 ts_tablet_manager.cc:1434] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:57:33.047660  1859 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.047614  1792 raft_consensus.cc:359] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.056428  1792 raft_consensus.cc:385] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.056797  1792 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.057307  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.057986  1749 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.058400  2051 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:33.059304  1792 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.061909  1794 tablet_bootstrap.cc:492] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.065493  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:33.066247  1672 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.068106  1793 tablet_bootstrap.cc:654] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.075101  1792 ts_tablet_manager.cc:1434] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.005s
I20260709 12:57:33.075506  1672 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.077165  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.077963  2024 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.078519  2024 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.077086  1792 tablet_bootstrap.cc:492] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.082547  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.085229  2024 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:33.086427  1715 leader_election.cc:343] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.080209  1794 tablet_bootstrap.cc:654] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.101728  1792 tablet_bootstrap.cc:654] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.102002  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.103097  2024 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.107712  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:33.109535  2046 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.110222  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.110487  2046 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:33.114043  2046 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:33.115239  1715 leader_election.cc:343] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.115866  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.117268  1972 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.145162  1749 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.146981  1793 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.147369  1793 ts_tablet_manager.cc:1403] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.003s
I20260709 12:57:33.147711  2046 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:33.151638  1793 raft_consensus.cc:359] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.152436  1793 raft_consensus.cc:385] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.152710  1793 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.153538  1793 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.154678  2024 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.155233  1498 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:33.171154  2053 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.171911  2053 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.175807  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.176769  2053 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.177026  1793 ts_tablet_manager.cc:1434] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:57:33.179082  1793 tablet_bootstrap.cc:492] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:33.183341  1566 leader_election.cc:343] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.185307  1794 tablet_bootstrap.cc:492] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.185940  1794 ts_tablet_manager.cc:1403] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.002s
I20260709 12:57:33.204746  1972 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.210539  1972 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.235530  1972 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:33.235297  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.236398  1752 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:33.241751  1794 raft_consensus.cc:359] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.242609  1794 raft_consensus.cc:385] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.242702  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.242975  1794 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.239319  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.243964  1794 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:33.245152  1715 leader_election.cc:343] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:33.247033  1715 leader_election.cc:343] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.247447  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.248193  1964 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:33.249550  1971 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.248847  1792 tablet_bootstrap.cc:492] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.250509  1792 ts_tablet_manager.cc:1403] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.174s	user 0.018s	sys 0.022s
I20260709 12:57:33.253773  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.256160  1794 ts_tablet_manager.cc:1434] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.070s	user 0.014s	sys 0.000s
I20260709 12:57:33.258162  1792 raft_consensus.cc:359] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.258740  1792 raft_consensus.cc:385] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.258992  1792 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.260061  1792 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.261652  1794 tablet_bootstrap.cc:492] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.262308  1792 ts_tablet_manager.cc:1434] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:57:33.263736  2053 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:33.264158  2053 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.271376  1792 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.273389  2051 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.280756  2051 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.281035  2012 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:33.283034  2051 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.283969  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.285761  1793 tablet_bootstrap.cc:654] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.272900  2053 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:33.294728  1566 leader_election.cc:343] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.332296  2012 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:33.339874  1794 tablet_bootstrap.cc:654] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.298502  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.356396  1752 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:33.362911  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.368265  2051 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:33.369434  2051 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.369797  2051 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.370808  1794 tablet_bootstrap.cc:492] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.371325  1794 ts_tablet_manager.cc:1403] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.110s	user 0.006s	sys 0.011s
I20260709 12:57:33.396512  1793 tablet_bootstrap.cc:492] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.397121  1793 ts_tablet_manager.cc:1403] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.218s	user 0.019s	sys 0.004s
I20260709 12:57:33.400276  1793 raft_consensus.cc:359] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.401582  1793 raft_consensus.cc:385] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.398625  1792 tablet_bootstrap.cc:654] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.401855  1793 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.402678  1793 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.404656  1793 ts_tablet_manager.cc:1434] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:57:33.405045  2053 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.407398  2053 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.405589  1793 tablet_bootstrap.cc:492] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:33.408176  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:33.410820  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.411474  1750 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:33.412382  1566 leader_election.cc:343] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.415472  1794 raft_consensus.cc:359] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.416491  1794 raft_consensus.cc:385] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.416796  1794 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.417519  1794 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.419052  1859 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.420251  1794 ts_tablet_manager.cc:1434] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 12:57:33.419557  1859 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.421510  1794 tablet_bootstrap.cc:492] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.422477  1859 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.423157  1793 tablet_bootstrap.cc:654] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.425745  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.428061  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:33.428411  1641 leader_election.cc:343] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.432667  1749 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:33.435163  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.448962  1794 tablet_bootstrap.cc:654] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.448345  2051 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.452590  1750 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.454025  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.438704  1859 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:57:33.455602  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:33.457383  2053 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.457969  2053 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:33.458053  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.458727  1749 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.458994  2053 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.456614  2051 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.455329  1859 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.465591  1859 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.470695  1793 tablet_bootstrap.cc:492] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.467029  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:33.473160  1566 leader_election.cc:343] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.471534  1793 ts_tablet_manager.cc:1403] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.005s
I20260709 12:57:33.482121  1749 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.479390  1793 raft_consensus.cc:359] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.484262  1793 raft_consensus.cc:385] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.484620  1793 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.483707  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.485991  1793 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.487632  1792 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.488224  1792 ts_tablet_manager.cc:1403] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.219s	user 0.015s	sys 0.019s
I20260709 12:57:33.488610  1793 ts_tablet_manager.cc:1434] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:57:33.489315  2012 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.490011  1793 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:33.489881  2012 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:33.491036  2012 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.491148  1792 raft_consensus.cc:359] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.492620  1792 raft_consensus.cc:385] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.492913  1792 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.493250  1794 tablet_bootstrap.cc:492] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.493848  1794 ts_tablet_manager.cc:1403] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.002s
I20260709 12:57:33.494648  1792 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.497129  1792 ts_tablet_manager.cc:1434] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:57:33.498119  1792 tablet_bootstrap.cc:492] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.498150  1793 tablet_bootstrap.cc:654] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.500916  1859 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.503461  1859 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.498031  1794 raft_consensus.cc:359] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.504604  1794 raft_consensus.cc:385] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.504913  1794 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.505342  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:33.506450  1794 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.508889  1794 ts_tablet_manager.cc:1434] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:57:33.512213  1792 tablet_bootstrap.cc:654] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.514439  1794 tablet_bootstrap.cc:492] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.514921  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.515859  1750 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.516558  1501 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:33.521734  1793 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.522310  1793 ts_tablet_manager.cc:1403] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.005s
I20260709 12:57:33.523277  1794 tablet_bootstrap.cc:654] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:33.525781  1641 leader_election.cc:343] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.532756  1750 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:33.538166  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.538995  1859 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.539554  1859 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:33.540439  1859 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.540916  1793 raft_consensus.cc:359] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.542695  1793 raft_consensus.cc:385] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.542990  1793 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.543650  1793 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.552850  2051 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.553449  2051 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.555621  2051 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.555569  1498 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:33.557180  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.557808  1750 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:33.559258  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:33.559746  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.560417  1673 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:33.560685  2012 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:33.561124  2012 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.561475  2012 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.563480  1793 ts_tablet_manager.cc:1434] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:57:33.565552  1793 tablet_bootstrap.cc:492] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:33.572471  1501 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:33.575528  2051 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:33.582192  1792 tablet_bootstrap.cc:492] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.581877  2051 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:33.585896  1794 tablet_bootstrap.cc:492] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.586243  1792 ts_tablet_manager.cc:1403] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.017s
I20260709 12:57:33.586449  1794 ts_tablet_manager.cc:1403] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.072s	user 0.003s	sys 0.015s
I20260709 12:57:33.585363  2012 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.591418  2012 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.592629  1792 raft_consensus.cc:359] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.593524  1792 raft_consensus.cc:385] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.593794  1792 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.594575  1792 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.594892  1971 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.595623  1971 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.600911  1971 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:33.602793  1794 raft_consensus.cc:359] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.603600  1794 raft_consensus.cc:385] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.603817  1792 ts_tablet_manager.cc:1434] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:57:33.603879  1794 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.604401  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:33.605052  1672 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.604974  1794 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.606885  1794 ts_tablet_manager.cc:1434] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 12:57:33.607990  1794 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.575595  1793 tablet_bootstrap.cc:654] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.610756  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:33.613329  1715 leader_election.cc:343] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.605093  1792 tablet_bootstrap.cc:492] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.622100  1672 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.633453  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.637705  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.641299  1750 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:33.637778  1715 leader_election.cc:343] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.642411  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.643810  1972 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.650877  1750 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.660328  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:33.661283  2051 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.664234  2051 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:33.665047  1794 tablet_bootstrap.cc:654] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.671149  1792 tablet_bootstrap.cc:654] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.673616  2053 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.674286  1972 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.665179  2051 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.674831  1972 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.677131  1972 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:33.674322  2053 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.679705  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.684535  2053 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.689865  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:33.686381  1715 leader_election.cc:343] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.690642  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.692536  1794 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.693109  1794 ts_tablet_manager.cc:1403] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.005s
I20260709 12:57:33.693398  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.694108  1750 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:33.695936  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:33.696211  1794 raft_consensus.cc:359] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.696939  1794 raft_consensus.cc:385] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.697254  1794 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.697868  1964 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:33.698467  1964 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.698953  1964 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:33.700425  1566 leader_election.cc:343] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.704982  1792 tablet_bootstrap.cc:492] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.705483  1792 ts_tablet_manager.cc:1403] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.003s
I20260709 12:57:33.712261  1792 raft_consensus.cc:359] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.713083  1792 raft_consensus.cc:385] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.713373  1792 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.713999  1792 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:33.714561  1715 leader_election.cc:343] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.699348  1794 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.715093  1715 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.720433  1972 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.720628  1792 ts_tablet_manager.cc:1434] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:57:33.722147  1792 tablet_bootstrap.cc:492] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.726107  1794 ts_tablet_manager.cc:1434] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:57:33.725317  1964 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.727795  1794 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.731397  1793 tablet_bootstrap.cc:492] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.731971  1793 ts_tablet_manager.cc:1403] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.014s
I20260709 12:57:33.735062  1793 raft_consensus.cc:359] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.735805  1793 raft_consensus.cc:385] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.736063  1794 tablet_bootstrap.cc:654] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.738406  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:33.739979  1566 leader_election.cc:343] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.740202  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.740716  1792 tablet_bootstrap.cc:654] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.740849  1750 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.736124  1793 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.742650  1793 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.749342  1750 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.750001  1964 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.751577  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.753161  1964 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.753990  1964 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:33.754938  1964 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.755975  1859 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.756553  1859 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.758626  1859 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.763373  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.766664  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.767581  1749 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:33.768301  2024 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.768991  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:33.768851  2024 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.770216  1859 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.771019  2024 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:33.772781  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:33.774266  1715 leader_election.cc:343] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.777341  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.778538  1793 ts_tablet_manager.cc:1434] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:57:33.780364  2007 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.781262  2007 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.782748  1859 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.790264  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:33.794036  1715 leader_election.cc:343] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.794812  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.795709  2024 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.796207  1749 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:33.797012  1793 tablet_bootstrap.cc:492] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:33.801038  2046 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.801901  2046 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.806923  2024 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.807614  2024 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.809190  1792 tablet_bootstrap.cc:492] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.809798  1792 ts_tablet_manager.cc:1403] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.006s
I20260709 12:57:33.809854  2024 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:33.811863  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.812227  2046 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.791922  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:33.815912  1715 leader_election.cc:343] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.817229  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.817380  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.818877  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:33.818356  1749 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:33.820736  2049 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.821485  1794 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.822034  1794 ts_tablet_manager.cc:1403] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.024s
I20260709 12:57:33.785957  1500 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:33.826503  1792 raft_consensus.cc:359] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.827401  1792 raft_consensus.cc:385] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.827731  1792 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.828473  1792 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.829463  1793 tablet_bootstrap.cc:654] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.788453  2007 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.832592  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:33.832684  1794 raft_consensus.cc:359] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.833417  1794 raft_consensus.cc:385] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.833715  1794 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.834661  1794 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.832362  1792 ts_tablet_manager.cc:1434] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
W20260709 12:57:33.837086  1715 leader_election.cc:343] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.837618  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:33.838342  2024 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:33.841984  1566 leader_election.cc:343] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.837144  1792 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.842972  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.846609  2049 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.849428  1792 tablet_bootstrap.cc:654] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.849323  1794 ts_tablet_manager.cc:1434] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:57:33.850862  1794 tablet_bootstrap.cc:492] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.863299  1794 tablet_bootstrap.cc:654] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.863284  2046 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:33.865226  2046 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.866485  1792 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:33.867055  1792 ts_tablet_manager.cc:1403] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.009s
I20260709 12:57:33.865607  2046 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.882141  2053 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.882958  2053 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.885421  2053 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.879155  1500 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:33.891237  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:33.891124  1792 raft_consensus.cc:359] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.891992  1792 raft_consensus.cc:385] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.892313  1792 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.893049  1792 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.894059  1794 tablet_bootstrap.cc:492] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.894694  1794 ts_tablet_manager.cc:1403] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.013s
I20260709 12:57:33.895371  1792 ts_tablet_manager.cc:1434] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:57:33.896921  1792 tablet_bootstrap.cc:492] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:33.899516  1794 raft_consensus.cc:359] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.900391  1794 raft_consensus.cc:385] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.900692  1794 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.901432  1794 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:33.901925  1566 leader_election.cc:343] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.904733  1794 ts_tablet_manager.cc:1434] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 12:57:33.908354  2051 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:33.890821  2046 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.911927  1793 tablet_bootstrap.cc:492] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.912448  1794 tablet_bootstrap.cc:492] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.912550  1793 ts_tablet_manager.cc:1403] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.116s	user 0.022s	sys 0.040s
I20260709 12:57:33.912685  2046 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:33.915643  1793 raft_consensus.cc:359] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.920066  1793 raft_consensus.cc:385] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.920439  1793 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.921087  1793 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.922766  1793 ts_tablet_manager.cc:1434] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:57:33.923594  1794 tablet_bootstrap.cc:654] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.923770  1793 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:33.924050  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:33.933372  1793 tablet_bootstrap.cc:654] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.934187  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:33.938586  1794 tablet_bootstrap.cc:492] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:33.939177  1794 ts_tablet_manager.cc:1403] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
W20260709 12:57:33.943773  1566 leader_election.cc:343] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.945425  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:33.949216  1750 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:33.949194  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:33.949679  1794 raft_consensus.cc:359] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.950456  1794 raft_consensus.cc:385] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:33.950773  1794 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:33.950814  2046 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:33.951431  1794 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:33.954474  1566 leader_election.cc:343] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:33.955842  1794 ts_tablet_manager.cc:1434] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:57:33.956997  1794 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:33.948544  1792 tablet_bootstrap.cc:654] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.960749  2046 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:33.964375  1750 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:33.966756  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:33.970789  1793 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:33.971340  1793 ts_tablet_manager.cc:1403] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.030s
I20260709 12:57:33.971618  2046 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:33.972414  2046 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:33.973448  2046 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:33.978746  1794 tablet_bootstrap.cc:654] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:33.992600  1964 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:33.998616  1964 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:57:34.008540  1641 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:34.018571  1793 raft_consensus.cc:359] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.020800  1793 raft_consensus.cc:385] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.021199  1793 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.022087  1793 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.047017  1793 ts_tablet_manager.cc:1434] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.075s	user 0.003s	sys 0.005s
I20260709 12:57:34.046447  1501 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:34.050002  1794 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:34.050537  1794 ts_tablet_manager.cc:1403] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.019s
I20260709 12:57:34.053438  1794 raft_consensus.cc:359] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.054206  1794 raft_consensus.cc:385] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.054524  1794 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.056573  1793 tablet_bootstrap.cc:492] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:34.055225  1794 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.064054  1793 tablet_bootstrap.cc:654] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.064064  1794 ts_tablet_manager.cc:1434] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:57:34.065389  1794 tablet_bootstrap.cc:492] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:34.072229  1794 tablet_bootstrap.cc:654] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.094506  2051 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.095587  2051 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.097765  1793 tablet_bootstrap.cc:492] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:34.098477  1793 ts_tablet_manager.cc:1403] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.010s
I20260709 12:57:34.098369  2051 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.102843  1793 raft_consensus.cc:359] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.103739  1793 raft_consensus.cc:385] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.104030  1793 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.104772  1793 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.106480  1793 ts_tablet_manager.cc:1434] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:34.106177  1859 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:34.110230  1794 tablet_bootstrap.cc:492] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:34.110814  1794 ts_tablet_manager.cc:1403] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.017s
I20260709 12:57:34.110872  2012 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:34.113423  1792 tablet_bootstrap.cc:492] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:34.113926  1792 ts_tablet_manager.cc:1403] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.217s	user 0.022s	sys 0.029s
I20260709 12:57:34.113821  1794 raft_consensus.cc:359] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.114607  1794 raft_consensus.cc:385] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.114882  1794 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.115645  1794 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.118080  1794 ts_tablet_manager.cc:1434] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:57:34.119143  1794 tablet_bootstrap.cc:492] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:34.123018  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.123821  1749 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:34.125730  1794 tablet_bootstrap.cc:654] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.128008  1793 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:34.141739  1972 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.142361  1972 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.145766  1972 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:34.141405  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:34.149410  1676 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:34.150260  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.151130  2012 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.151480  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:34.152872  1792 raft_consensus.cc:359] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.153625  1792 raft_consensus.cc:385] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.153954  1792 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.151574  2012 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.155025  2012 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.156859  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:34.153790  1715 leader_election.cc:343] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:34.159900  1715 leader_election.cc:343] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:34.160360  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:34.161981  1792 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.163995  1859 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.164772  1859 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.168160  2007 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.168829  2007 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.171831  1792 ts_tablet_manager.cc:1434] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.006s
I20260709 12:57:34.174793  1971 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.175428  1971 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.177359  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.177874  1971 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:34.178186  1600 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.170441  1972 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:34.196194  1792 tablet_bootstrap.cc:492] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:34.206067  1859 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.207705  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:34.210085  1715 leader_election.cc:343] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:34.213410  1793 tablet_bootstrap.cc:654] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.214326  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:34.218907  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.222072  1859 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.222633  1859 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:34.230001  1715 leader_election.cc:343] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:34.230722  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:34.228495  1964 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:34.228790  2101 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.231767  1971 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:34.232191  2101 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.232587  2101 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.233640  1794 tablet_bootstrap.cc:492] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:34.233748  1859 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.234232  1794 ts_tablet_manager.cc:1403] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.059s
I20260709 12:57:34.246677  2046 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:34.235023  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.252238  1752 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.240401  2007 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.287957  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.308544  1794 raft_consensus.cc:359] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.295995  2052 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.312630  1794 raft_consensus.cc:385] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.313292  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.313913  1794 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.311311  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.314303  1750 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.320962  1600 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.323578  1794 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.327848  1792 tablet_bootstrap.cc:654] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.330713  1673 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.331663  1794 ts_tablet_manager.cc:1434] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.008s
I20260709 12:57:34.319226  2052 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.334764  2052 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.335804  1599 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.336220  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.365157  1752 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.336699  2012 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.367777  2012 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.343918  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:34.347255  1794 tablet_bootstrap.cc:492] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:34.344548  2101 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.374239  2101 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.375052  2049 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.375612  2049 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.376112  2049 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.377566  1794 tablet_bootstrap.cc:654] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.380548  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.362506  1793 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:34.362496  1792 tablet_bootstrap.cc:492] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:34.383966  1792 ts_tablet_manager.cc:1403] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.029s
I20260709 12:57:34.385023  1793 ts_tablet_manager.cc:1403] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.258s	user 0.015s	sys 0.026s
I20260709 12:57:34.386832  2102 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.387306  2102 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.387686  2102 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.392810  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.393500  1750 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:34.396266  2101 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.391005  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:34.396899  2101 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.398226  1600 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.397060  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:34.399060  1672 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.405259  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:34.403128  2007 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.409700  1792 raft_consensus.cc:359] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.410559  1792 raft_consensus.cc:385] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.410926  1792 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.411722  1792 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.418823  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.420192  1792 ts_tablet_manager.cc:1434] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:57:34.422154  2046 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.422097  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.419076  2012 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:34.422722  2046 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.423105  2046 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.409737  2007 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.433004  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:34.433744  1747 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.440721  1792 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:34.444141  1602 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.458838  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:34.460626  1746 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.469942  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.481307  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.484899  1748 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:34.488739  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:34.489981  1859 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.497574  1747 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:34.501974  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.503360  1859 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:34.461714  2101 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.505051  2101 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:34.505291  2007 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.509651  1964 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:34.509939  2101 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:34.525337  1600 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:34.509696  2049 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.527912  2049 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.530632  1793 raft_consensus.cc:359] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.531423  1793 raft_consensus.cc:385] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.531720  1793 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.532425  1793 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.525334  1672 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:34.524689  2101 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.555655  2102 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.542183  1792 tablet_bootstrap.cc:654] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:34.557399  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55516.1us
W20260709 12:57:34.545655  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:34.572576  1793 ts_tablet_manager.cc:1434] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.187s	user 0.006s	sys 0.002s
I20260709 12:57:34.573431  1673 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:34.573815  1793 tablet_bootstrap.cc:492] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:34.575349  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:34.580559  1794 tablet_bootstrap.cc:492] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:34.581039  1752 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.571676  2049 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.583071  1794 ts_tablet_manager.cc:1403] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.013s
I20260709 12:57:34.585843  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.607342  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:34.609486  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:34.610834  1600 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.588006  2049 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.614075  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:34.608397  1971 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.616598  2007 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:34.621290  1971 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.631091  1746 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:34.627343  2102 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.627096  2108 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:34.639310  2049 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.640220  1793 tablet_bootstrap.cc:654] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.632987  1794 raft_consensus.cc:359] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.681139  1794 raft_consensus.cc:385] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.615294  2046 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.644282  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:34.645044  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:34.648311  1752 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:34.648847  1600 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:34.630124  1971 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:34.681622  1794 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.693475  1794 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:34.681598  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56810.4us
I20260709 12:57:34.695446  2108 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:34.703647  2108 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.694818  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:34.703394  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.696085  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:34.766435  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:34.768359  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.751714  1599 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:34.770674  2053 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:57:34.795739  1794 ts_tablet_manager.cc:1434] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.212s	user 0.009s	sys 0.015s
I20260709 12:57:34.801530  1792 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:34.802906  1792 ts_tablet_manager.cc:1403] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.374s	user 0.022s	sys 0.017s
I20260709 12:57:34.765458  1751 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.761441  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.820686  1745 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.751981  2012 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:34.755105  2046 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.812454  2102 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:34.828254  1794 tablet_bootstrap.cc:492] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:34.830446  2102 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:34.832111  1793 tablet_bootstrap.cc:492] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:34.831607  2102 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.832676  1793 ts_tablet_manager.cc:1403] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.259s	user 0.015s	sys 0.002s
I20260709 12:57:34.823405  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.836655  1859 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.837436  1859 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.837978  1859 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.840270  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:34.841163  1677 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:34.827201  2012 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.842267  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:57:34.852844  1641 leader_election.cc:343] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:34.859038  1715 leader_election.cc:343] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:34.862967  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:34.863775  1793 raft_consensus.cc:359] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.864976  1793 raft_consensus.cc:385] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.865373  1793 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.866900  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:34.866524  1793 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.870862  2024 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.870136  1964 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:34.877780  2024 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.881642  1792 raft_consensus.cc:359] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.887972  2024 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.888018  1792 raft_consensus.cc:385] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:34.888556  1792 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:34.889266  1792 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.890143  1751 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:34.892000  1792 ts_tablet_manager.cc:1434] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 12:57:34.891866  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.893086  1859 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.884063  1793 ts_tablet_manager.cc:1434] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 12:57:34.901497  2112 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:34.902119  2112 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:34.909433  1859 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.915992  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:34.925678  1859 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.926230  1859 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.928854  1793 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:34.930096  1792 tablet_bootstrap.cc:492] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:34.932474  1859 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:34.933916  1794 tablet_bootstrap.cc:654] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:34.907387  2112 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.939967  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:34.940759  1749 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.963665  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:34.971405  2024 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:34.951884  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:34.973460  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:34.980011  1859 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:34.981590  2112 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:34.985729  2112 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.986176  2112 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:34.992449  2024 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:34.993337  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:34.991080  1745 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:34.982930  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:34.989290  2012 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.005811  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:35.034766  1793 tablet_bootstrap.cc:654] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.034999  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:35.046347  1501 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:35.035593  2119 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.053673  2119 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.061656  1792 tablet_bootstrap.cc:654] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.072409  1794 tablet_bootstrap.cc:492] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:35.072955  1794 ts_tablet_manager.cc:1403] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.251s	user 0.024s	sys 0.014s
W20260709 12:57:35.088059  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 109352us
I20260709 12:57:35.092196  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:35.090862  2124 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:35.097311  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:35.099186  1715 leader_election.cc:343] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.101581  1670 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:35.104079  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:35.110441  1641 leader_election.cc:343] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.117071  1794 raft_consensus.cc:359] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.117918  1794 raft_consensus.cc:385] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.118186  1794 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.123883  1793 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:35.124507  1793 ts_tablet_manager.cc:1403] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.014s
I20260709 12:57:35.124414  2112 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.125898  1794 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.131147  1793 raft_consensus.cc:359] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.133343  1793 raft_consensus.cc:385] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.133682  1793 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.134449  1793 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.135914  2119 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:35.134869  2136 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.136907  1793 ts_tablet_manager.cc:1434] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:57:35.139120  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:35.145937  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:35.148139  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:35.154717  1794 ts_tablet_manager.cc:1434] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.001s
I20260709 12:57:35.157894  1793 tablet_bootstrap.cc:492] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
W20260709 12:57:35.158354  1715 leader_election.cc:343] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.160522  1794 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:35.180562  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:35.181314  1602 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.159150  2102 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.145972  2112 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.176275  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:35.187356  1745 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:35.189016  1715 leader_election.cc:343] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.189595  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:35.191738  2136 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.208196  1964 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:35.217250  1792 tablet_bootstrap.cc:492] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:35.217875  1792 ts_tablet_manager.cc:1403] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.308s	user 0.025s	sys 0.019s
I20260709 12:57:35.219831  1793 tablet_bootstrap.cc:654] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.233706  1602 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:35.235554  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:35.240078  2007 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:35.241886  2007 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:35.245086  2007 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.281100  2007 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.281306  1792 raft_consensus.cc:359] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.282140  1792 raft_consensus.cc:385] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.281806  2007 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.282433  1792 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.284387  2007 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.286383  2102 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:35.288748  1745 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:35.288446  1792 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.293632  1792 ts_tablet_manager.cc:1434] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.005s
I20260709 12:57:35.294130  1794 tablet_bootstrap.cc:654] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.301203  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:35.302582  1793 tablet_bootstrap.cc:492] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:35.302734  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:35.303211  1793 ts_tablet_manager.cc:1403] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.154s	user 0.007s	sys 0.008s
I20260709 12:57:35.303493  1745 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
W20260709 12:57:35.309077  1641 leader_election.cc:343] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.312206  1792 tablet_bootstrap.cc:492] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:35.321015  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:35.323324  2101 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:35.325827  2101 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.326222  2101 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.328296  1500 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:35.334649  2108 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.335520  2108 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.346783  2108 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.350282  1793 raft_consensus.cc:359] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.352504  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:35.353487  1793 raft_consensus.cc:385] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.354516  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:35.355381  1793 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
W20260709 12:57:35.364488  1566 leader_election.cc:343] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.357419  1745 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:35.379415  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:35.360352  1793 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.383518  1794 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:35.383952  2052 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:35.384119  1794 ts_tablet_manager.cc:1403] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.224s	user 0.014s	sys 0.013s
I20260709 12:57:35.384402  2052 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.372190  2101 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.390568  1794 raft_consensus.cc:359] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.400699  1794 raft_consensus.cc:385] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.401206  1794 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.386549  2052 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.415287  2114 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:35.418534  1793 ts_tablet_manager.cc:1434] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.115s	user 0.009s	sys 0.001s
I20260709 12:57:35.419775  1793 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:35.419919  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:35.421478  2112 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:35.428979  2007 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:35.428905  2052 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:35.432328  1641 leader_election.cc:343] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.432667  2052 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.434402  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:35.435041  1746 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.441973  1794 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.447060  1794 ts_tablet_manager.cc:1434] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.005s
I20260709 12:57:35.447304  1793 tablet_bootstrap.cc:654] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.448227  1794 tablet_bootstrap.cc:492] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:35.449121  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:35.452149  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:35.458557  1748 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.463171  1792 tablet_bootstrap.cc:654] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.452198  2101 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.452991  1498 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:35.470052  1498 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:35.472653  1566 leader_election.cc:343] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.474449  2138 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.476788  2138 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.475206  1498 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:35.493927  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:35.506117  2138 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:35.507475  1746 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:35.511525  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:35.512487  1859 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:35.513012  1859 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:35.513892  1859 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:35.515363  1715 leader_election.cc:343] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.503252  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:35.520813  1748 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:35.521620  2112 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:35.525873  1715 leader_election.cc:343] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.526595  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:35.528568  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:35.528599  2138 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.531831  1964 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:35.532366  1964 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:35.532713  1794 tablet_bootstrap.cc:654] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.533291  1964 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.539080  2101 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:35.545893  1793 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:35.546574  1793 ts_tablet_manager.cc:1403] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.010s
I20260709 12:57:35.565064  1792 tablet_bootstrap.cc:492] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:35.565726  1792 ts_tablet_manager.cc:1403] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.254s	user 0.012s	sys 0.018s
I20260709 12:57:35.569519  1793 raft_consensus.cc:359] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.570351  1793 raft_consensus.cc:385] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.570639  1793 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.572623  1793 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.577634  1793 ts_tablet_manager.cc:1434] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:57:35.582669  2134 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.583292  2134 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.585675  2134 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:35.593734  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:35.595503  1715 leader_election.cc:343] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.596477  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:35.598905  1715 leader_election.cc:343] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.599366  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:35.602375  1792 raft_consensus.cc:359] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.603176  2138 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.604733  1793 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:35.606230  1792 raft_consensus.cc:385] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.606832  2138 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.619144  1792 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.620577  1792 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.625571  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:35.634241  1792 ts_tablet_manager.cc:1434] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 12:57:35.649207  1792 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:35.628383  2138 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.663656  1794 tablet_bootstrap.cc:492] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:35.681682  1859 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.691802  1794 ts_tablet_manager.cc:1403] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.244s	user 0.035s	sys 0.030s
I20260709 12:57:35.691715  1859 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.688366  1498 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:35.673693  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:35.679005  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:35.699707  1859 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.706653  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:35.704632  1715 leader_election.cc:343] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.707427  1745 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:35.677732  2138 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:35.713613  1715 leader_election.cc:343] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.714200  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:35.714599  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:35.715258  1859 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:35.715170  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:35.715730  1859 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.716166  1859 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.717485  2134 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.722649  1794 raft_consensus.cc:359] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.723565  1794 raft_consensus.cc:385] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.723856  1794 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.724478  1794 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.725417  1792 tablet_bootstrap.cc:654] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:35.725682  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:57:35.725939  1641 leader_election.cc:343] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:35.732652  2129 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:35.760612  1859 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.764297  1793 tablet_bootstrap.cc:654] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.768445  1794 ts_tablet_manager.cc:1434] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 12:57:35.778920  2114 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.780294  2114 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.785364  2114 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.787627  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:35.788614  1747 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:35.788875  1793 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:35.787613  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:35.789366  1793 ts_tablet_manager.cc:1403] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.008s
I20260709 12:57:35.789752  1677 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 1: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:35.791817  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:35.793238  1794 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:35.802413  2124 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.794122  1793 raft_consensus.cc:359] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.823014  1793 raft_consensus.cc:385] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.823503  1793 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.788661  1792 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:35.824738  1792 ts_tablet_manager.cc:1403] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.004s
I20260709 12:57:35.832669  1793 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.844041  1792 raft_consensus.cc:359] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.845132  1792 raft_consensus.cc:385] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.845414  1792 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.846129  1792 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.848336  1793 ts_tablet_manager.cc:1434] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:57:35.849577  1793 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:35.851313  1794 tablet_bootstrap.cc:654] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.872534  1793 tablet_bootstrap.cc:654] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.856447  2124 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:35.865454  1792 ts_tablet_manager.cc:1434] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 12:57:35.854772  1859 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.856384  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:35.878459  1598 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.879722  1792 tablet_bootstrap.cc:492] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:35.871269  2007 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:57:35.856743  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:35.882036  1747 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.907084  1598 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:35.908649  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:35.909008  1792 tablet_bootstrap.cc:654] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.909515  2007 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:35.910228  2007 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:35.911150  2007 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.909024  1747 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:35.921993  1792 tablet_bootstrap.cc:492] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:35.922573  1859 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:35.924060  1792 ts_tablet_manager.cc:1403] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.006s
I20260709 12:57:35.938536  1792 raft_consensus.cc:359] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.939316  1792 raft_consensus.cc:385] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.940409  1792 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.941304  1793 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:35.941123  1792 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.942509  1793 ts_tablet_manager.cc:1403] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.006s
I20260709 12:57:35.943737  1792 ts_tablet_manager.cc:1434] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:57:35.944882  1792 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:35.945526  1793 raft_consensus.cc:359] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.950490  1793 raft_consensus.cc:385] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.950784  1793 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.951710  1793 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.968253  1794 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:35.969889  1793 ts_tablet_manager.cc:1434] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:57:35.971088  1793 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:35.971623  1794 ts_tablet_manager.cc:1403] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.176s	user 0.024s	sys 0.024s
I20260709 12:57:35.974561  1794 raft_consensus.cc:359] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.975296  1794 raft_consensus.cc:385] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.975580  1794 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.976212  1794 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.976946  1598 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.978487  1794 ts_tablet_manager.cc:1434] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:57:35.983048  1566 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:35.988767  2102 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.989472  2102 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:35.991796  2102 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:35.992637  2102 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:35.993209  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:35.996803  1794 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:35.998080  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:35.999228  1745 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:35.991796  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.005239  1792 tablet_bootstrap.cc:654] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.005924  1793 tablet_bootstrap.cc:654] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.007880  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:36.013936  1859 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.030741  2138 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.031330  2138 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.033851  2138 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.037436  2124 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.038115  2124 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.039888  1859 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.040273  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:36.042842  1715 leader_election.cc:343] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.055150  2134 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.062038  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.054237  2119 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.064824  2119 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.055732  2134 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:36.068382  1715 leader_election.cc:343] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.113256  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.069873  2119 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.111300  1793 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.114607  2121 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.116482  1793 ts_tablet_manager.cc:1403] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.007s
I20260709 12:57:36.084977  2125 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
W20260709 12:57:36.115310  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46962.3us
I20260709 12:57:36.124428  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.124343  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.125245  2134 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.068414  2124 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.113102  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.127064  1747 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:36.127274  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.127524  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.101962  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:36.129786  1715 leader_election.cc:343] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.130311  1678 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
W20260709 12:57:36.130436  1715 leader_election.cc:343] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:36.131105  1715 leader_election.cc:343] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.131498  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:36.132618  1715 leader_election.cc:343] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.129904  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.134128  1964 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.134473  1964 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.134781  1964 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.135064  2134 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.142373  1964 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.147006  1964 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.155500  1792 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.153090  1793 raft_consensus.cc:359] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.156095  1793 raft_consensus.cc:385] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.156453  1793 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.110870  1794 tablet_bootstrap.cc:654] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.164608  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:36.165352  1748 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.156118  1792 ts_tablet_manager.cc:1403] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.211s	user 0.036s	sys 0.017s
I20260709 12:57:36.133008  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.168748  2121 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.174679  1793 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.175326  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:36.176219  1670 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.177050  1748 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:36.182965  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.186944  2124 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.187629  2124 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:36.187840  1793 ts_tablet_manager.cc:1434] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.002s
I20260709 12:57:36.189054  1793 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.188789  2124 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.195628  1794 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.196317  1794 ts_tablet_manager.cc:1403] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.217s	user 0.009s	sys 0.007s
I20260709 12:57:36.199858  1792 raft_consensus.cc:359] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.200654  1792 raft_consensus.cc:385] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.200945  1792 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.202185  1792 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.204962  1794 raft_consensus.cc:359] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.205777  1794 raft_consensus.cc:385] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.207970  1794 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.208750  1794 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.207166  1670 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:36.209786  1793 tablet_bootstrap.cc:654] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.213009  1792 ts_tablet_manager.cc:1434] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:57:36.224260  1794 ts_tablet_manager.cc:1434] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 12:57:36.225440  1794 tablet_bootstrap.cc:492] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:36.232604  1794 tablet_bootstrap.cc:654] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.233708  2124 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.234108  1792 tablet_bootstrap.cc:492] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.234311  2124 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.234897  1498 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.250478  1793 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.243834  1792 tablet_bootstrap.cc:654] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.251434  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.251077  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.252346  1745 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:36.252424  1670 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:36.253780  1793 ts_tablet_manager.cc:1403] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.003s
I20260709 12:57:36.254025  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.243093  2124 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.255276  2114 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.255687  2114 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.256017  2114 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.257829  1793 raft_consensus.cc:359] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.258683  1793 raft_consensus.cc:385] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.258913  1793 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.260514  1792 tablet_bootstrap.cc:492] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.261183  1792 ts_tablet_manager.cc:1403] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.003s
I20260709 12:57:36.259505  1793 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.265182  1793 ts_tablet_manager.cc:1434] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:57:36.266013  2114 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.267534  1793 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.276597  1793 tablet_bootstrap.cc:654] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.280457  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:36.281276  1678 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.282225  2114 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.284319  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:36.290252  1792 raft_consensus.cc:359] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.292615  1792 raft_consensus.cc:385] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.292958  1792 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.293694  1792 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.295387  1792 ts_tablet_manager.cc:1434] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 12:57:36.296376  1792 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.292641  1745 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.310039  1678 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:36.318650  1792 tablet_bootstrap.cc:654] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.318286  1745 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:36.319517  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:36.322937  1793 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.323279  2124 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.323470  1793 ts_tablet_manager.cc:1403] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.003s
I20260709 12:57:36.326228  1793 raft_consensus.cc:359] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.328392  2124 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:36.327615  1793 raft_consensus.cc:385] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.329260  1793 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.330179  1793 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.329694  2124 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.334828  1793 ts_tablet_manager.cc:1434] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:57:36.340601  1793 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.345598  1794 tablet_bootstrap.cc:492] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.347803  1793 tablet_bootstrap.cc:654] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.346392  1794 ts_tablet_manager.cc:1403] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.000s
I20260709 12:57:36.358757  1794 raft_consensus.cc:359] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.361727  1794 raft_consensus.cc:385] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.362062  1794 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.362952  1792 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.362816  1794 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.363441  1792 ts_tablet_manager.cc:1403] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.031s
I20260709 12:57:36.366454  1792 raft_consensus.cc:359] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.367098  1792 raft_consensus.cc:385] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.367352  1792 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.368145  1792 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.370393  1792 ts_tablet_manager.cc:1434] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:57:36.371443  1792 tablet_bootstrap.cc:492] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.373271  2114 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.373831  2114 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.376242  2114 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.378201  1792 tablet_bootstrap.cc:654] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.383162  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.384268  1748 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:36.386298  2007 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:36.387009  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:36.391276  1566 leader_election.cc:343] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.392808  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:36.393887  2052 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.394296  2052 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.394640  2052 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.406116  1500 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.405793  2052 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.413259  2052 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.415786  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:36.417098  1745 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.426242  1745 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:36.428596  1794 ts_tablet_manager.cc:1434] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:57:36.430493  1794 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:36.433537  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:36.443120  1793 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.443701  1793 ts_tablet_manager.cc:1403] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.022s
I20260709 12:57:36.439472  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.441505  2102 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:36.449971  1793 raft_consensus.cc:359] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.451455  2052 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.452181  1793 raft_consensus.cc:385] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.452351  2052 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:36.452530  1793 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.453423  1793 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.453428  2052 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.454557  2121 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.455498  2121 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.456207  1793 ts_tablet_manager.cc:1434] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:57:36.457342  1793 tablet_bootstrap.cc:492] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.458484  2121 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.459638  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:36.460994  1715 leader_election.cc:343] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:36.485997  1566 leader_election.cc:343] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.486207  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.488591  1792 tablet_bootstrap.cc:492] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.489197  1792 ts_tablet_manager.cc:1403] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.054s
W20260709 12:57:36.490551  1715 leader_election.cc:343] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.491066  1715 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.495364  2121 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.495707  1792 raft_consensus.cc:359] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.499107  1792 raft_consensus.cc:385] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.499593  1792 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.500468  1792 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.507150  1792 ts_tablet_manager.cc:1434] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:57:36.497903  1793 tablet_bootstrap.cc:654] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.512213  2121 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.514822  1792 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.512845  2121 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.522105  2121 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.523392  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:36.525090  1715 leader_election.cc:343] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.527765  1794 tablet_bootstrap.cc:654] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.531883  1792 tablet_bootstrap.cc:654] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.535045  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.538937  1598 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 0.
I20260709 12:57:36.545140  1500 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.550577  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:36.551774  2121 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.552237  2121 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.552613  2121 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.556582  2138 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.557188  2138 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.577704  1794 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.578291  1794 ts_tablet_manager.cc:1403] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.006s
I20260709 12:57:36.585103  1792 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.585812  1792 ts_tablet_manager.cc:1403] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.015s
I20260709 12:57:36.594084  2138 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.593809  1794 raft_consensus.cc:359] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.595145  2007 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.599725  1793 tablet_bootstrap.cc:492] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.600512  1793 ts_tablet_manager.cc:1403] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.018s
I20260709 12:57:36.599922  2007 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.599751  1794 raft_consensus.cc:385] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.602671  1794 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.603466  1794 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.604635  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.604960  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.605578  1747 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:36.605418  2121 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.595932  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.607120  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.607188  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.596868  2138 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.608456  2138 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.610533  2102 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.607939  1600 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:36.610953  2102 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.611490  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:36.611894  2102 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.596963  1792 raft_consensus.cc:359] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:36.609242  1715 leader_election.cc:343] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.612804  1792 raft_consensus.cc:385] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.613175  1792 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.605362  1793 raft_consensus.cc:359] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:36.613418  1715 leader_election.cc:343] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.613940  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.613552  1793 raft_consensus.cc:385] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.614002  1792 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.614681  1793 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.615412  1793 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.615157  2134 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.602608  2007 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.617491  1794 ts_tablet_manager.cc:1434] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 12:57:36.618247  2138 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.621186  1793 ts_tablet_manager.cc:1434] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:57:36.623382  1793 tablet_bootstrap.cc:492] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.626371  2102 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.629177  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:36.630008  1600 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.629858  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.632431  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:36.633004  1597 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:36.636781  1715 leader_election.cc:343] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.636971  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:36.637566  1715 leader_election.cc:343] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.640515  1600 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:36.640771  1793 tablet_bootstrap.cc:654] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.651473  2134 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.654078  2134 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.656378  2134 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:36.651314  1715 leader_election.cc:343] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.657325  1715 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.658154  2134 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.644435  1794 tablet_bootstrap.cc:492] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:36.641336  1792 ts_tablet_manager.cc:1434] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 12:57:36.659360  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.659700  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.643203  2121 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:36.662261  1715 leader_election.cc:343] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.665060  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:36.662180  1792 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.660427  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:36.666602  1747 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.658120  2102 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:36.667570  1715 leader_election.cc:343] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.668215  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.669200  2134 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.672760  1794 tablet_bootstrap.cc:654] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.677443  1747 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:36.666611  2121 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.677990  1793 tablet_bootstrap.cc:492] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.684865  1793 ts_tablet_manager.cc:1403] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.004s
I20260709 12:57:36.651379  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:36.684777  2121 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:36.686838  2121 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.687600  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:36.687740  1793 raft_consensus.cc:359] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.688467  1793 raft_consensus.cc:385] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.688488  2190 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.688846  1793 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.689393  2190 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:36.689833  2124 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:36.689692  1793 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.690730  1792 tablet_bootstrap.cc:654] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.690991  2190 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.697800  1793 ts_tablet_manager.cc:1434] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:57:36.699105  1793 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.682582  1794 tablet_bootstrap.cc:492] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.702620  1794 ts_tablet_manager.cc:1403] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.058s	user 0.003s	sys 0.019s
I20260709 12:57:36.705794  1794 raft_consensus.cc:359] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.706939  1794 raft_consensus.cc:385] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.707221  1794 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.707888  1794 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.709213  2125 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:36.710271  1794 ts_tablet_manager.cc:1434] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:36.713724  1792 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.717274  1792 ts_tablet_manager.cc:1403] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.005s
I20260709 12:57:36.721714  1793 tablet_bootstrap.cc:654] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.722024  1792 raft_consensus.cc:359] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.722934  1792 raft_consensus.cc:385] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.723242  1792 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.724057  1792 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.727720  1794 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:36.733532  2125 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.734144  2125 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.738313  2125 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.756810  1500 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 1, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:36.758924  1792 ts_tablet_manager.cc:1434] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:57:36.739881  1794 tablet_bootstrap.cc:654] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.761543  1792 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.769169  1792 tablet_bootstrap.cc:654] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.773748  1794 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.773917  2007 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.774400  1794 ts_tablet_manager.cc:1403] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.009s
I20260709 12:57:36.774497  2007 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.777482  2007 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.784633  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.786185  1501 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.795233  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.796278  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.797049  1749 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:36.794063  1794 raft_consensus.cc:359] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.804659  1794 raft_consensus.cc:385] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.805037  1794 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.805920  1794 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.810583  1794 ts_tablet_manager.cc:1434] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 12:57:36.811883  1794 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:36.801836  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.816900  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.817938  2007 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.818414  2007 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:36.818503  1566 leader_election.cc:343] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.818904  2007 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.819012  1793 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.819815  1793 ts_tablet_manager.cc:1403] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.015s
I20260709 12:57:36.823028  1793 raft_consensus.cc:359] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.823769  1793 raft_consensus.cc:385] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.824052  1793 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.823791  1747 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:36.824771  1793 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.826902  1793 ts_tablet_manager.cc:1434] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:57:36.830581  1794 tablet_bootstrap.cc:654] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.830508  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:57:36.831494  1641 leader_election.cc:343] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.833065  1793 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Bootstrap starting.
I20260709 12:57:36.833658  1792 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.834586  1792 ts_tablet_manager.cc:1403] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.012s
I20260709 12:57:36.838429  1859 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.838948  1859 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.830530  2007 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.841902  1859 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.844126  2124 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.844585  2124 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.844519  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:36.845016  2124 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.845875  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.852805  1792 raft_consensus.cc:359] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.858569  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:36.858911  1792 raft_consensus.cc:385] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.859365  1747 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.859375  1792 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.855077  2124 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.862257  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.863034  1792 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.841832  2007 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:36.858671  1641 leader_election.cc:343] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.863102  1749 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:57:36.870437  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:36.873627  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:36.874142  1792 ts_tablet_manager.cc:1434] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.005s
I20260709 12:57:36.875759  1859 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.880605  1859 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.884747  1792 tablet_bootstrap.cc:492] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.888511  1793 tablet_bootstrap.cc:654] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.884644  1747 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:36.898494  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.899515  2007 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.900275  2007 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:36.901968  1792 tablet_bootstrap.cc:654] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.901443  2007 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.906104  2124 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:36.908169  1794 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.908670  1793 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: No bootstrap required, opened a new log
I20260709 12:57:36.908761  1794 ts_tablet_manager.cc:1403] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.011s
I20260709 12:57:36.909268  1793 ts_tablet_manager.cc:1403] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.002s
I20260709 12:57:36.909741  2134 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.910221  2134 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.911821  1794 raft_consensus.cc:359] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.912302  2134 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.912511  1794 raft_consensus.cc:385] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.912806  1794 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.914314  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:36.914994  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:36.916361  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.917193  2134 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:36.917559  2134 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.918203  2134 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:36.918025  1793 raft_consensus.cc:359] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.918839  1793 raft_consensus.cc:385] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.919168  1793 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.920157  1793 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.923599  1793 ts_tablet_manager.cc:1434] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:57:36.928026  2138 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.928763  2138 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.929487  1794 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.933020  2138 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.934016  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:36.935881  1715 leader_election.cc:343] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.941373  1794 ts_tablet_manager.cc:1434] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:57:36.942528  1794 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:36.927608  2134 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.947221  2134 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:36.948289  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:36.948872  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:36.949043  1670 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:36.949916  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:36.950529  1747 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.959486  1792 tablet_bootstrap.cc:492] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:36.949827  2007 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.965229  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.966035  1597 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:36.946653  1501 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.966991  1670 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:36.968231  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.963109  1794 tablet_bootstrap.cc:654] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.960111  1792 ts_tablet_manager.cc:1403] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.008s
I20260709 12:57:36.968963  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.971518  1792 raft_consensus.cc:359] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.972306  1792 raft_consensus.cc:385] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.972149  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:36.972616  1792 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.973372  1792 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.973893  1597 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:36.975160  2134 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:36.965788  2007 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.975755  2134 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:36.976716  2134 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.979395  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:36.979889  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:36.980284  1792 ts_tablet_manager.cc:1434] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:57:36.980531  1748 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:36.981339  1792 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:36.981896  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:36.977126  2007 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:36.983054  1641 leader_election.cc:343] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.983793  2190 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.984501  2190 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.960441  1747 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:36.990255  2201 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:36.992740  1715 leader_election.cc:343] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.993208  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:36.994930  2119 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.996711  1794 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:36.997264  1794 ts_tablet_manager.cc:1403] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 12:57:37.000041  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.000903  1964 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.001374  1964 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.002113  1964 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:36.984891  2190 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.007673  2114 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:37.008790  1566 leader_election.cc:343] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.006651  2124 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:37.010535  2052 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.011626  1792 tablet_bootstrap.cc:654] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.022583  1794 raft_consensus.cc:359] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.026199  1794 raft_consensus.cc:385] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.026676  1794 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.990828  2201 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.027904  1794 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.032531  2201 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.034077  1794 ts_tablet_manager.cc:1434] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 12:57:37.034473  1597 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:37.035373  1794 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.037441  2190 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.041642  2007 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.042236  2007 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.042675  1794 tablet_bootstrap.cc:654] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.044225  2007 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.047565  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:37.048007  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.048216  1792 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:37.048503  1598 raft_consensus.cc:2393] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:37.048630  1747 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.048768  1792 ts_tablet_manager.cc:1403] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.012s
I20260709 12:57:37.049633  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.051589  1792 raft_consensus.cc:359] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.052285  1792 raft_consensus.cc:385] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.052533  1792 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.053146  1792 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.054440  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:37.055122  1597 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.055197  1792 ts_tablet_manager.cc:1434] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:57:37.056421  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:37.058655  1501 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 0 to 2, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:37.059013  1792 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:37.059396  2007 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.044101  2190 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.066051  1597 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:37.070746  1964 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.071332  1964 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.071492  2007 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.075079  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:37.076464  1964 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.076884  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.072605  1792 tablet_bootstrap.cc:654] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.084647  1749 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.084822  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.085541  1746 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.092295  2007 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.092934  2007 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:37.096099  1794 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.096792  1794 ts_tablet_manager.cc:1403] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.006s
I20260709 12:57:37.097424  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:37.103845  1670 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.098241  2007 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.099645  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:37.108258  1794 raft_consensus.cc:359] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.109997  2114 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.125077  2114 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.102563  1747 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:37.120398  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.130986  2124 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.131094  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.131474  2124 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.131870  2124 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.132784  2114 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.133306  1794 raft_consensus.cc:385] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.133580  1794 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.134300  1794 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.134824  2052 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.135258  2052 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.135643  2052 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.140635  1794 ts_tablet_manager.cc:1434] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:57:37.140882  2124 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.142036  1794 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.143141  2124 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.143743  2052 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.146711  2052 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.169726  2121 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.150490  2134 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.171178  2134 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.157737  2201 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.173887  2134 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:37.162647  1794 tablet_bootstrap.cc:654] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.178864  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:37.187628  1715 leader_election.cc:343] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:37.192131  1566 leader_election.cc:343] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.193706  2190 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.214542  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.215619  1747 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.223737  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:37.227732  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.228847  1747 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.220183  1501 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.243507  1792 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:37.248383  1792 ts_tablet_manager.cc:1403] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.190s	user 0.046s	sys 0.052s
I20260709 12:57:37.251312  1792 raft_consensus.cc:359] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.252050  1792 raft_consensus.cc:385] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.252338  1792 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.253026  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:37.252990  1792 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.253702  1677 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.254575  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.255295  1751 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.247731  1794 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.256134  1794 ts_tablet_manager.cc:1403] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.033s
I20260709 12:57:37.261088  1794 raft_consensus.cc:359] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.261837  1794 raft_consensus.cc:385] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.262118  1794 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.262849  1794 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.265517  1794 ts_tablet_manager.cc:1434] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:57:37.266754  1794 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.269124  1792 ts_tablet_manager.cc:1434] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:57:37.270509  1792 tablet_bootstrap.cc:492] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:37.277720  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:37.278986  1792 tablet_bootstrap.cc:654] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.287364  1794 tablet_bootstrap.cc:654] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.293040  1747 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.298404  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:37.300112  1751 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
W20260709 12:57:37.322976  1566 leader_election.cc:343] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:37.323469  1715 leader_election.cc:343] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.324426  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:37.324231  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:37.328585  2121 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.329864  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.331463  1964 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.331983  1964 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.332775  1964 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.333753  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.326188  1677 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.341313  1859 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.348909  2124 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.326848  2052 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.363631  2121 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.365165  1792 tablet_bootstrap.cc:492] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:37.365694  1792 ts_tablet_manager.cc:1403] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.013s
I20260709 12:57:37.367334  1794 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.367831  1794 ts_tablet_manager.cc:1403] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.101s	user 0.024s	sys 0.004s
I20260709 12:57:37.352263  2052 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.370136  2052 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.387277  1792 raft_consensus.cc:359] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.388239  1792 raft_consensus.cc:385] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.390848  1794 raft_consensus.cc:359] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.391820  1794 raft_consensus.cc:385] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.392196  1794 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.393098  1794 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.388592  1792 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.394554  2190 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.398139  1792 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.401474  1792 ts_tablet_manager.cc:1434] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:57:37.402928  1792 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:37.408937  1794 ts_tablet_manager.cc:1434] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 12:57:37.410570  2124 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.411147  1794 tablet_bootstrap.cc:492] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.413811  2124 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.425591  1792 tablet_bootstrap.cc:654] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.434343  2052 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.435587  1794 tablet_bootstrap.cc:654] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.437533  2052 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:37.441959  1641 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:37.443280  1792 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:37.443877  1792 ts_tablet_manager.cc:1403] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.001s
W20260709 12:57:37.444624  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 92127.3us
I20260709 12:57:37.448280  1792 raft_consensus.cc:359] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.449136  1792 raft_consensus.cc:385] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.449437  1792 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.450110  1792 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.454587  1794 tablet_bootstrap.cc:492] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.455199  1794 ts_tablet_manager.cc:1403] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.001s
I20260709 12:57:37.459381  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.459381  1794 raft_consensus.cc:359] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.460361  1794 raft_consensus.cc:385] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.460323  1746 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.460829  1794 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.462888  1792 ts_tablet_manager.cc:1434] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:57:37.470592  1746 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.471819  1792 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:37.462656  1498 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.475907  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:37.476596  1672 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.461788  1794 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:37.479977  1566 leader_election.cc:343] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.483278  1794 ts_tablet_manager.cc:1434] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:57:37.484529  1794 tablet_bootstrap.cc:492] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.493055  1794 tablet_bootstrap.cc:654] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.493857  2226 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.494469  2226 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.496735  2226 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.499250  1672 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.501402  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.503109  2007 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.516525  1748 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:37.516335  2007 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.518420  2007 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.524418  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:37.525321  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.526007  1747 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:37.535024  1678 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:37.537933  2134 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.538520  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:37.539938  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 0.
I20260709 12:57:37.542089  1792 tablet_bootstrap.cc:654] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.542729  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.544268  2190 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.545771  2190 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.546391  2190 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.549782  1794 tablet_bootstrap.cc:492] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.543080  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.553260  1794 ts_tablet_manager.cc:1403] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.027s
I20260709 12:57:37.554883  2229 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.555457  2229 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.556478  2229 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.558879  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:37.560257  2226 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.567797  2190 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.569738  2226 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.578017  1794 raft_consensus.cc:359] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.587913  1794 raft_consensus.cc:385] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.588410  1794 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.588881  2190 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.589496  1794 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.593060  1794 ts_tablet_manager.cc:1434] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:57:37.594113  1794 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.593885  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.594676  1792 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:37.594580  1748 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.595201  1792 ts_tablet_manager.cc:1403] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.124s	user 0.007s	sys 0.031s
I20260709 12:57:37.595991  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:37.596611  1598 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.603822  1598 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:37.605127  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:37.603858  1600 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:37.607774  2226 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.607954  2124 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.608664  2226 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:37.610662  1748 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:37.610376  2226 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.612759  1794 tablet_bootstrap.cc:654] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.616777  1792 raft_consensus.cc:359] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.619760  1792 raft_consensus.cc:385] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.620177  1792 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.622144  2134 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.622560  2124 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.622929  1792 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.623047  2124 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.626893  2124 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.629611  2229 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.630430  1794 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.631109  1794 ts_tablet_manager.cc:1403] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 12:57:37.631127  1792 ts_tablet_manager.cc:1434] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:57:37.633733  1792 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Bootstrap starting.
I20260709 12:57:37.634739  1794 raft_consensus.cc:359] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.636904  1794 raft_consensus.cc:385] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.637180  1794 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.637873  1794 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.641214  1794 ts_tablet_manager.cc:1434] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 12:57:37.642328  1794 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Bootstrap starting.
I20260709 12:57:37.645082  2226 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.649284  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.650125  1748 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.656754  2226 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.657370  2226 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.659456  2226 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.674988  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.675989  2201 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.676365  2201 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.676717  2201 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.677639  1794 tablet_bootstrap.cc:654] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.680402  1792 tablet_bootstrap.cc:654] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.675505  1498 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.686024  1498 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.689313  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:37.691461  1794 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: No bootstrap required, opened a new log
I20260709 12:57:37.692114  1794 ts_tablet_manager.cc:1403] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.014s
I20260709 12:57:37.691757  1498 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.692889  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.694499  1746 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 1: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:37.697580  1794 raft_consensus.cc:359] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.698336  1794 raft_consensus.cc:385] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.698616  1794 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.699249  1794 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.700665  2201 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.701438  1794 ts_tablet_manager.cc:1434] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:57:37.712576  2201 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.715606  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.716526  1746 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.724614  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:37.725481  1678 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.729405  1792 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: No bootstrap required, opened a new log
I20260709 12:57:37.729980  1792 ts_tablet_manager.cc:1403] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.000s
I20260709 12:57:37.733685  1792 raft_consensus.cc:359] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.735347  1792 raft_consensus.cc:385] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.735694  1792 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.736378  1792 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.738116  2229 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.738510  1792 ts_tablet_manager.cc:1434] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:37.738646  2229 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.741345  2229 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.744338  1746 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.749722  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.750514  1746 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.751935  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.751686  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:37.752714  2229 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.752873  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.753414  2229 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.753738  2124 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.754212  2124 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.755043  2124 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.757115  2229 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.753237  1672 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.768363  2124 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.769047  1672 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.773057  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:37.773648  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:37.773782  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:37.775064  2007 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.777678  2124 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.780388  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.781100  1746 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.783146  1498 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.774005  1677 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.792999  2007 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.795801  1746 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.798758  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.802727  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.803658  2229 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.804136  2229 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.804965  2229 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.819365  2229 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.819954  2229 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.821593  2229 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.822930  2007 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.827072  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:37.827879  1746 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.830077  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:37.831440  2229 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.831846  2229 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.832167  2229 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.842577  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:37.843497  1677 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 0.
I20260709 12:57:37.846309  1603 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.849510  2231 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.858139  1501 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.868221  2231 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.867151  2229 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.907718  2229 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:37.911871  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:37.912863  1677 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.913406  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:37.914038  1747 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.927284  1677 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.942440  1747 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:37.951560  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:37.952397  2201 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.952916  2201 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:37.953769  2201 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:37.957923  2231 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:57:37.965886  1549 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:37.965885  2231 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.993490  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:38.030635  2190 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.051775  2190 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:38.101940  2231 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.128847  2231 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:38.221487  1677 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:38.229552  2229 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:38.232160  2229 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.307372  2231 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:38.329481  2124 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:38.354180  2124 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.370357  2228 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.587430   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:38.617902  2271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:38.618125  2270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:38.618929   431 server_base.cc:1061] running on GCE node
W20260709 12:57:38.619323  2273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:38.620884   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:38.621141   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:38.621377   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601858621356 us; error 0 us; skew 500 ppm
I20260709 12:57:38.622051   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:38.627995   431 webserver.cc:533] Webserver started at http://127.0.107.196:45877/ using document root <none> and password file <none>
I20260709 12:57:38.628739   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:38.629014   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:38.629412   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:38.631268   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-3-root/instance:
uuid: "570958eb733a4af7ae16ae020998c8b4"
format_stamp: "Formatted at 2026-07-09 12:57:38 on dist-test-slave-fc6v"
I20260709 12:57:38.637854   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:57:38.642040  2278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:38.643009   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:57:38.643386   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-3-root
uuid: "570958eb733a4af7ae16ae020998c8b4"
format_stamp: "Formatted at 2026-07-09 12:57:38 on dist-test-slave-fc6v"
I20260709 12:57:38.643813   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:38.680786   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:38.682945   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:38.685299   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:38.688781   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:38.689074   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:38.689385   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:38.689620   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:38.805171   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:35919
I20260709 12:57:38.805331  2341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:35919 every 8 connection(s)
I20260709 12:57:38.812687   431 auto_leader_rebalancer-test.cc:384] add a tserver: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:38.841128  2342 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44561
I20260709 12:57:38.841703  2342 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:38.842557  2342 heartbeater.cc:507] Master 127.0.107.254:44561 requested a full tablet report, sending...
I20260709 12:57:38.844713  1500 ts_manager.cc:194] Registered new tserver with Master: 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:38.846414  1500 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52332
I20260709 12:57:39.052325  1745 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.062209  1598 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.062209  1678 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.064234  2224 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.065408  2119 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:39.077687  1715 consensus_peers.cc:597] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05c68d760d04910b7ffad46dd2ec819. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.080106  2119 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.081643  1598 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.089346  1677 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.125711  1500 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.141242  1598 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.160252  1677 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.160902  1745 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.162317  2201 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.163831  2231 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:39.188169  1566 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cd71f19da3340e6aae32a3f83215159. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.190757  2231 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.192552  1745 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.228178  1501 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.246399  1677 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.255255  1678 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.275588  1747 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.279136  1603 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.280396  2366 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.282740  2226 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.377727  1751 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 12:57:39.380091  1641 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 979e85778d254fc7a74198c589e12967. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.369455  2366 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.438232  1598 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.464231  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.507794  1676 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.543473  1747 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.544936  2374 ts_tablet_manager.cc:933] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:39.545197  1641 consensus_peers.cc:597] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22178ca5cca34225bf0682753c951fb7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.554412  1603 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.562637  2366 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.564160  1859 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.569085  2374 tablet_copy_client.cc:323] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43001
I20260709 12:57:39.600616  2366 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.604729  2380 ts_tablet_manager.cc:933] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 12:57:39.622350  1751 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.640287  1762 tablet_copy_service.cc:140] P fab19506de7242869c29d70c9fffb739: Received BeginTabletCopySession request for tablet d05c68d760d04910b7ffad46dd2ec819 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:46136)
I20260709 12:57:39.641126  1762 tablet_copy_service.cc:161] P fab19506de7242869c29d70c9fffb739: Beginning new tablet copy session on tablet d05c68d760d04910b7ffad46dd2ec819 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:46136: session id = 570958eb733a4af7ae16ae020998c8b4-d05c68d760d04910b7ffad46dd2ec819
I20260709 12:57:39.649448  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:39.640373  1603 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:39.685189  1762 tablet_copy_source_session.cc:215] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:39.693259  2374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c68d760d04910b7ffad46dd2ec819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:39.720536  2380 tablet_copy_client.cc:323] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
I20260709 12:57:39.729650  2374 tablet_copy_client.cc:806] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:39.730615  2374 tablet_copy_client.cc:670] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:39.739905  2374 tablet_copy_client.cc:538] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:39.747418  1613 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet 6cd71f19da3340e6aae32a3f83215159 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
I20260709 12:57:39.748211  1613 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet 6cd71f19da3340e6aae32a3f83215159 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-6cd71f19da3340e6aae32a3f83215159
I20260709 12:57:39.758435  1613 tablet_copy_source_session.cc:215] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:39.769655  2383 ts_tablet_manager.cc:933] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:39.770668  2380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd71f19da3340e6aae32a3f83215159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:39.781104  2383 tablet_copy_client.cc:323] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:57:39.785429  2374 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:39.801301  2380 tablet_copy_client.cc:806] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:39.802136  2380 tablet_copy_client.cc:670] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:39.810519  2380 tablet_copy_client.cc:538] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:39.814749  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 979e85778d254fc7a74198c589e12967 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:57:39.815526  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 979e85778d254fc7a74198c589e12967 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-979e85778d254fc7a74198c589e12967
I20260709 12:57:39.834424  1688 tablet_copy_source_session.cc:215] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:39.847451  2380 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:39.849020  2383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979e85778d254fc7a74198c589e12967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:39.849324  2342 heartbeater.cc:499] Master 127.0.107.254:44561 was elected leader, sending a full tablet report...
I20260709 12:57:39.870965  2374 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:39.872377  2374 tablet_bootstrap.cc:492] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:39.873245  2374 ts_tablet_manager.cc:1403] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.017s
I20260709 12:57:39.876907  2374 raft_consensus.cc:359] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.877889  2374 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:39.878674  2374 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.889427  2374 ts_tablet_manager.cc:1434] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:57:39.890300  2380 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:39.891377  2380 tablet_bootstrap.cc:492] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:39.894217  2380 ts_tablet_manager.cc:1403] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.017s
I20260709 12:57:39.897446  1762 tablet_copy_service.cc:342] P fab19506de7242869c29d70c9fffb739: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-d05c68d760d04910b7ffad46dd2ec819 received from {username='slave'} at 127.0.0.1:46136
I20260709 12:57:39.897747  2380 raft_consensus.cc:359] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.898147  1762 tablet_copy_service.cc:434] P fab19506de7242869c29d70c9fffb739: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-d05c68d760d04910b7ffad46dd2ec819 on tablet d05c68d760d04910b7ffad46dd2ec819 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:39.900821  2380 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:39.901814  2380 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.904860  2380 ts_tablet_manager.cc:1434] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:57:39.913086  1613 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-6cd71f19da3340e6aae32a3f83215159 received from {username='slave'} at 127.0.0.1:55880
I20260709 12:57:39.913643  1613 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-6cd71f19da3340e6aae32a3f83215159 on tablet 6cd71f19da3340e6aae32a3f83215159 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:39.929452  2383 tablet_copy_client.cc:806] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:39.930207  2383 tablet_copy_client.cc:670] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:39.934253  2383 tablet_copy_client.cc:538] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:39.944753  2383 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:39.971114  2383 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:39.972283  2383 tablet_bootstrap.cc:492] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:39.973075  2383 ts_tablet_manager.cc:1403] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260709 12:57:39.976496  2383 raft_consensus.cc:359] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.977445  2383 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:39.978157  2383 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:39.980691  2383 ts_tablet_manager.cc:1434] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:57:39.985749  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-979e85778d254fc7a74198c589e12967 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:57:39.986303  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-979e85778d254fc7a74198c589e12967 on tablet 979e85778d254fc7a74198c589e12967 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:40.005537  2317 raft_consensus.cc:1217] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:40.012425  2383 ts_tablet_manager.cc:933] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:40.015676  2383 tablet_copy_client.cc:323] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:57:40.018152  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 22178ca5cca34225bf0682753c951fb7 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:57:40.018777  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 22178ca5cca34225bf0682753c951fb7 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-22178ca5cca34225bf0682753c951fb7
I20260709 12:57:40.027640  1688 tablet_copy_source_session.cc:215] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:40.031438  2383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22178ca5cca34225bf0682753c951fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:40.050594  2383 tablet_copy_client.cc:806] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:40.051313  2383 tablet_copy_client.cc:670] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:40.055698  2383 tablet_copy_client.cc:538] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:40.065752  2383 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:40.098670  2383 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:40.099786  2383 tablet_bootstrap.cc:492] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:40.100840  2383 ts_tablet_manager.cc:1403] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.004s
I20260709 12:57:40.104144  2383 raft_consensus.cc:359] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:40.105274  2383 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:40.106003  2383 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:40.109222  2383 ts_tablet_manager.cc:1434] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:40.111855  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-22178ca5cca34225bf0682753c951fb7 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:57:40.112391  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-22178ca5cca34225bf0682753c951fb7 on tablet 22178ca5cca34225bf0682753c951fb7 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:40.170782  2317 raft_consensus.cc:1217] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:40.321087  2317 raft_consensus.cc:1217] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:40.437816  2119 raft_consensus.cc:1064] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:40.441130  2119 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:40.449512  1674 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.449772  2317 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.451385  1600 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.451196  2119 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:40.452495  2224 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:40.453467  2390 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.470929  2119 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.478865  1600 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.482143  2317 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.522064  1501 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.525182  1677 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.564800  2317 raft_consensus.cc:1217] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:40.605414  1746 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:40.612778  2317 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:40.613075  1674 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:40.616040  2119 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:40.617280  2397 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:40.625905  2397 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.644654  1674 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.653206  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d05c68d760d04910b7ffad46dd2ec819 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:40.651875  2317 raft_consensus.cc:2955] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.682265  1498 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:40.700675  1590 tablet_service.cc:1558] Processing DeleteTablet for tablet d05c68d760d04910b7ffad46dd2ec819 with delete_type TABLET_DATA_TOMBSTONED (TS 693257b3078444e0bd26d3e82159d452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54650
I20260709 12:57:40.703917  2402 tablet_replica.cc:333] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 12:57:40.713243  2402 raft_consensus.cc:2243] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:40.714116  2402 raft_consensus.cc:2272] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:40.719314  2402 ts_tablet_manager.cc:1916] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:40.737236  2402 ts_tablet_manager.cc:1929] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:40.737914  2402 log.cc:1199] T d05c68d760d04910b7ffad46dd2ec819 P 693257b3078444e0bd26d3e82159d452: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/wals/d05c68d760d04910b7ffad46dd2ec819
I20260709 12:57:40.739610  1485 catalog_manager.cc:5028] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): tablet d05c68d760d04910b7ffad46dd2ec819 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:40.773425  2362 raft_consensus.cc:1064] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:40.776548  2362 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:40.785154  2317 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.787024  1751 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.787040  2362 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:40.788862  2401 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:40.790838  1674 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.792783  2401 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.812942  2226 raft_consensus.cc:1064] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:40.814302  2124 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.815740  2226 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:40.822049  1674 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.824957  2316 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.831564  1751 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.836352  1498 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:40.860136  2317 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.862947  1600 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.864579  2371 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:40.865876  2367 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:40.868854  1751 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.871495  2367 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.879204  1598 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:40.893288  1751 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:40.893451  2316 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:40.896697  2231 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:40.897733  2124 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:40.916006  2124 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.922996  1746 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.933375  2317 raft_consensus.cc:2955] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.941931  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6cd71f19da3340e6aae32a3f83215159 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:40.957512  1500 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:40.966130  2366 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:40.978026  2316 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.016554  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:57:41.023732  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 43752.5us
I20260709 12:57:41.032866  1746 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.039495  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cd71f19da3340e6aae32a3f83215159 with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46970
I20260709 12:57:41.039192  1603 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.043740  2411 raft_consensus.cc:1064] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:41.047739  2411 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:41.054745  1674 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:41.055133  2412 tablet_replica.cc:333] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 12:57:41.060963  2412 raft_consensus.cc:2243] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.064131  2412 raft_consensus.cc:2272] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.070073  2316 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:41.072047  1598 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:41.071960  2411 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:41.076437  1748 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:41.078581  2412 ts_tablet_manager.cc:1916] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.079265  2366 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:41.080730  2316 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.083465  2366 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:41.085809  2366 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:41.095134  1598 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.098897  2411 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:41.110790  2366 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.112756  2317 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.135957  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 979e85778d254fc7a74198c589e12967 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:41.154834  1600 raft_consensus.cc:2955] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.166543  2411 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.170118  2412 ts_tablet_manager.cc:1929] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:41.170715  2412 log.cc:1199] T 6cd71f19da3340e6aae32a3f83215159 P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/6cd71f19da3340e6aae32a3f83215159
I20260709 12:57:41.173777  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet 6cd71f19da3340e6aae32a3f83215159 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:41.174557  1748 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.175981  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:41.185861  2317 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.198791  1598 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.220584  1500 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.223109  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet 979e85778d254fc7a74198c589e12967 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:48436
I20260709 12:57:41.239328  2417 tablet_replica.cc:333] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 12:57:41.241037  2417 raft_consensus.cc:2243] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.241966  2417 raft_consensus.cc:2272] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.266695  1674 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:41.269387  2417 ts_tablet_manager.cc:1916] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.280375  2317 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.282253  1747 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.284287  2367 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.286695  2367 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.290583  2417 ts_tablet_manager.cc:1929] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:41.291261  2417 log.cc:1199] T 979e85778d254fc7a74198c589e12967 P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/979e85778d254fc7a74198c589e12967
I20260709 12:57:41.293406  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet 979e85778d254fc7a74198c589e12967 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:41.299018  2226 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.301905  2317 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.303624  1747 raft_consensus.cc:2955] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:41.313061  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22178ca5cca34225bf0682753c951fb7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:41.322579  1500 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:41.350420  1590 tablet_service.cc:1558] Processing DeleteTablet for tablet 22178ca5cca34225bf0682753c951fb7 with delete_type TABLET_DATA_TOMBSTONED (TS 693257b3078444e0bd26d3e82159d452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54650
I20260709 12:57:41.357372  2418 tablet_replica.cc:333] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 12:57:41.358597  2418 raft_consensus.cc:2243] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.359453  2418 raft_consensus.cc:2272] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.364759  2418 ts_tablet_manager.cc:1916] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.382042  2418 ts_tablet_manager.cc:1929] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:41.382510  2418 log.cc:1199] T 22178ca5cca34225bf0682753c951fb7 P 693257b3078444e0bd26d3e82159d452: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/wals/22178ca5cca34225bf0682753c951fb7
I20260709 12:57:41.384307  1485 catalog_manager.cc:5028] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): tablet 22178ca5cca34225bf0682753c951fb7 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:42.414276  1598 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:42.425292  1676 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.426343  1747 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:57:42.427879  1566 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8ce4edad7b14292b8c162db2d204922. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.429157  2124 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.430047  2362 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.452618  2124 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.454873  1746 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.454671  1676 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.472405  1500 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.481185  1598 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:42.494004  1746 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:57:42.495213  1566 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc29da50f1424c238eee239d451aab3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.496155  2401 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.496820  1674 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.501282  2124 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.520125  2124 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.521744  1670 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.522766  1746 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.536840  1674 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:42.547163  1498 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.559239  1598 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.561273  1748 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.561798  2371 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:42.562829  1641 consensus_peers.cc:597] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19b0503746074acbb6bd55ef700df0ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.566836  2371 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.586256  2226 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.589154  1748 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.601199  1600 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.603886  1747 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:42.612747  1500 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.632467  1670 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:57:42.634189  1715 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f8de6698b474b218d672997f3c708e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.651489  2419 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:42.656987  1600 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.660774  2436 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.672441  2436 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.674767  1674 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.682564  1600 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:42.695079  1498 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.938833  2439 ts_tablet_manager.cc:933] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 12:57:42.941236  2439 tablet_copy_client.cc:323] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
I20260709 12:57:42.942966  1613 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet bc29da50f1424c238eee239d451aab3c from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
I20260709 12:57:42.943604  1613 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet bc29da50f1424c238eee239d451aab3c from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-bc29da50f1424c238eee239d451aab3c
I20260709 12:57:42.950726  1613 tablet_copy_source_session.cc:215] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:42.957046  2439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29da50f1424c238eee239d451aab3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:42.975601  2439 tablet_copy_client.cc:806] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:42.976217  2439 tablet_copy_client.cc:670] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:42.980240  2439 tablet_copy_client.cc:538] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:42.997434  2439 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:43.045167  2442 ts_tablet_manager.cc:933] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 12:57:43.047919  2442 tablet_copy_client.cc:323] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
I20260709 12:57:43.049909  1613 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet c8ce4edad7b14292b8c162db2d204922 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
I20260709 12:57:43.050220  2439 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.050520  1613 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet c8ce4edad7b14292b8c162db2d204922 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-c8ce4edad7b14292b8c162db2d204922
I20260709 12:57:43.051194  2439 tablet_bootstrap.cc:492] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:43.052026  2439 ts_tablet_manager.cc:1403] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.004s
I20260709 12:57:43.063223  2439 raft_consensus.cc:359] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.064240  2439 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:43.064942  2439 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.070689  1613 tablet_copy_source_session.cc:215] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.078310  2439 ts_tablet_manager.cc:1434] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:57:43.085347  1612 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-bc29da50f1424c238eee239d451aab3c received from {username='slave'} at 127.0.0.1:55880
I20260709 12:57:43.085922  1612 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-bc29da50f1424c238eee239d451aab3c on tablet bc29da50f1424c238eee239d451aab3c with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:43.094744  2442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ce4edad7b14292b8c162db2d204922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.114250  2442 tablet_copy_client.cc:806] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.114933  2442 tablet_copy_client.cc:670] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.119263  2442 tablet_copy_client.cc:538] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.128502  2442 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:43.160887  2442 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.162221  2442 tablet_bootstrap.cc:492] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:43.163120  2442 ts_tablet_manager.cc:1403] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.014s
I20260709 12:57:43.167062  2442 raft_consensus.cc:359] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.168104  2442 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:43.168815  2442 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.171480  2442 ts_tablet_manager.cc:1434] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:57:43.173327  1612 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-c8ce4edad7b14292b8c162db2d204922 received from {username='slave'} at 127.0.0.1:55880
I20260709 12:57:43.173851  1612 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-c8ce4edad7b14292b8c162db2d204922 on tablet c8ce4edad7b14292b8c162db2d204922 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:43.178802  2442 ts_tablet_manager.cc:933] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:43.206887  2442 tablet_copy_client.cc:323] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:57:43.209116  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 19b0503746074acbb6bd55ef700df0ae from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:57:43.209726  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 19b0503746074acbb6bd55ef700df0ae from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-19b0503746074acbb6bd55ef700df0ae
I20260709 12:57:43.219760  1688 tablet_copy_source_session.cc:215] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.223145  2442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b0503746074acbb6bd55ef700df0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.242852  2442 tablet_copy_client.cc:806] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.243578  2442 tablet_copy_client.cc:670] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.247388  2442 tablet_copy_client.cc:538] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.253326  2439 ts_tablet_manager.cc:933] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:43.256852  2439 tablet_copy_client.cc:323] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43001
I20260709 12:57:43.257954  2442 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:43.261453  1762 tablet_copy_service.cc:140] P fab19506de7242869c29d70c9fffb739: Received BeginTabletCopySession request for tablet 3f8de6698b474b218d672997f3c708e3 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:46136)
I20260709 12:57:43.262140  1762 tablet_copy_service.cc:161] P fab19506de7242869c29d70c9fffb739: Beginning new tablet copy session on tablet 3f8de6698b474b218d672997f3c708e3 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:46136: session id = 570958eb733a4af7ae16ae020998c8b4-3f8de6698b474b218d672997f3c708e3
I20260709 12:57:43.276302  1762 tablet_copy_source_session.cc:215] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.279709  2439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8de6698b474b218d672997f3c708e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.284022  2442 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.285158  2442 tablet_bootstrap.cc:492] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:43.285944  2442 ts_tablet_manager.cc:1403] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 12:57:43.289399  2442 raft_consensus.cc:359] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.290354  2442 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:43.291054  2442 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.298036  2442 ts_tablet_manager.cc:1434] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:57:43.301015  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-19b0503746074acbb6bd55ef700df0ae received from {username='slave'} at 127.0.0.1:38702
I20260709 12:57:43.301543  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-19b0503746074acbb6bd55ef700df0ae on tablet 19b0503746074acbb6bd55ef700df0ae with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:43.308174  2439 tablet_copy_client.cc:806] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.309134  2439 tablet_copy_client.cc:670] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.317240  2439 tablet_copy_client.cc:538] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.328078  2439 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:43.345217  2317 raft_consensus.cc:1217] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:43.372020  2439 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.373281  2439 tablet_bootstrap.cc:492] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:43.374143  2439 ts_tablet_manager.cc:1403] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.012s
I20260709 12:57:43.378993  2439 raft_consensus.cc:359] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.380015  2439 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:43.380792  2439 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:43.385900  2439 ts_tablet_manager.cc:1434] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:57:43.388140  1762 tablet_copy_service.cc:342] P fab19506de7242869c29d70c9fffb739: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-3f8de6698b474b218d672997f3c708e3 received from {username='slave'} at 127.0.0.1:46136
I20260709 12:57:43.388652  1762 tablet_copy_service.cc:434] P fab19506de7242869c29d70c9fffb739: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-3f8de6698b474b218d672997f3c708e3 on tablet 3f8de6698b474b218d672997f3c708e3 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:43.572284  2317 raft_consensus.cc:1217] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:43.595227  2317 raft_consensus.cc:1217] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:43.804255  2317 raft_consensus.cc:1217] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:43.933936  2362 raft_consensus.cc:1064] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:43.936591  2362 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:43.943399  1747 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:43.944149  2317 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:43.944319  1670 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:43.946098  2362 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:43.947791  2124 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:43.949010  2421 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:43.984565  2371 raft_consensus.cc:1064] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:43.987391  2371 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:43.991407  2362 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:43.998893  1670 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.026067  1747 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.029173  2316 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.032847  2450 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.029731  2317 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.044785  1498 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.063143  2124 raft_consensus.cc:1064] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:44.066406  2124 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:44.085852  2316 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.087724  1747 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.089013  1676 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.094507  1747 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.096807  2450 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:44.101446  1600 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.102936  2457 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.106029  2455 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:57:44.118794  2362 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.122352  2401 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.200742  2436 raft_consensus.cc:1064] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:44.203915  2436 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:44.210871  2457 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.212563  1747 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.222645  2401 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.225471  1751 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.226409  1598 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.242931  2317 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.248855  2315 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.249673  1676 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.251125  2397 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:44.252518  1670 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.252556  2316 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.254274  2397 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.257619  1598 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.260203  2436 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:44.287389  1600 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:44.301889  1746 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.307837  2316 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.319995  2397 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.304924  1501 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.321398  2317 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.331027  2362 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.333310  2401 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.335090  1600 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.342446  1500 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.347455  1670 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.355110  2401 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.363823  1674 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:44.369997  1603 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:44.394788  1746 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.396874  2317 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.399348  1678 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.401414  1751 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.404518  2457 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.405898  2450 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.405123  2316 raft_consensus.cc:2955] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.407003  2317 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.423620  2422 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.428620  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc29da50f1424c238eee239d451aab3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.429394  2421 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.433581  2401 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.377061  1500 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.449550  2317 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.446799  1746 raft_consensus.cc:2955] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.457433  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19b0503746074acbb6bd55ef700df0ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:57:44.525535  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49457.8us
I20260709 12:57:44.531912  1501 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.536120  1751 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:57:44.545388  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 115145us
I20260709 12:57:44.548118  2317 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.549953  2436 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.567186  1590 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b0503746074acbb6bd55ef700df0ae with delete_type TABLET_DATA_TOMBSTONED (TS 693257b3078444e0bd26d3e82159d452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54650
I20260709 12:57:44.567215  2436 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.572220  2476 tablet_replica.cc:333] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 12:57:44.572319  2317 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.583305  1496 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.586557  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f8de6698b474b218d672997f3c708e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.596680  2476 raft_consensus.cc:2243] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.597596  2476 raft_consensus.cc:2272] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.603134  2476 ts_tablet_manager.cc:1916] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.608824  1597 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.624289  2476 ts_tablet_manager.cc:1929] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:44.624825  2476 log.cc:1199] T 19b0503746074acbb6bd55ef700df0ae P 693257b3078444e0bd26d3e82159d452: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/wals/19b0503746074acbb6bd55ef700df0ae
I20260709 12:57:44.628954  2455 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.641381  2469 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.626950  1485 catalog_manager.cc:5028] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): tablet 19b0503746074acbb6bd55ef700df0ae (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:44.648759  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8ce4edad7b14292b8c162db2d204922 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.654176  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet bc29da50f1424c238eee239d451aab3c with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46970
I20260709 12:57:44.669646  2477 tablet_replica.cc:333] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 12:57:44.671198  1603 raft_consensus.cc:2955] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.678869  1496 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.684222  2477 raft_consensus.cc:2243] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.685716  1676 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.689779  2316 raft_consensus.cc:2955] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:44.709415  1500 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.711599  2477 raft_consensus.cc:2272] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.726344  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet c8ce4edad7b14292b8c162db2d204922 with delete_type TABLET_DATA_TOMBSTONED (TS fab19506de7242869c29d70c9fffb739 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48436
I20260709 12:57:44.745882  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f8de6698b474b218d672997f3c708e3 with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46970
I20260709 12:57:44.748462  2477 ts_tablet_manager.cc:1916] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.756983  2478 tablet_replica.cc:333] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 12:57:44.759972  2478 raft_consensus.cc:2243] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.760758  2478 raft_consensus.cc:2272] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.771636  2478 ts_tablet_manager.cc:1916] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.790330  2477 ts_tablet_manager.cc:1929] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:44.791234  2477 log.cc:1199] T bc29da50f1424c238eee239d451aab3c P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/bc29da50f1424c238eee239d451aab3c
I20260709 12:57:44.799106  2477 tablet_replica.cc:333] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 12:57:44.802627  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet bc29da50f1424c238eee239d451aab3c (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:44.803498  2477 raft_consensus.cc:2243] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.805774  2477 raft_consensus.cc:2272] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.806640  2478 ts_tablet_manager.cc:1929] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:44.807153  2478 log.cc:1199] T c8ce4edad7b14292b8c162db2d204922 P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/c8ce4edad7b14292b8c162db2d204922
I20260709 12:57:44.809126  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet c8ce4edad7b14292b8c162db2d204922 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:44.810189  2477 ts_tablet_manager.cc:1916] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.831039  2477 ts_tablet_manager.cc:1929] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:44.831517  2477 log.cc:1199] T 3f8de6698b474b218d672997f3c708e3 P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/3f8de6698b474b218d672997f3c708e3
I20260709 12:57:44.833390  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet 3f8de6698b474b218d672997f3c708e3 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:45.824306  1603 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:45.831269  1751 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.832146  1670 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.833855  2480 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:45.834779  1566 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 852e1e3fa7a448bf924920b2d2b47558. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:45.835574  2481 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.842310  2480 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.844069  1751 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.844364  1670 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.858014  1676 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:45.863293  1501 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 12:57:45.871590  1641 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51d41e7558f84fa1b99e709cb935e448. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:45.871908  1751 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.871594  1603 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.873898  2457 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:45.875062  2482 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.886135  2482 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.890967  1603 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.894833  1751 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.920061  1500 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.923022  1746 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:57:45.935038  1715 consensus_peers.cc:597] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2eac534aa8b349bc923752022b0b9ab6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:45.942237  1676 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.942691  1597 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.943825  2436 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.944905  2419 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.957509  2436 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.958685  1676 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.984440  1597 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:45.989751  1748 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:45.990281  1500 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 12:57:46.019310  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a60f7d5f008b4c6f8ee8b707a5916f7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:46.023644  1674 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:46.023795  1603 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:46.025380  2497 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:46.027822  2436 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:46.065881  2497 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:46.072566  1603 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:46.072213  1674 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:46.092406  1500 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:46.416886  2502 ts_tablet_manager.cc:933] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:46.433378  2504 ts_tablet_manager.cc:933] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:46.433616  2502 tablet_copy_client.cc:323] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:57:46.435984  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 51d41e7558f84fa1b99e709cb935e448 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:57:46.436805  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 51d41e7558f84fa1b99e709cb935e448 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-51d41e7558f84fa1b99e709cb935e448
I20260709 12:57:46.446238  2504 tablet_copy_client.cc:323] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43001
I20260709 12:57:46.448002  1688 tablet_copy_source_session.cc:215] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.448455  1762 tablet_copy_service.cc:140] P fab19506de7242869c29d70c9fffb739: Received BeginTabletCopySession request for tablet 2eac534aa8b349bc923752022b0b9ab6 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:46136)
I20260709 12:57:46.449481  1762 tablet_copy_service.cc:161] P fab19506de7242869c29d70c9fffb739: Beginning new tablet copy session on tablet 2eac534aa8b349bc923752022b0b9ab6 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:46136: session id = 570958eb733a4af7ae16ae020998c8b4-2eac534aa8b349bc923752022b0b9ab6
I20260709 12:57:46.454881  2502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d41e7558f84fa1b99e709cb935e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.459220  2506 ts_tablet_manager.cc:933] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 12:57:46.461587  1762 tablet_copy_source_session.cc:215] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.465489  2504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eac534aa8b349bc923752022b0b9ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.469447  2506 tablet_copy_client.cc:323] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
I20260709 12:57:46.472519  1612 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet 852e1e3fa7a448bf924920b2d2b47558 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
I20260709 12:57:46.473156  1612 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet 852e1e3fa7a448bf924920b2d2b47558 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-852e1e3fa7a448bf924920b2d2b47558
I20260709 12:57:46.481762  1612 tablet_copy_source_session.cc:215] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.482622  2502 tablet_copy_client.cc:806] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.483413  2502 tablet_copy_client.cc:670] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.494617  2502 tablet_copy_client.cc:538] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.490634  2506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e1e3fa7a448bf924920b2d2b47558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.523857  2504 tablet_copy_client.cc:806] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.524654  2504 tablet_copy_client.cc:670] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.525203  2502 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:46.537700  2506 tablet_copy_client.cc:806] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.538821  2506 tablet_copy_client.cc:670] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.539355  2504 tablet_copy_client.cc:538] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.547353  2506 tablet_copy_client.cc:538] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.566675  2504 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:46.567476  2506 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:46.594533  2502 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.595920  2502 tablet_bootstrap.cc:492] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:46.596690  2502 ts_tablet_manager.cc:1403] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.009s
I20260709 12:57:46.606542  2502 raft_consensus.cc:359] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.607506  2502 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:46.608623  2502 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.618623  2502 ts_tablet_manager.cc:1434] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 12:57:46.626427  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-51d41e7558f84fa1b99e709cb935e448 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:57:46.626991  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-51d41e7558f84fa1b99e709cb935e448 on tablet 51d41e7558f84fa1b99e709cb935e448 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:46.642052  2502 ts_tablet_manager.cc:933] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:46.643285  2506 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.646965  2506 tablet_bootstrap.cc:492] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:46.649797  2506 ts_tablet_manager.cc:1403] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.009s
I20260709 12:57:46.656152  2506 raft_consensus.cc:359] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.658599  2502 tablet_copy_client.cc:323] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43001
I20260709 12:57:46.659389  2506 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:46.661538  1762 tablet_copy_service.cc:140] P fab19506de7242869c29d70c9fffb739: Received BeginTabletCopySession request for tablet a60f7d5f008b4c6f8ee8b707a5916f7d from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:46136)
I20260709 12:57:46.662163  1762 tablet_copy_service.cc:161] P fab19506de7242869c29d70c9fffb739: Beginning new tablet copy session on tablet a60f7d5f008b4c6f8ee8b707a5916f7d from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:46136: session id = 570958eb733a4af7ae16ae020998c8b4-a60f7d5f008b4c6f8ee8b707a5916f7d
I20260709 12:57:46.661381  2506 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.663352  2504 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.664428  2504 tablet_bootstrap.cc:492] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:46.665210  2504 ts_tablet_manager.cc:1403] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.009s
I20260709 12:57:46.665614  2506 ts_tablet_manager.cc:1434] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:57:46.667584  1612 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-852e1e3fa7a448bf924920b2d2b47558 received from {username='slave'} at 127.0.0.1:55880
I20260709 12:57:46.668006  1612 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-852e1e3fa7a448bf924920b2d2b47558 on tablet 852e1e3fa7a448bf924920b2d2b47558 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:46.671041  2504 raft_consensus.cc:359] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.672160  2504 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:46.672890  1762 tablet_copy_source_session.cc:215] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.672997  2504 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.677062  2504 ts_tablet_manager.cc:1434] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:57:46.678802  2502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60f7d5f008b4c6f8ee8b707a5916f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.679071  1762 tablet_copy_service.cc:342] P fab19506de7242869c29d70c9fffb739: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-2eac534aa8b349bc923752022b0b9ab6 received from {username='slave'} at 127.0.0.1:46136
I20260709 12:57:46.679627  1762 tablet_copy_service.cc:434] P fab19506de7242869c29d70c9fffb739: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-2eac534aa8b349bc923752022b0b9ab6 on tablet 2eac534aa8b349bc923752022b0b9ab6 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:46.703927  2502 tablet_copy_client.cc:806] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.704612  2502 tablet_copy_client.cc:670] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.710601  2502 tablet_copy_client.cc:538] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.721592  2502 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:46.740317  2502 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.741225  2502 tablet_bootstrap.cc:492] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:46.741852  2502 ts_tablet_manager.cc:1403] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.010s
I20260709 12:57:46.744971  2502 raft_consensus.cc:359] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.745831  2502 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:46.746527  2502 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:46.748720  2502 ts_tablet_manager.cc:1434] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:46.752627  1762 tablet_copy_service.cc:342] P fab19506de7242869c29d70c9fffb739: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-a60f7d5f008b4c6f8ee8b707a5916f7d received from {username='slave'} at 127.0.0.1:46136
I20260709 12:57:46.753144  1762 tablet_copy_service.cc:434] P fab19506de7242869c29d70c9fffb739: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-a60f7d5f008b4c6f8ee8b707a5916f7d on tablet a60f7d5f008b4c6f8ee8b707a5916f7d with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:46.809034  2316 raft_consensus.cc:1217] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:46.860911  2316 raft_consensus.cc:1217] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:47.016194  2316 raft_consensus.cc:1217] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:47.187585  2316 raft_consensus.cc:1217] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:47.252658  2482 raft_consensus.cc:1064] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:47.255510  2482 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.264117  1603 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.264117  2316 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.266245  1748 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.266979  2450 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.267995  2508 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:47.269950  2482 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.316498  2482 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.319403  1745 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.327726  2517 raft_consensus.cc:1064] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:47.331276  1603 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.336278  2517 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.346923  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.385185  2316 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.392980  1670 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.393075  2317 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.396718  2436 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.398304  2497 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:47.413784  1600 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.415650  2436 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.422287  1674 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.432117  1603 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.433048  2497 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.436250  2315 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.441852  2508 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:47.458802  1500 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:47.458576  2482 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.466943  2317 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.472160  1597 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.494009  1751 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.496191  2480 raft_consensus.cc:1064] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:47.499127  2480 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.529649  2315 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.481304  1674 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.536274  2497 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:57:47.539877  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67569.2us
I20260709 12:57:47.548103  2517 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.549357  2315 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.553560  2508 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:47.556348  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51d41e7558f84fa1b99e709cb935e448 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:47.567183  2316 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.575937  1677 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.576361  2455 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.570508  2317 raft_consensus.cc:2955] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.579819  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2eac534aa8b349bc923752022b0b9ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:47.591333  1745 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.597882  1676 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.599175  1496 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:47.601353  2517 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:57:47.599435  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:47.610563  1676 raft_consensus.cc:2955] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.622418  1590 tablet_service.cc:1558] Processing DeleteTablet for tablet 2eac534aa8b349bc923752022b0b9ab6 with delete_type TABLET_DATA_TOMBSTONED (TS 693257b3078444e0bd26d3e82159d452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54650
W20260709 12:57:47.626674  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 51928.2us
I20260709 12:57:47.639571  2455 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.644582  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d41e7558f84fa1b99e709cb935e448 with delete_type TABLET_DATA_TOMBSTONED (TS fab19506de7242869c29d70c9fffb739 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48436
I20260709 12:57:47.648840  2455 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.659648  2497 raft_consensus.cc:1064] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:57:47.662636  2497 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.678830  2315 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.681893  2497 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.690282  2538 tablet_replica.cc:333] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 12:57:47.692549  1676 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.712229  2536 tablet_replica.cc:333] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 12:57:47.717674  2535 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.710816  2497 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:57:47.733868  2538 raft_consensus.cc:2243] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:47.734920  2538 raft_consensus.cc:2272] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:47.743996  1597 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.749724  2538 ts_tablet_manager.cc:1916] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:47.760241  1748 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.768690  2536 raft_consensus.cc:2243] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:47.769577  2536 pending_rounds.cc:70] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 12:57:47.770021  2536 pending_rounds.cc:77] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633248602214400 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2eac534aa8b349bc923752022b0b9ab6" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } } }
I20260709 12:57:47.771660  2536 raft_consensus.cc:2917] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:57:47.772198  2536 raft_consensus.cc:2889] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:57:47.772646  2536 raft_consensus.cc:2272] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:47.776816  2536 ts_tablet_manager.cc:1916] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:47.782737  2517 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.795980  2538 ts_tablet_manager.cc:1929] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:47.796561  2538 log.cc:1199] T 51d41e7558f84fa1b99e709cb935e448 P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/51d41e7558f84fa1b99e709cb935e448
I20260709 12:57:47.798265  2536 ts_tablet_manager.cc:1929] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:47.798693  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet 51d41e7558f84fa1b99e709cb935e448 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:47.798851  2536 log.cc:1199] T 2eac534aa8b349bc923752022b0b9ab6 P 693257b3078444e0bd26d3e82159d452: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/wals/2eac534aa8b349bc923752022b0b9ab6
I20260709 12:57:47.801016  1485 catalog_manager.cc:5028] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): tablet 2eac534aa8b349bc923752022b0b9ab6 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:47.837577  2517 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.841185  1674 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.850376  1496 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.850734  2315 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.876938  1674 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.902398  1598 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.905682  1597 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.902398  1496 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.909252  2317 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.904906  2315 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.912077  1674 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.914523  2480 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.934725  2518 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:47.944736  2480 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.957363  2315 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.963367  1676 raft_consensus.cc:2955] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:47.966269  1751 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:47.975100  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 852e1e3fa7a448bf924920b2d2b47558 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:47.981036  2317 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.988129  2436 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:47.990864  1597 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.996800  2436 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.999876  1497 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 3 to 4, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:48.006976  2517 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:48.013463  1600 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:48.017432  2317 raft_consensus.cc:2955] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:57:48.019440  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet 852e1e3fa7a448bf924920b2d2b47558 with delete_type TABLET_DATA_TOMBSTONED (TS fab19506de7242869c29d70c9fffb739 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48436
I20260709 12:57:48.029606  2538 tablet_replica.cc:333] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 12:57:48.030894  2538 raft_consensus.cc:2243] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:48.045202  2538 raft_consensus.cc:2272] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:48.050158  2538 ts_tablet_manager.cc:1916] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:48.053339  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a60f7d5f008b4c6f8ee8b707a5916f7d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:48.065753  1497 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 3 to 4, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:48.104581  2538 ts_tablet_manager.cc:1929] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:48.105221  2538 log.cc:1199] T 852e1e3fa7a448bf924920b2d2b47558 P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/852e1e3fa7a448bf924920b2d2b47558
I20260709 12:57:48.107110  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet 852e1e3fa7a448bf924920b2d2b47558 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:48.137277  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet a60f7d5f008b4c6f8ee8b707a5916f7d with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46970
I20260709 12:57:48.142516  2546 tablet_replica.cc:333] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 12:57:48.144284  2546 raft_consensus.cc:2243] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:48.145252  2546 raft_consensus.cc:2272] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:48.150648  2546 ts_tablet_manager.cc:1916] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:48.169914  2546 ts_tablet_manager.cc:1929] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:48.170406  2546 log.cc:1199] T a60f7d5f008b4c6f8ee8b707a5916f7d P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/a60f7d5f008b4c6f8ee8b707a5916f7d
I20260709 12:57:48.172525  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet a60f7d5f008b4c6f8ee8b707a5916f7d (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:57:50.340143  2553 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.369081  2553 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.374003  2553 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.377069  2554 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.468253  2553 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.468394  2554 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.469472  2553 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.429060  2556 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.440153  2558 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.441941  2557 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.472172  2556 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.472726  2557 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.473905  2559 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.475284  2559 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.465906  2560 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.472186  2558 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.534755  2558 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.535465  2558 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.489661  2560 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.561659  2558 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.494855  2561 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.564999  2561 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.568609  2561 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.507512  2562 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.571854  2562 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.475533  2556 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.576088  2556 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.475873  2557 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.577131  2557 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.578120  2557 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.581168  2557 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.581317  2564 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.582680  2560 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.582615  2564 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:50.476128  2554 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.584499  2554 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.585371  2554 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.524991  2553 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.588176  2553 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.588991  2553 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.592370  2554 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.593143  2554 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.609687  2560 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.611088  2560 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.614367  2560 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.705714  2560 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.621466  2556 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.709017  2556 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.485864  2559 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.709985  2556 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.710282  2559 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.711148  2556 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.711572  2559 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.714682  2556 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.637135  2557 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.794483  2557 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.797830  2557 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.643603  2567 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.799191  2567 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.651364  2564 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:50.804178  2564 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.805233  2564 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.575377  2562 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.809309  2564 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.565018  2558 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.810362  2562 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.811307  2567 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:50.812279  2567 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.549665  2563 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.634138  2565 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.813380  2563 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.817507  2563 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.732935  2560 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.820943  2560 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.735229  2571 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.735014  2566 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.822283  2571 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.825642  2571 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:50.826579  2571 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.828905  2571 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.780964  2573 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.652395  2561 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.683012  2553 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.810576  2558 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.689961  2569 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.811777  2562 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:50.594024  2554 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.813485  2565 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:50.714811  2559 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.736904  2570 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:50.831398  2556 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.749226  2555 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.836997  2572 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.955355  2548 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.955627  2556 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.956507  2548 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.957777  2555 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.958688  2556 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.839520  2567 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:50.959452  2548 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.822409  2566 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.961444  2555 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:50.837270  2564 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.924618  2576 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.925073  2580 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.928369  2571 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:50.934689  2577 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.956175  2572 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.965027  2564 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.962105  2566 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:50.854775  2575 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.963184  2571 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.963124  2576 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.963201  2580 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:50.979835  2568 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.977111  2571 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.967974  2566 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:50.981879  2561 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:50.986269  2580 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.010921  2586 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.982827  2559 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.012651  2582 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.011188  2564 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.013017  2583 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:50.986819  2561 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.002707  2563 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.015527  2572 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.025491  2583 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.033111  2578 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.018955  2582 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.040380  2586 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.014819  2567 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.004503  2558 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.017658  2580 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.019953  2570 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.080610  2557 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.079226  2575 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.026156  2566 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.096045  2572 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.177011  2576 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.177913  2567 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.106105  2562 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.218107  2565 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.095161  2559 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.102631  2581 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.015117  2569 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.433974  2563 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.434638  2570 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.435247  2579 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.019186  2573 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.439555  2588 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.439884  2571 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.440481  2580 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.442847  2584 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.443662  2584 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.441746  2557 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.092758  2568 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.460621  2561 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.461377  2564 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.440441  2588 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.558403  2557 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.558810  2556 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.559178  2562 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.560107  2562 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.560534  2558 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.562834  2562 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.566099  2566 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.444751  2572 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.568037  2564 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.571079  2564 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.571944  2561 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.572844  2559 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.574548  2586 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.574728  2561 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.559149  2557 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.575979  2557 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.463953  2554 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.462466  2576 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.580230  2572 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.579931  2576 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.581139  2558 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.582635  2576 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.450956  2567 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.581964  2558 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.094007  2577 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.589512  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 185) took 2235 ms. Trace:
I20260709 12:57:51.589788  2556 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.590513  2575 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.452716  2563 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.600489  2569 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.613191  2583 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.436023  2579 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.603422  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 420) took 2234 ms. Trace:
I20260709 12:57:51.613746  1501 rpcz_store.cc:276] 0709 12:57:49.348643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.180617 (+1831974us) service_pool.cc:224] Handling call
0709 12:57:51.584006 (+403389us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260709 12:57:51.625270  2557 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.625661  2556 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.608489  2565 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.650013  2565 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.610334  2559 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.631907  2585 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.444623  2578 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.655093  2591 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.654932  2559 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.598130  2589 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.653395  2565 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.646004  1674 rpcz_store.cc:276] 0709 12:57:49.369023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.601872 (+2232849us) service_pool.cc:224] Handling call
0709 12:57:51.602403 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:51.602696 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.602740 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:51.602820 (+    80us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:51.602866 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.602946 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:51.603119 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.605764  2558 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.665711  2579 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.666597  2579 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.591923  2581 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.663812  2559 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.660785  2589 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.674062  2567 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.676002  2586 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.676290  2567 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.676702  2586 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.677309  2567 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.669119  2571 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.679059  2586 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.679533  2571 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.682349  2568 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.683502  2571 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.662552  2583 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.674379  2590 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.680743  2580 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.692410  2580 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.692787  2567 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.691349  2586 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.693221  2580 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.693678  2582 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.696689  2577 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.681185  2569 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.667397  2579 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.692313  2590 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.700719  2567 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.701407  2567 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.705169  2567 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.693778  2586 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.708289  2569 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.708950  2586 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:51.712317  2281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.082s	sys 0.123s
I20260709 12:57:51.683710  2585 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.699996  2583 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.711220  2569 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.721642  2584 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.722425  2584 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.724203  2584 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.712674  2581 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.729508  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.731988  2586 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.712648  2578 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.736444  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.734565  2571 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.737651  1677 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:51.737927  2571 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.739742  2577 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.740585  2577 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.741216  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.742204  1674 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:51.688530  2591 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.774785  2596 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:51.775645  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.561s	user 0.033s	sys 0.016s
W20260709 12:57:51.776223  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.562s	user 0.034s	sys 0.016s
I20260709 12:57:51.777560  2582 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.775856  2596 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.778960  2582 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.779364  2594 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.776786  2576 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.782207  2576 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.782810  2582 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.780841  2575 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.783623  2575 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.784690  2576 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.785953  2575 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.781150  2569 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.787142  2569 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.789760  2569 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.790386  2569 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:51.776587  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 2.56223e+06us
I20260709 12:57:51.793825  2595 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.799052  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.799126  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.807590  2575 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.808406  2575 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.810976  2575 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.791024  2569 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.811527  2573 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.828738  2588 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.827739  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.825610  2571 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.832569  2591 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.738889  2586 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.835772  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.836423  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 421) took 2460 ms. Trace:
I20260709 12:57:51.836580  1674 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.836905  1676 rpcz_store.cc:276] 0709 12:57:49.376361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.458597 (+2082236us) service_pool.cc:224] Handling call
0709 12:57:51.459326 (+   729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:51.563909 (+104583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.563947 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:51.564015 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:51.564054 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.836009 (+271955us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540036ecd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:57:51.836057 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:51.836198 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239660288}
I20260709 12:57:51.844125  2580 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.844810  2584 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.794849  2595 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.828052  2583 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.780233  2594 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.847481  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.826045  2585 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.847371  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.848711  2556 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.850615  1676 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.850119  2564 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.853736  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.853364  2556 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.857007  2556 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.857681  2564 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.854622  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:51.860026  2584 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:51.860447  2564 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.860297  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:51.860457  2584 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.861199  2584 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.861408  2580 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:51.862027  2580 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.862509  2580 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.867894  2585 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.868229  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.869036  1670 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.868872  2585 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.871727  2585 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.854104  2577 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.882845  2535 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.883687  2535 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.883328  2586 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.885629  2436 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.886512  2436 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.887336  2535 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.888715  2436 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.890777  2593 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.892095  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.892753  1676 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:51.877877  2510 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:51.896322  2596 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.896845  2436 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.877372  2583 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:51.895953  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6020 after lost signal to thread 434
I20260709 12:57:51.891767  2593 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.901137  2436 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:57:51.902410  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6700 after lost signal to thread 1535
I20260709 12:57:51.892671  1674 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:51.903240  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:51.899502  2586 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.896807  2510 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.906863  2569 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.902555  2589 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:51.907279  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd3c0 after lost signal to thread 1627
I20260709 12:57:51.911015  2510 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:51.911957  2338 debug-util.cc:398] Leaking SignalData structure 0x7b080026e760 after lost signal to thread 1702
I20260709 12:57:51.912369  2436 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.907902  2586 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.916623  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:51.901757  2579 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.910387  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.917331  2317 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.917850  1670 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.909663  2588 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:51.913527  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3140 after lost signal to thread 1776
I20260709 12:57:51.917145  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.917388  2586 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.921185  1676 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.919691  2595 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.914542  2593 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:51.920150  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:51.923014  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002753e0 after lost signal to thread 1777
W20260709 12:57:51.925436  2338 debug-util.cc:398] Leaking SignalData structure 0x7b0800306700 after lost signal to thread 2341
I20260709 12:57:51.925431  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.926390  1670 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.928198  2580 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.919018  2588 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.936646  2588 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.937491  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.937650  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.938380  1672 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.922183  2598 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.922495  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.899094  2584 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.923624  2594 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.929399  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.929875  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.942979  1597 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:51.917900  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.931308  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.921269  2583 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.931959  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.932538  2590 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.933712  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.944384  1676 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.945468  2315 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:51.947245  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.947990  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:51.946902  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.947163  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.941812  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.950652  1671 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.950814  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:51.951125  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.943123  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.951855  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.952558  1676 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.951874  1673 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.944582  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.954820  1669 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.941807  2598 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.957974  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:51.958693  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.957608  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.959838  1669 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.960038  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.960400  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.962425  2598 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.967126  2583 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.967464  2588 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:51.968072  2584 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.976660  2570 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.976954  2317 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:57:51.977366  2570 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.978068  2588 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:51.970220  2568 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.970721  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.971030  2589 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.971082  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.979421  2568 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.980757  2589 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.972702  2545 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:51.972913  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.974646  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:51.975706  2315 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:51.983529  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:51.987010  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:51.975616  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:51.987591  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.988029  1669 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.982218  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.988361  1672 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:51.983587  1677 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.980839  1600 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:51.987182  1671 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.971674  2580 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:51.971381  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:51.991928  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:51.992489  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 71577.6us
I20260709 12:57:51.992797  2583 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:51.993280  2583 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:51.993667  2583 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:51.982954  2545 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:51.969293  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:51.998389  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:51.999954  1672 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.000379  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.001061  1673 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.002827  1671 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:52.004222  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:52.006345  1677 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:52.007828  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:52.008759  2588 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.015420  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.017247  1748 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.010486  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:52.018510  2317 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.009385  2580 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.011035  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:52.009264  2588 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:52.021490  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.039292  1603 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.021718  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.039742  2588 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.040371  1748 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.022269  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.042057  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.016386  2589 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.036473  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:52.028236  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.022168  2570 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.035154  2545 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.037771  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.037933  2568 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.046972  1751 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.047851  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.048697  1677 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.048815  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.049470  1751 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.052639  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.052942  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:52.052958  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.054039  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.056025  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.056725  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:52.060205  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.060962  1603 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.061846  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.062563  1671 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.049304  2580 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:52.065034  2580 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.068332  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.040334  1669 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:52.070765  1673 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.071564  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:52.073625  2584 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.074229  2584 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:52.073787  2583 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.075368  2584 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.068982  1674 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.077231  2583 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:52.078405  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.079350  1751 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.084105  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.084630  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.085721  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.087108  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.087363  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.087779  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.088088  1751 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.088408  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.088438  1747 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.089162  1748 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.091027  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.091693  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.092926  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.093587  1748 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.095496  2598 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:52.096838  2436 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.097221  2436 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:52.098278  2436 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.099794  2436 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.094897  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.108348  1674 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.110759  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.110910  2583 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.111824  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.112171  2583 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.133279  2583 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.133562  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.156018  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.156876  1748 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.158300  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.159245  1674 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.161470  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:57:52.162173  2316 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.171306  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.175920  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.177281  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.177800  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.178529  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.179931  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.180365  1669 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.180689  1675 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:52.181694  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.182693  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.188913  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.190615  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.190683  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.192142  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.193106  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.193322  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.194212  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.183027  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.195094  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.196055  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.200048  2317 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.200762  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.202291  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.182753  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:52.208787  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.211169  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.211913  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:52.213066  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.213158  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.213838  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.214401  1748 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.216470  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.217175  1597 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:52.218329  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.216800  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.223732  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.224742  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.227263  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.228216  2598 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.228648  2598 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.228713  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.229154  2598 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.229561  2436 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.229707  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.229979  2436 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.230440  2436 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.230795  2595 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.230087  1501 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 2, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.231235  2595 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.231736  2595 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.232852  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.232875  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.234316  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.234997  1751 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.236789  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.240326  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.241493  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.241698  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.241822  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.242381  1746 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.242470  1749 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.243309  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.244114  1752 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.245127  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.243309  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.246956  1748 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.248934  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.248991  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.249765  2596 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.249899  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.250229  2596 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.250214  1752 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:52.250815  2596 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.251147  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.247385  2316 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:52.253899  2569 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.254524  2569 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.255008  2569 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.247357  2595 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.260674  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:52.267717  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.268329  2436 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:52.269282  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.270318  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.275041  1751 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:52.275453  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.275597  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.273072  2586 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.278458  2569 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:52.279191  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.269151  1749 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.287286  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.282465  1746 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:52.284698  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.290725  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.291494  2595 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.291465  1746 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:52.293007  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.295948  2436 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.282722  2586 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.298484  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.299235  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.299208  1597 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:52.301556  2436 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.287014  2577 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.328423  2436 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.329073  2436 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.322860  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.323431  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:52.319595  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:52.294211  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.332273  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.305646  2595 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.301689  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.333711  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.338138  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.342872  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.341318  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.300570  2586 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.344300  1751 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:52.337882  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:52.316390  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.346683  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.345923  2597 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.352010  2597 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.352522  2597 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.334072  2577 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.351842  2584 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.358114  1750 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:52.339102  2595 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.345266  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.359683  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.360390  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.367898  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.359485  2584 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.370149  2584 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.370232  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.372099  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.372723  2585 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.373294  2585 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.373781  2585 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.359591  2577 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.361881  2595 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.389011  1746 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.367022  2583 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.393890  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.394527  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.396126  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.407305  1749 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:52.408701  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.417655  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.422379  2436 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.423509  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.424000  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.422814  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.425486  2436 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.425729  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.412228  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:52.401984  2598 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.428712  2436 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.411108  2569 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.432760  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.430799  2436 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.434924  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.434247  2436 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.435992  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.438074  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.438301  2596 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.440493  2596 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.441876  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:52.442775  2589 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.442922  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:52.443259  2589 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:52.444128  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.446023  2436 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.447057  1748 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:52.429994  2604 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.450125  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.452911  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.453603  1751 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.455128  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.456257  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.458698  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.459597  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.462441  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:52.463083  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.464053  2568 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:52.464823  2598 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.464845  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.465812  2583 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:52.453140  2604 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.466960  2604 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.467203  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.448871  2570 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.464164  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:52.469323  2570 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:52.469818  2570 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.470103  2568 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.469630  2436 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.470484  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:52.447209  2589 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.472335  2565 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.472491  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.472548  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.468267  2595 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.475172  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.476982  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.476284  2565 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:52.478039  2565 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.450651  2596 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.481122  2436 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.481580  2436 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.481937  2436 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.483372  1743 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.481942  2605 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.483966  2605 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.484336  2605 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.473279  2598 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.471282  2568 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:52.486904  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:52.488986  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.470602  2606 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.490187  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.490912  2559 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.489729  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.492821  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.482937  2596 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.491971  2606 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.497005  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:52.489957  2568 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.494077  2559 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:52.497534  2583 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.505601  2559 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.505658  2583 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.506168  2583 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.498417  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.507107  2577 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.503986  2606 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.504595  2569 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:52.488631  2598 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.509722  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.509931  1747 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.508474  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.510071  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.511684  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.521314  2436 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.522682  2569 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.510414  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.523156  2569 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.523631  2569 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.523721  2436 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.522426  2606 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.526870  2606 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.526496  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:52.530392  2595 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.530678  1671 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:52.534325  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.536022  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.499677  2596 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.538870  2584 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.532727  2577 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.528414  2598 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.548002  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.554215  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.555872  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.538902  2595 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:52.557216  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.561066  1748 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:52.561765  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67478.5us
I20260709 12:57:52.547379  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.563066  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.566118  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.562186  2580 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:57:52.570636  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.571943  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.575296  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.567256  1673 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:52.596524  1747 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.618173  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.561371  2595 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:52.563422  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:52.648527  2279 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.642s (SENT) [suppressed 1 similar messages]
I20260709 12:57:52.626009  2595 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.708022  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:57:52.723500  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:52.736054  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:52.739161  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 173946us
I20260709 12:57:52.741669  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.746724  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.748996  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.749805  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.750571  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.752146  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.752802  2585 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.753978  1750 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.755126  2585 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.757025  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.757586  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.758347  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.734776  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.759819  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:52.746608  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 98157.9us
I20260709 12:57:52.759424  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.761380  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.734189  2583 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.748620  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:52.758823  1750 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.741196  2584 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.785801  2577 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.825485  2597 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.827019  1749 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.829210  2604 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.839097  2586 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.840889  1752 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.848568  2569 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.779472  2565 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.878026  2565 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.891002  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.857209  2605 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.892093  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.780424  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.904722  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.907939  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.908325  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.893939  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.910401  1603 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:52.912587  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.899919  2577 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:52.906749  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.908002  1675 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:52.914490  2577 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:52.916690  2584 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:52.918133  1752 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.785027  2580 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:57:52.922354  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.924602  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.925683  2583 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.925973  2604 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.926913  2570 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.927940  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.928718  1748 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.903343  2569 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.929016  2568 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.931685  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.932956  2568 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.940554  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.941998  2559 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.943140  2317 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.943825  1678 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.948303  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.949175  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:52.940562  1669 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.950567  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:52.951906  2590 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:52.952890  2584 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:52.954638  2589 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.955850  1675 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.956918  2589 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.969245  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.972074  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:52.972898  2597 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.973731  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.974032  2604 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.974400  1675 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.975142  2569 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.975651  1752 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:52.975579  2583 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:52.976233  2569 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.975662  1745 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:52.976677  2569 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:52.976765  2583 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.977308  2583 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:52.977607  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.977775  2436 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.972172  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:52.978169  2436 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:52.973647  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:52.980551  1678 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:52.980861  2605 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:52.980443  2436 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.984272  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:52.986337  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.986877  2590 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:52.987908  2590 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:52.990561  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.991715  2597 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.992765  2597 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.996520  2436 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.997254  2583 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:52.996317  2604 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.999148  2583 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.000794  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:53.009728  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:53.010905  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:53.014001  2586 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:53.011386  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.001531  2569 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.016683  2569 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.016813  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.017482  2598 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.018395  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:53.001765  2604 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:53.008189  2597 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.008074  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:52.971354  2596 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.009027  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:53.020506  2604 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.024391  2604 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.024282  2559 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:52.969245  2570 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.001304  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.010080  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:53.033437  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.035516  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.035661  1501 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 2, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:53.036809  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.028282  2595 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.037336  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.039723  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.040997  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.040616  2589 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.042760  2565 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.037343  2570 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.042862  2610 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.043509  2570 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.043726  2610 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.043923  2596 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:53.044023  2570 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.044239  2610 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.042760  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.042263  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.046870  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.049731  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.048861  1501 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:53.056695  1747 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:53.040975  2559 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.057977  2559 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.058451  2559 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.055924  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.021704  2597 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:53.061856  2613 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.062327  2613 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.062837  2613 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.062628  2597 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.043345  2565 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.065100  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:53.061537  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.043255  2598 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:53.065532  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:53.042760  2589 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.053893  2568 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.068995  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.070475  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.055466  2607 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.072081  2589 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.055259  2609 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.076669  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:57:53.067884  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.064709  2597 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.080344  2612 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.089382  2612 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.089886  2612 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.082602  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.067663  2565 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.087630  2545 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.075927  2568 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.075114  2607 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.096858  2607 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.093552  2545 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.081653  2609 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.102500  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.089375  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.074008  2611 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.097743  2568 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.102314  2545 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.126583  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.105300  2609 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.129225  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.136884  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.124082  2611 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.147307  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.125522  2625 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.151472  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.142030  2611 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.155772  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.158957  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.160976  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.163374  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:53.154892  2595 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:53.170127  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.176565  2570 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.181216  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.182420  2570 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.158830  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.187408  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.199462  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.201561  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.194985  2570 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.207439  2570 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.207959  2570 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:53.215142  2623 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:57:53.219126  1497 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.221783  2559 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.229753  2559 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.224824  2589 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.232187  2589 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:53.233824  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:53.234350  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82969.9us
I20260709 12:57:53.235183  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.236447  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.237622  2627 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.237669  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.238075  2627 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.238621  2627 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.240928  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.242101  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.243906  2612 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.247884  2612 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.194696  2626 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.251310  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:53.262205  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:53.262951  1750 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:53.239971  2589 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.267668  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:53.272923  2613 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.270016  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.245126  2628 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.277115  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.282634  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.283093  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.256230  2610 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.260010  2626 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.283684  2604 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.287282  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.284410  2613 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.280072  2595 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.292881  2597 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.292739  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.293895  2568 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.306213  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.306665  2568 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.284332  2628 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.307838  2628 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.307999  2580 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.283723  2612 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:57:53.285073  2625 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.296675  2609 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.296815  2545 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.276942  2589 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.316198  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.297755  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.256210  2565 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.299494  2607 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.329043  2565 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.302925  2613 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.329957  2607 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.330665  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.331418  1748 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.332345  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.333200  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:53.326776  2589 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.299702  2626 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.317557  1746 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.318778  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.337904  1748 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.320103  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.307858  2584 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.321028  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.322485  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.322726  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:53.322852  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.323503  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:53.323503  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.324146  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.324635  2597 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.324875  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.325843  2610 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.327879  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.327940  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.340111  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.337327  2545 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.339603  2584 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:53.343359  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:57:53.347478  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.350823  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:53.307293  2568 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:57:53.358307  2584 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.353773  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.307418  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.339725  2595 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.336128  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.371286  2559 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:53.371490  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51476.5us
I20260709 12:57:53.372174  1744 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.372886  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.373863  2610 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:53.374413  2559 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.364147  2565 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.370325  1745 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:53.374599  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.377777  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.376314  2584 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:53.384397  2580 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.384879  2611 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:53.378306  2565 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:53.386196  2589 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.392180  2584 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.389634  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.389052  2610 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.387568  2613 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.392287  2565 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:53.393188  2607 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.394042  2565 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.395053  2589 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.357036  2604 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.392104  2611 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.397619  2625 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:53.401602  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94236.3us
I20260709 12:57:53.401918  1751 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:53.402549  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.403110  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.403784  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.403825  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.404734  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.405571  2595 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.406991  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.403215  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.407582  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.407824  2597 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.410120  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.411432  2580 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.411459  2597 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.408941  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.412117  2580 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:53.412572  2580 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.414815  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.415726  2597 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.417692  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.418491  2597 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.420679  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.420323  2570 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.421525  2597 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.422745  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.423408  2570 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.423482  2597 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.425092  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.425289  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.425921  2597 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:53.427016  1641 consensus_peers.cc:597] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22373089b38b498393c2161e53b5f016. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:53.427845  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.427763  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.430444  2597 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.431879  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.432652  1751 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.434198  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.436954  1752 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:53.424455  2626 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.444170  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.444696  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.445148  1746 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.445465  1752 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.438410  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.446913  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.435353  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.448443  1744 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.449345  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.439929  2588 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.453199  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:53.454123  2570 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.454857  2570 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:53.455845  2570 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.458992  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.461163  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.463344  2626 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.463526  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.465109  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.462810  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.466002  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.466331  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.467391  2595 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.468457  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.468160  2580 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:53.466562  2604 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.470314  2597 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.470625  2580 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.425166  2609 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.458576  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:53.469174  2628 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.473225  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.474105  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:53.475386  2626 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.475620  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.475828  2611 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.475934  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.476536  2611 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:53.476495  2626 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:53.475821  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.477840  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.477659  2611 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.478502  2628 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.481021  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:53.480790  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.440326  1743 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:53.484411  2597 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.483572  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.486891  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.488034  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.477643  2626 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.488186  2597 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.490869  2595 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.489464  2604 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.482543  2609 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.501899  2627 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.503446  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.504944  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.506131  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.507426  2595 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.508255  2604 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.509361  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:53.509909  2588 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.510593  2613 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.511250  2613 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:53.512885  2604 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.503400  2609 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:53.514055  2613 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.515566  2609 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.521724  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.526167  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.527426  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.528546  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.529500  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.532200  2627 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.532598  2595 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.533390  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.532228  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:57:53.537479  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 170643us
I20260709 12:57:53.533516  2583 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.535665  2604 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.533640  2569 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.535282  2597 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.535450  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.537952  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:57:53.583314  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47952.5us
I20260709 12:57:53.585083  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.593775  2604 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.595506  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.596580  2604 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.597690  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.598301  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.599273  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.585333  2583 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.601682  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.603430  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.605119  2595 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.603860  2597 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.606189  2568 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.606747  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.598505  2604 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.608734  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.606992  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.604337  2569 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.621577  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.608500  2570 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.586561  2610 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:53.632395  2569 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.634200  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.634569  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.634244  2568 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.639019  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.639355  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.640781  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.641055  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.641796  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.642647  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.639235  2589 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.639460  2569 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.643728  2604 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.644933  2583 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.645290  2569 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.646797  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:53.649053  2597 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.654261  1670 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:53.658056  2568 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.658835  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.669317  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:57:53.668450  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 90459.6us
I20260709 12:57:53.672339  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.673291  2607 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.674513  2609 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.674849  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.671267  2589 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.675752  2609 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.676136  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.656491  2570 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.657145  2611 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.677506  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.681023  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.679257  2595 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:57:53.687700  2611 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.679608  2609 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.687847  2568 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.695137  2631 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:53.700095  2638 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.700753  2638 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:53.702092  2638 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:53.719504  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:53.720302  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:53.722023  1747 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:53.725924  2317 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:53.727166  2316 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:53.728017  2609 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.729120  2609 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.731289  2609 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.730178  2638 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.736934  2610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 4) took 1869 ms. Trace:
I20260709 12:57:53.731379  2595 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:57:53.738677  2569 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:57:53.754416  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.755303  2609 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.762899  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.763643  2595 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.763878  2609 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:53.764160  2595 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:53.765286  2595 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:53.766692  2595 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.771400  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:53.782382  1595 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:57:53.787194  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:53.750283  2610 rpcz_store.cc:276] 0709 12:57:51.873797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.889234 (+ 15437us) service_pool.cc:224] Handling call
0709 12:57:51.962775 (+ 73541us) log.cc:844] Serialized 506 byte log entry
0709 12:57:52.028857 (+ 66082us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4c0006e940. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f76b13f 00007f947f72f2ab 00007f947f75cf3c 00007f947f75d3fe 00007f947f9ea50b 00007f94813e9381 00007f94813e726b 00007f94813edd53 00007f94813edcd9
0709 12:57:53.728208 (+1699351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7521,"raft.queue_time_us":1896,"raft.run_cpu_time_us":3433,"raft.run_wall_time_us":21124,"spinlock_wait_cycles":10843776,"thread_start_us":43013,"threads_started":1,"wal-append.queue_time_us":84261,"wal-append.run_cpu_time_us":2788,"wal-append.run_wall_time_us":1026473}
I20260709 12:57:53.859663  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:57:53.862934  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 75226.8us
I20260709 12:57:53.866945  1501 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.877362  1751 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:53.867606  2607 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:53.872190  2642 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 12:57:53.886937  1501 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.875306  1743 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.890513  1501 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.892966  2545 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.894135  2607 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:53.896123  2545 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.896489  2607 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.898986  2545 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.905820  2646 ts_tablet_manager.cc:933] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:53.910552  2643 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:53.911900  2643 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.912346  2643 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:53.913321  2643 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:53.899427  2607 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:53.937420  2646 tablet_copy_client.cc:323] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:57:53.942579  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 22373089b38b498393c2161e53b5f016 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:57:53.943352  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 22373089b38b498393c2161e53b5f016 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-22373089b38b498393c2161e53b5f016
I20260709 12:57:53.947093  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:53.947151  2589 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:53.948397  2643 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.949810  2589 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.973038  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:53.974067  1749 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.975070  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:53.975919  1752 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:53.984195  2589 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:54.049229  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 91735.6us
I20260709 12:57:54.118559  1501 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:54.122138  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.122337  2316 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:54.120895  1501 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.134362  2597 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.135696  2597 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.136072  2597 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:54.137225  2597 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:54.138710  2597 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.154765  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:54.155570  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:54.159005  1596 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.162544  1601 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.165522  2649 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.166515  2647 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.167145  2649 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:54.168347  2649 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.168742  2649 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.169543  2648 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.169629  2649 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.171073  2649 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.168010  2647 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.172448  2647 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.172816  2647 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.173763  2647 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.175102  2647 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.168286  2631 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.176146  2631 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.177135  2631 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.178465  2631 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:54.181532  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.165195  2653 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:57:54.183405  2641 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.183873  2641 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.170125  2648 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.184885  2641 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.185405  2648 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.186136  2641 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.187633  1594 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.191941  2648 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.204015  1749 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.205473  1688 tablet_copy_source_session.cc:215] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:54.162137  1595 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:54.208837  1751 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.232605  1500 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 12:57:54.234483  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.215148  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47893.2us
I20260709 12:57:54.235908  2653 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.237433  2653 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.237639  1744 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.237864  2653 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.239084  2653 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.240362  2653 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.215298  2643 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:54.235071  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.250739  1751 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:54.251788  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.263173  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.267505  1600 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:54.270856  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 88018.4us
I20260709 12:57:54.270751  1596 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.279950  2638 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.284098  1603 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.283100  2646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22373089b38b498393c2161e53b5f016. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:54.349246  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.303622  2647 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.275074  2649 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
W20260709 12:57:54.405821  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.392745  2647 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:57:54.538506  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 243448us
I20260709 12:57:54.545497  1603 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.556939  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:54.500102  2609 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:57:54.509428  2658 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 12:57:54.568636  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.642s (SENT)
I20260709 12:57:54.584738  1601 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.569391  2659 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.590575  2649 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:57:54.640985  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.655488  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.657222  1594 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:54.600620  2659 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.660912  2659 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.662470  2659 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.665385  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:54.682049  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 286446us
I20260709 12:57:54.681958  2658 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:54.694846  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 136564us
I20260709 12:57:54.692191  2658 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.707103  2665 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:57:54.712092  2662 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.714116  2662 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:54.716096  2658 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.718657  2658 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:54.739110  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49545.6us
I20260709 12:57:54.744766  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.747002  2662 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.748060  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:57:54.751978  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.753374  2671 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.765801  2653 consensus_queue.cc:1059] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.616891  2647 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:54.784667  2647 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.795166  2672 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:54.798030  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.813748  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47521.6us
I20260709 12:57:54.816758  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.818203  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.818888  2653 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.819943  2667 raft_consensus.cc:3055] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.820163  2671 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.820459  2667 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.821568  2667 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:54.822382  2662 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.823094  2667 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:54.823735  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 69165us
I20260709 12:57:54.826519  2675 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.832489  2672 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.834146  2672 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:54.835351  2670 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:54.860201  2659 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:54.862578  2659 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.864555  2664 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.865684  2664 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.874046  2664 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:54.875797  2664 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.886243  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.889038  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.890198  2667 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.899246  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.904709  2658 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.906549  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:57:54.913679  2648 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.721s	user 0.016s	sys 0.000s
I20260709 12:57:54.916728  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.923265  2664 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.925443  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.933270  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.936342  2666 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.937347  2666 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.939399  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.948854  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.953645  2666 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.955206  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.963452  2649 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.963994  2649 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:54.964267  2666 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.965710  2649 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:54.967232  2649 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.970376  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.982813  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.987655  2648 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.989375  2643 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:54.988785  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.994163  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:54.997805  2666 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.003490  2647 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.001718  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.020386  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.022205  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.029243  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.035773  2668 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.039076  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:55.042009  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.044232  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.010684  2647 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.025460  2643 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.049463  2664 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.058750  2668 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.073287  2660 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:55.079425  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.071874  2647 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:55.092876  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.107781  2663 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:55.125568  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:55.155795  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 215278us
W20260709 12:57:55.165733  2279 leader_election.cc:336] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.605s (SENT)
I20260709 12:57:55.146857  2641 raft_consensus.cc:2764] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:57:55.165566  2662 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.152650  2667 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.206221  2686 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.207157  2686 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:55.210909  2686 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:55.177475  2658 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.212178  2612 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.180562  2662 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.217700  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 506) took 1093 ms. Trace:
I20260709 12:57:55.229984  2686 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.227907  2607 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:55.294219  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.310382  2696 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.310434  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:55.311730  2314 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:57:55.311151  2696 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:55.286571  2670 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.276788  2612 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.313393  2672 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.331041  2672 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.300150  2607 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.335999  2692 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.336632  2607 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.338645  2612 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.298307  2686 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.341081  2686 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.341636  2686 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.342115  2686 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:55.344466  2662 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.336670  2692 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.348501  2696 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:55.348750  2692 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.349704  2611 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.350291  2672 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.324244  2670 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.355299  2686 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.287974  1669 rpcz_store.cc:276] 0709 12:57:54.121764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.954345 (+832581us) service_pool.cc:224] Handling call
0709 12:57:54.954762 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:54.955052 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:54.955458 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 12:57:55.164842 (+209384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:55.171848 (+  7006us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:55.177824 (+  5976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.203774 (+ 25950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.215009 (+ 11235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":326,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":4547,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":1957,"thread_start_us":192473,"threads_started":1,"wal-append.queue_time_us":365585}
I20260709 12:57:55.362478  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.363396  1670 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:55.363642  2670 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.367591  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:55.372444  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.373353  1670 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.376654  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.377851  1670 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.368690  2314 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.406582  2631 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:55.390041  2694 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.382552  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:55.417377  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:55.411883  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 232952us
I20260709 12:57:55.407647  2640 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.422482  2696 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:55.422195  2640 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.422981  2696 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.423444  2696 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:55.394740  2583 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:55.407202  2631 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:55.425520  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:55.354758  2611 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.430330  2699 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.410401  2686 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.424305  2692 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.434437  2701 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:55.390367  2695 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.424970  2694 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.443123  2700 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:55.462209  2700 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.462882  2700 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:55.465340  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 421148us
I20260709 12:57:55.467196  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:55.433880  2583 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.471122  1603 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:55.473619  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:55.474196  1594 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:55.474344  1601 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:55.445398  2597 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.472718  2663 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:55.477955  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:55.478641  1603 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:55.482782  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:55.504026  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:55.443984  2686 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.445116  2692 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.446882  2699 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.503834  2597 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.515187  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:55.517063  1602 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:55.516018  2664 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.455467  2701 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:55.518405  2664 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.519986  2611 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.506994  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:55.520818  1603 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:55.516548  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:55.484217  2640 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.525949  2699 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.474289  2694 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.538901  2583 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.527248  2646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 94) took 1756 ms. Trace:
I20260709 12:57:55.475364  2631 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.543108  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:55.539417  1599 raft_consensus.cc:2376] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2. Re-sending same reply.
I20260709 12:57:55.572695  2316 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.539713  2640 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.541004  2664 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.528013  2701 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.549337  2699 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:55.564260  2705 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.553555  2583 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.592868  2597 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.593220  2583 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:55.581817  2631 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:55.573880  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:55.549882  2646 rpcz_store.cc:276] 0709 12:57:53.770790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.770972 (+   182us) service_pool.cc:224] Handling call
0709 12:57:53.915965 (+144993us) ts_tablet_manager.cc:934] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 12:57:54.281386 (+365421us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:55.184474 (+903088us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:55.214645 (+ 30171us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:55.526133 (+311488us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:55.526566 (+   433us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:55.527031 (+   465us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:55.527136 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":307,"tablet-copy.queue_time_us":103076,"thread_start_us":98870,"threads_started":2}
I20260709 12:57:55.577690  2672 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.603034  2672 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.585733  2699 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.584790  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.586381  2705 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:55.589406  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.589664  2662 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.591807  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:55.474838  2695 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.592569  1594 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.581352  2640 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.593570  2692 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:55.585319  2704 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:57:55.599555  1602 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:55.603827  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.604736  1750 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:55.626184  1603 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.595927  2671 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.626111  1748 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:55.605917  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.607002  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.629302  1751 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:55.629639  1752 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:55.608140  2672 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.596304  2607 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.609529  2699 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.604799  1749 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:55.637524  1752 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.627866  2646 tablet_copy_client.cc:806] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:55.658145  1670 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.657413  1677 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.659509  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.660434  1670 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:55.627245  1595 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
W20260709 12:57:55.657773  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 232368us
I20260709 12:57:55.668247  1674 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.639287  2672 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.616312  2662 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:55.673565  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.642062  2625 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.659045  2610 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.674358  1752 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.642589  2705 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.634277  2671 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.681782  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.682117  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.662771  2675 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.641608  2607 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.686327  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.683305  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.685654  1670 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.687351  1677 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.687582  1676 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.670091  2686 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.688442  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.688987  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:55.682294  1773 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6640 after lost signal to thread 434
I20260709 12:57:55.687613  1674 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.690675  1670 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:55.686928  2706 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:55.677505  2672 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.697154  1752 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.684401  2646 tablet_copy_client.cc:670] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:55.686645  2597 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.693544  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:55.696532  1773 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7b20 after lost signal to thread 1535
I20260709 12:57:55.686580  2692 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.695627  2662 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.696719  2672 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.692199  1671 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.683060  2625 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:55.710068  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.709867  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.695783  2695 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.682727  2696 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.714843  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:55.718775  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.704506  1673 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.696321  2640 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.689616  2675 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.723667  2708 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:55.723766  2695 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.693287  2709 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.695178  2706 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:55.738945  1748 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.739729  1747 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.689129  2610 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.741083  1751 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.732468  1750 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.719348  2662 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:55.747169  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63256.4us
I20260709 12:57:55.743909  2708 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.749042  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.749601  2708 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.751658  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:55.707389  2597 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.710760  2692 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.742017  2640 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:55.761850  1678 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.763916  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.741678  2583 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:55.767115  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:55.754454  1773 debug-util.cc:398] Leaking SignalData structure 0x7b0800363340 after lost signal to thread 1627
I20260709 12:57:55.749044  1744 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.764739  1747 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:57:55.768216  1750 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:55.736969  2701 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:57:55.771987  1745 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:55.765172  2640 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.741454  2695 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.753818  2662 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.744405  2709 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.780148  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.772038  2686 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.864706  1751 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:55.849148  2675 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.827461  2625 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.802461  2700 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.804363  2696 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.868824  2696 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:55.815675  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:55.869602  2700 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.801400  2706 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:55.870440  2700 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.870811  2706 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.871130  2700 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.871510  2706 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.870327  1670 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:55.873821  2700 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.756079  2702 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:55.876343  2702 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:55.862591  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 111066us
I20260709 12:57:55.880558  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:55.771899  2583 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.840799  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.883209  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:55.897929  1751 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
W20260709 12:57:55.945582  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 104890us
I20260709 12:57:55.947144  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:57:55.791870  2656 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.665s	user 0.009s	sys 0.000s
I20260709 12:57:55.804168  2646 tablet_copy_client.cc:538] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:55.956539  1749 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:55.957620  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:55.958695  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:55.924206  2702 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.864733  2640 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.797200  2607 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:55.959811  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 79382us
I20260709 12:57:55.809309  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:55.848145  2671 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.825030  2714 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.810761  2610 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:55.869626  2696 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.805272  2597 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.874563  2706 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:55.993572  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:55.955633  2653 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.804777  1743 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:55.952657  2705 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:56.012751  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 57799.2us
I20260709 12:57:55.986316  2710 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:57:55.993468  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080035ba40 after lost signal to thread 1702
W20260709 12:57:56.016698  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.944878  2686 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.965807  2584 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:55.989387  2667 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.952610  2583 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:55.956283  2661 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:57:55.949834  2631 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:57:56.001780  2700 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.014063  2687 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.001590  2696 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.815007  2699 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:55.955297  2664 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:57:56.010816  2597 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:56.036501  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080035ba80 after lost signal to thread 1703
I20260709 12:57:56.000068  1601 raft_consensus.cc:2376] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2. Re-sending same reply.
I20260709 12:57:56.015112  2692 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.034183  2715 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:56.036998  2663 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.007580  2714 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.018193  2658 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:56.017598  2653 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.073990  2719 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.074543  2719 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.075273  2653 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.045423  2700 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.047675  2687 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.049126  2705 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:56.067373  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.043916  2694 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:56.041661  2667 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.077257  2653 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:57:56.068358  2722 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:56.082722  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:56.082172  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76075.6us
I20260709 12:57:56.069456  2692 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.088304  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.095635  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.095832  2731 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:57:56.096087  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.096407  1672 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.097007  1673 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.072840  2631 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:56.081656  2700 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.101054  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:56.102155  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:56.062377  2597 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.101310  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.083005  2687 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.082093  2705 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.112989  2705 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:56.102833  2631 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:56.109324  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.116540  1678 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.116855  2631 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.118487  2631 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:56.099330  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080035fbc0 after lost signal to thread 1776
W20260709 12:57:56.126313  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080035fbe0 after lost signal to thread 1777
W20260709 12:57:56.128018  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080034ed60 after lost signal to thread 2341
W20260709 12:57:56.128953  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080013a260 after lost signal to thread 2633
W20260709 12:57:56.129319  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080028cc80 after lost signal to thread 2635
I20260709 12:57:56.133214  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.134380  1678 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.133389  2687 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.141196  2687 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.147797  2687 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:56.225996  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.160039  2667 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.161536  2701 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:56.162413  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:56.229962  2714 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.152091  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:56.104622  2692 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.163475  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:56.186780  2695 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.187983  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.152637  2709 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.166880  2583 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.190256  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.076804  2663 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.069535  2715 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.254252  1675 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:56.232527  2686 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.196719  2721 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:56.198851  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 240160us
I20260709 12:57:56.153079  2662 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.192896  2707 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.234434  2667 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:56.213867  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 462154us
I20260709 12:57:56.152995  2708 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.148705  2705 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.212201  2699 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.214047  2719 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:56.249773  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 188) took 2374 ms. Trace:
I20260709 12:57:56.247511  1597 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.231242  2316 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.253193  2597 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.231573  1671 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.259622  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:56.209834  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.231357  2714 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.284775  2714 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.233410  2692 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.286979  2714 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.256073  2640 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.266340  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.290239  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.230140  2723 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:57:56.291460  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.267792  2667 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.230783  2687 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.315821  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.260279  1599 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.248852  2701 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.330245  1746 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:56.273736  2707 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.331936  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.314771  2662 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.314888  2565 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.332731  2612 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.326121  2667 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.335198  2707 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.278468  1500 rpcz_store.cc:276] 0709 12:57:53.861224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.861490 (+   266us) service_pool.cc:224] Handling call
0709 12:57:56.235902 (+2374412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:54.736842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:54.737611 (+   769us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:54.737651 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:57:54.737676 (+    25us) tablet.cc:662] Decoding operations
0709 12:57:54.738097 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:54.738156 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:54.738190 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:54.738414 (+   224us) tablet.cc:701] Row locks acquired
0709 12:57:54.738427 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:57:54.738623 (+   196us) write_op.cc:270] Start()
0709 12:57:54.738798 (+   175us) write_op.cc:276] Timestamp: P: 1783601874738546 usec, L: 0
0709 12:57:54.738818 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:57:54.744995 (+  6177us) log.cc:844] Serialized 598 byte log entry
0709 12:57:54.875291 (+130296us) op_driver.cc:464] REPLICATION: finished
0709 12:57:55.070784 (+195493us) write_op.cc:301] APPLY: starting
0709 12:57:55.074314 (+  3530us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:55.075609 (+  1295us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:55.075753 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:55.075999 (+   246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:55.076163 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:55.076206 (+    43us) write_op.cc:312] APPLY: finished
0709 12:57:55.076457 (+   251us) log.cc:844] Serialized 22 byte log entry
0709 12:57:55.076626 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:55.076713 (+    87us) write_op.cc:454] Released schema lock
0709 12:57:55.076756 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":300716,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":191636,"apply.run_cpu_time_us":1893,"apply.run_wall_time_us":6333,"num_ops":1,"prepare.queue_time_us":458180,"prepare.run_cpu_time_us":3260,"prepare.run_wall_time_us":21364,"replication_time_us":136328,"thread_start_us":287638,"threads_started":1}]]}
I20260709 12:57:56.342098  2670 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.347335  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.334334  2665 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.274556  2721 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.340240  2662 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.341863  2565 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.342738  2612 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.347258  2708 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:56.349843  2670 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.360868  2699 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.381640  2699 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.358793  2565 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.361382  2612 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.354358  2545 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.349905  2665 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.357256  2662 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:56.391124  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.391710  2545 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.393599  2701 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.396035  1671 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:56.397115  2661 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.403271  2705 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.359688  2733 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:56.407723  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 176) took 2569 ms. Trace:
I20260709 12:57:56.386404  2670 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.407009  2665 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.387802  2663 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.411652  2545 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.458102  2584 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:56.426972  2661 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.430096  2640 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.428457  1501 rpcz_store.cc:276] 0709 12:57:53.838091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.843661 (+  5570us) service_pool.cc:224] Handling call
0709 12:57:56.407635 (+2563974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:54.276514 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:54.277433 (+   919us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:54.277482 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:57:54.277511 (+    29us) tablet.cc:662] Decoding operations
0709 12:57:54.278518 (+  1007us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:54.278630 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:54.278667 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:57:54.279312 (+   645us) tablet.cc:701] Row locks acquired
0709 12:57:54.279334 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:57:54.290749 (+ 11415us) write_op.cc:270] Start()
0709 12:57:54.375786 (+ 85037us) write_op.cc:276] Timestamp: P: 1783601874279497 usec, L: 0
0709 12:57:54.375821 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:57:54.555093 (+179272us) log.cc:844] Serialized 2093 byte log entry
0709 12:57:54.779129 (+224036us) op_driver.cc:464] REPLICATION: finished
0709 12:57:55.004316 (+225187us) write_op.cc:301] APPLY: starting
0709 12:57:55.004421 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:55.004625 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:55.004792 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:55.010739 (+  5947us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:55.040027 (+ 29288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:57:55.040107 (+    80us) write_op.cc:312] APPLY: finished
0709 12:57:55.040503 (+   396us) log.cc:844] Serialized 46 byte log entry
0709 12:57:55.040722 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:55.040834 (+   112us) write_op.cc:454] Released schema lock
0709 12:57:55.040882 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:55.050926 (+ 10044us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:55.057943 (+  7017us) write_op.cc:454] Released schema lock
0709 12:57:55.169826 (+111883us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:55.172172 (+  2346us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":264646,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":224886,"apply.run_cpu_time_us":3355,"apply.run_wall_time_us":36977,"num_ops":5,"prepare.queue_time_us":132587,"prepare.run_cpu_time_us":25275,"prepare.run_wall_time_us":418976,"raft.queue_time_us":177375,"raft.run_cpu_time_us":38180,"raft.run_wall_time_us":402100,"replication_time_us":402778,"thread_start_us":377755,"threads_started":4,"wal-append.queue_time_us":156334,"wal-append.run_cpu_time_us":12692,"wal-append.run_wall_time_us":1395628}]]}
I20260709 12:57:56.461467  2661 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.459234  2708 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.479486  2713 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.480041  2713 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.475945  2658 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.466549  2710 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 12:57:56.504325  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 215150us
I20260709 12:57:56.507530  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.513446  1598 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.488517  2699 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.504315  2589 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.533586  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.521648  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.527024  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.544584  1749 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.545835  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.530700  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.547008  1603 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.548100  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.532418  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.534526  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.549728  1751 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.534848  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.550743  1748 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.550979  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.551921  1751 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.493801  2706 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.537700  1746 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.529561  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.507040  2732 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.549902  1750 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.511309  2658 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.478273  2708 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.508359  2687 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.558626  1600 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.562160  1749 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:56.548938  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
W20260709 12:57:56.563730  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 462689us
W20260709 12:57:56.569128  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 486443us
I20260709 12:57:56.535303  2628 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.527077  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.523810  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.590519  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.591737  1676 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.592649  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.580984  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.582077  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:56.586905  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.586896  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:56.587859  1566 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 516703d5c9f14537854665616191b5aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:56.509372  2696 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.593716  2687 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.564044  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:56.573594  2658 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.595876  1670 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.596531  1597 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:56.568228  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.601611  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.572279  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.609073  1672 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.569092  1743 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.611303  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.634055  1676 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.555696  2589 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.596035  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.568526  2706 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.593448  2628 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.635298  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.636554  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.613412  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.598459  2687 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:56.696365  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52242.7us
I20260709 12:57:56.697782  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:56.697553  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.606338  2731 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.711635  1677 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.713593  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.698864  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.602775  1595 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.720741  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:56.723384  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 88190.6us
I20260709 12:57:56.613108  2728 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.609364  2721 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.725139  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:56.645749  2640 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.725945  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.736702  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.576084  2584 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.729127  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.613492  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.723948  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:56.726127  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:56.728289  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:56.732553  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.697513  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.644963  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.719856  2687 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.572394  2732 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.745587  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.747135  1670 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.748001  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:57:56.781641  1677 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:56.772095  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.709437  2745 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.731422  2715 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.728122  2713 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.734760  2702 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.732156  2671 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.783319  2744 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:57:56.780093  2607 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.734870  2699 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:56.795933  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69872.1us
I20260709 12:57:56.774057  1676 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.738001  2640 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:56.814615  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82130us
W20260709 12:57:56.798439  2664 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.018s	sys 0.042s
I20260709 12:57:56.731691  2739 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.737231  2565 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.853415  2702 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.728689  2731 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.613845  2710 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:56.868716  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.889387  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.890597  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.785971  1599 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:56.785626  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:56.861662  1673 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:56.855417  2714 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.861613  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:56.857941  2671 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:56.901911  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 114196us
I20260709 12:57:56.877501  2739 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.814168  2611 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.860085  2607 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.904633  2607 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.884785  2738 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:56.905221  2738 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:56.905131  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.906023  1743 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:56.884336  2712 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.893187  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:56.873739  2664 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.019s	sys 0.043s
I20260709 12:57:56.872942  2640 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.871559  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:56.899672  1678 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:56.855412  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.813251  2747 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:57:56.885646  2702 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.887923  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:56.916188  2746 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:56.920758  1594 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.921281  2736 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.908200  2739 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.908420  2671 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.904672  2741 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:56.895881  2708 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.906773  2611 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.898556  2714 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.916288  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:56.927695  2712 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.930958  1676 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:57:56.932382  2667 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
I20260709 12:57:56.858563  2743 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:57:56.750612  2728 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:56.933761  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.039630  2663 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.040079  2663 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.040647  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.040980  2663 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.041976  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.042238  2663 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:56.947647  2646 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:57:57.005599  2611 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.949309  2732 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.951459  2565 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.900731  2715 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.039630  2728 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.902006  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.900504  2699 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:56.968106  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.064908  1752 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:56.909644  2610 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:56.970932  1602 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.910181  2696 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:56.959761  2700 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.003s
W20260709 12:57:56.990772  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.047297  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:56.933776  2706 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:56.855368  2745 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:56.981379  2612 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.006s
I20260709 12:57:56.974815  1595 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
W20260709 12:57:57.005390  2670 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.001s
I20260709 12:57:56.989873  2589 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.032823  2667 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.037634  2716 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.007197  2714 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.004377  2628 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:56.964644  2665 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.098264  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.099841  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.099924  2665 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.032048  2712 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.964144  1672 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:57:57.043883  2661 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.562s	user 0.014s	sys 0.000s
I20260709 12:57:57.107410  2694 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:57.107782  2755 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:57:57.107642  2661 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:57.109965  2661 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:57.045006  2707 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.701s	user 0.015s	sys 0.000s
W20260709 12:57:57.072824  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.110857  2707 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.111420  2747 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.054890  2715 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:57.079350  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 169056us
W20260709 12:57:57.080209  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 187066us
I20260709 12:57:57.029704  2741 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.071156  2610 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.123970  2610 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.085376  2670 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.074275  2699 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:57.071022  1601 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.128944  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.103925  1595 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.107964  2694 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:56.957969  2737 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.112588  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.008620  2736 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.115289  2715 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.077149  2700 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.130357  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:57.104331  2545 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.001s
W20260709 12:57:57.114368  2662 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.006s
I20260709 12:57:57.102012  2716 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.135493  1602 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:57.101536  2742 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:57:57.083359  2612 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.139596  2707 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.142462  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.131510  2756 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.140592  2760 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:57.145054  2545 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.143035  2757 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.141177  2754 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:57:57.148280  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.134555  2737 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.153594  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.177868  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.112080  2747 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:57.207223  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53748us
I20260709 12:57:57.155866  2745 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.148411  2716 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.148043  2696 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.209461  1602 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
W20260709 12:57:57.210479  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62279.9us
I20260709 12:57:57.251704  2696 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.252413  2696 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.148208  2744 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:57:57.206390  2707 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.212692  2737 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.258193  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.286485  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.287739  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.288326  1602 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.218906  2741 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.219599  2653 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.277140  2706 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:57.213536  2733 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.749s	user 0.021s	sys 0.009s
I20260709 12:57:57.207086  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:57.282086  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 64079.9us
W20260709 12:57:57.212066  2658 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.007s
W20260709 12:57:57.329957  2766 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:57:57.329866  2658 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.212915  2694 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:57.330533  2611 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.331362  2694 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.255892  1671 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:57.151057  2662 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.213884  2565 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.209261  2764 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:57.295184  2653 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.296593  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:57.297722  2762 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:57:57.334097  2733 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:57.299090  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.290870  2728 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.212163  2664 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:57:57.218932  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.253206  2747 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.328727  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:57.332841  1598 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:57.284893  2707 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.333418  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.334352  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.159358  2742 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:57.281091  2667 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.179126  2756 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.149561  2743 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:57:57.220551  2702 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.296375  2768 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:57:57.255785  2671 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.257182  2687 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:57.223162  2640 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.214243  2757 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.221263  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 157) took 1684 ms. Trace:
I20260709 12:57:57.359009  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.335561  2658 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.213661  2760 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.341697  2565 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.290982  2745 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:57:57.364266  1600 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.367130  2708 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:57.342272  2625 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:57:57.341636  1601 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.314901  2706 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.310788  2741 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:57:57.285296  2699 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.372426  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.385385  2670 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.378355  2743 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.379478  2736 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.385075  1602 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:57.385769  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.366837  2707 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.364460  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:57.432010  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67637.2us
I20260709 12:57:57.432960  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:57.434234  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:57.358875  1595 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:57.362771  1596 raft_consensus.cc:2376] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3. Re-sending same reply.
W20260709 12:57:57.384008  2761 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:57:57.399516  1751 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.399870  1752 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.352869  2764 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.401342  2745 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.401994  1743 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.402189  2640 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.397732  2565 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.399597  2700 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:57.404042  2765 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 12:57:57.361634  2728 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.375010  2611 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.376832  1749 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:57.411768  2658 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.456593  2658 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.435148  1747 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.435333  2733 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:57.429780  2767 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:57:57.416132  2612 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.398098  2607 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.449717  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.428490  2687 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:57.427528  2753 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.446609  2745 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.455293  2769 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.436347  2708 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:57.428143  1594 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:57.480798  2317 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:57.480964  2745 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.481731  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.482350  2745 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.482662  1594 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:57.485127  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.486727  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.488145  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.489347  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.490669  1676 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:57.437294  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.429265  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.408977  2625 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.464200  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.460724  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.396925  1497 rpcz_store.cc:276] 0709 12:57:55.536387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.536588 (+   201us) service_pool.cc:224] Handling call
0709 12:57:57.221162 (+1684574us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":412460,"reported_tablets":6}
I20260709 12:57:57.466095  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.466594  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.469528  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.469619  1677 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:57.470224  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.471328  2728 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.452514  2760 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.473357  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.456626  2763 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.435371  2610 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.454107  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.458676  2658 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.417291  2653 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.496673  2708 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:57.480423  2753 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.429867  2743 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.531883  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.447052  2739 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.403972  2738 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:57.491849  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54623.5us
I20260709 12:57:57.469419  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:57.538055  1674 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.538110  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:57.495370  1678 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:57.497704  2724 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.497830  1595 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.501466  2625 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.501654  2764 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.553186  2724 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.508411  2750 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.556468  2750 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.510188  1669 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:57.464181  2772 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.533782  2607 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:57.534811  2759 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.396s	user 0.005s	sys 0.000s
I20260709 12:57:57.532378  2743 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.535106  2610 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.494459  2769 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.501510  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.540783  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.541136  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.541437  1673 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:57.508248  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.543310  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.492043  2715 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.546173  2653 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.530908  2568 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:57:57.547976  2736 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.569387  2740 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.551060  1674 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:57:57.493068  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.555855  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:57.558461  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.569307  2706 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.520318  2763 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.611420  2763 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.563364  2738 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.548398  2760 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:57:57.549000  2728 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:57.585011  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.579471  2739 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.570585  2743 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.570391  2696 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.570443  2769 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.581064  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.579766  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.521255  2723 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.592242  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.591675  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 847) took 1054 ms. Trace:
I20260709 12:57:57.601248  2740 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.556337  2753 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.556337  2724 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.602573  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 47) took 1088 ms. Trace:
I20260709 12:57:57.603071  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.597549  1599 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.563874  2750 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.633818  1745 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3.
I20260709 12:57:57.613972  1751 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.549998  2708 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:57.559111  2565 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.615985  1743 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:57:57.611421  2712 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
I20260709 12:57:57.583297  2699 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.622634  1603 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.621224  2737 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.654330  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 502) took 1042 ms. Trace:
I20260709 12:57:57.522773  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.588698  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.624651  2723 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.628515  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:57:57.625579  1746 rpcz_store.cc:276] 0709 12:57:56.536845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.568186 (+ 31341us) service_pool.cc:224] Handling call
0709 12:57:57.590780 (+1022594us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:57:57.591017 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.591266 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.591292 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.591337 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:57.591365 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.591422 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.591591 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9699072}
I20260709 12:57:57.627556  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.628902  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 829) took 1025 ms. Trace:
I20260709 12:57:57.608168  2736 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:57.619100  2732 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:57.632946  1675 rpcz_store.cc:276] 0709 12:57:56.513871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.518383 (+  4512us) service_pool.cc:224] Handling call
0709 12:57:57.553853 (+1035470us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:57:57.602492 (+ 48639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32856320}
I20260709 12:57:57.649132  2756 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.652314  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 840) took 1108 ms. Trace:
I20260709 12:57:57.629324  2739 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:57.572463  2716 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.654709  1603 rpcz_store.cc:276] 0709 12:57:56.612257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.580643 (+968386us) service_pool.cc:224] Handling call
0709 12:57:57.654263 (+ 73620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.657326  2316 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:57:57.616750  2658 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.658802  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:57.658468  1597 rpcz_store.cc:276] 0709 12:57:56.603253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.605707 (+  2454us) service_pool.cc:224] Handling call
0709 12:57:57.592065 (+986358us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:57:57.628834 (+ 36769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4557056}
W20260709 12:57:57.660962  2714 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.557s	user 0.001s	sys 0.012s
I20260709 12:57:57.659685  2753 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.661000  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.661306  1672 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:57.661993  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.662142  2731 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:57.662819  2702 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.662580  2732 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:57.665174  1745 rpcz_store.cc:276] 0709 12:57:56.533391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.534161 (+   770us) service_pool.cc:224] Handling call
0709 12:57:57.602938 (+1068777us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:57:57.634715 (+ 31777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12295552}
I20260709 12:57:57.666044  2724 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.667276  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.668864  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.656092  2712 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:57:57.676168  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.653728  2631 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.676772  2631 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:57.677821  2631 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.678794  2631 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.668568  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.664332  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:57.680596  2727 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:57.676527  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.680014  2712 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:57.681453  1597 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:57.682487  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.683096  1597 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:57.672303  2706 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.684469  2706 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.684888  2706 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.684595  2708 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.655805  2699 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.663851  2728 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:57.660369  1594 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.671183  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:57.568251  2772 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.666507  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.676834  2737 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.686110  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:57.686592  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.690302  2699 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.704766  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 844) took 1162 ms. Trace:
I20260709 12:57:57.668741  2714 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.670964  2750 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.670387  2739 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:57.706215  1748 rpcz_store.cc:276] 0709 12:57:56.536091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.551646 (+ 15555us) service_pool.cc:224] Handling call
0709 12:57:56.552034 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.599960 (+ 47926us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:56.769297 (+169337us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.050700 (+281403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.050864 (+   164us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:57.050918 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.697157 (+646239us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b540013ae54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:57:57.697206 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.697347 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":284608,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":94,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6966,"spinlock_wait_cycles":109647616,"thread_start_us":430529,"threads_started":2,"wal-append.queue_time_us":386740}
I20260709 12:57:57.716849  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.717711  1602 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.692413  2721 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.693339  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:57.688858  2728 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.698956  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.704324  2316 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 12:57:57.704890  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.686486  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:57.671279  1746 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.725518  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 503) took 1113 ms. Trace:
I20260709 12:57:57.710811  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.712108  1595 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:57.712329  2696 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.712735  2732 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:57.714129  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:57.704517  1601 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:57.718400  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:57.727028  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.724898  2728 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:57.729887  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.734982  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.726054  1600 rpcz_store.cc:276] 0709 12:57:56.612528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.698650 (+1086122us) service_pool.cc:224] Handling call
0709 12:57:57.725428 (+ 26778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.753229  1746 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.754278  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.755170  1600 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.724014  2715 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:57.689100  2723 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:57.724886  2737 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:57.778177  2758 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.662s	user 0.004s	sys 0.000s
I20260709 12:57:57.748978  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 505) took 1125 ms. Trace:
I20260709 12:57:57.779585  1743 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.784852  2723 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.826749  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.827718  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:57.793392  1595 rpcz_store.cc:276] 0709 12:57:56.614460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.460370 (+845910us) service_pool.cc:224] Handling call
0709 12:57:57.739306 (+278936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.828452  1599 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.918527  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 848) took 1381 ms. Trace:
I20260709 12:57:57.942777  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:57.958187  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:57.943890  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:58.048882  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 328827us
I20260709 12:57:58.034909  1597 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.967350  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 70) took 1440 ms. Trace:
I20260709 12:57:58.119313  1674 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:57.932687  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.119791  1676 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:57.835076  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:57.868997  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.994977  1600 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:57:58.122790  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.122231  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:57:58.123368  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.118960  1678 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.120005  1501 rpcz_store.cc:276] 0709 12:57:56.526997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.527366 (+   369us) service_pool.cc:224] Handling call
0709 12:57:57.967267 (+1439901us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":416261,"reported_tablets":3}
I20260709 12:57:58.123711  1752 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.048969  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:57.935837  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.077309  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:57.950001  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:57.830514  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.115036  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.852962  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.114398  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.132071  1672 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.116279  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.132889  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.135289  1745 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.111896  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.134410  1602 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.135721  1748 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:57:58.133914  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.117354  1750 rpcz_store.cc:276] 0709 12:57:56.537083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.564732 (+ 27649us) service_pool.cc:224] Handling call
0709 12:57:56.564991 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.043428 (+478437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.043462 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.043505 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:57.043534 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.918203 (+874669us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54000d4154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:57:57.918268 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.918453 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099605760}
I20260709 12:57:57.814851  2662 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.144162  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.152345  1600 raft_consensus.cc:2376] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3. Re-sending same reply.
I20260709 12:57:58.153007  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 495) took 1544 ms. Trace:
I20260709 12:57:58.153321  1600 rpcz_store.cc:276] 0709 12:57:56.608910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.143810 (+1534900us) service_pool.cc:224] Handling call
0709 12:57:58.152953 (+  9143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.154162  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.154731  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:58.154721  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.144423  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.145210  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:57.847925  2776 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:57:58.133606  1751 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:57:58.160738  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:58.146888  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 214269us
I20260709 12:57:58.150127  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 516) took 1532 ms. Trace:
I20260709 12:57:58.162717  1672 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.156551  1674 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:58.145867  1752 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.163187  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.158699  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.831806  2737 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:57:57.941118  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 817) took 1450 ms (client timeout 1783 ms). Trace:
I20260709 12:57:58.162982  1597 rpcz_store.cc:276] 0709 12:57:56.617778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.683780 (+1066002us) service_pool.cc:224] Handling call
0709 12:57:58.149992 (+466212us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54000249d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.150078 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711168384}
I20260709 12:57:57.963146  2774 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:58.151378  1641 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.093s (SENT) [suppressed 6 similar messages]
I20260709 12:57:57.898423  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:57.937973  2722 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:58.167511  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.164637  1750 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:57.948374  2671 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.169353  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:57.962397  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1097) took 1467 ms. Trace:
I20260709 12:57:57.957026  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.170619  2774 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:58.179231  2722 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:58.187873  2658 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.188884  2757 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.188434  2774 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.164546  2731 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:57.961364  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.171830  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.037290  2714 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.045082  2661 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.172360  1752 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
W20260709 12:57:58.203289  2753 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 12:57:57.829689  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.037683  2687 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.251621  1602 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.173439  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:57.934628  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 513) took 1317 ms. Trace:
I20260709 12:57:57.938813  2545 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.253176  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.015329  2716 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:58.259337  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 50026.8us
I20260709 12:57:58.037737  2715 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:58.166420  1598 rpcz_store.cc:269] 0709 12:57:56.490934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.522219 (+ 31285us) service_pool.cc:224] Handling call
0709 12:57:56.636326 (+114107us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:57:57.940800 (+1304474us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400078fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:57.940993 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404626048}
I20260709 12:57:57.832034  2739 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.143208  2736 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.143903  2738 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.175782  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.156441  2631 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.066190  1596 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:57.933635  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.179665  1597 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:58.284917  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 511) took 1668 ms. Trace:
I20260709 12:57:58.285264  1597 rpcz_store.cc:276] 0709 12:57:56.616223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.167217 (+1550994us) service_pool.cc:224] Handling call
0709 12:57:58.284827 (+117610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.286315  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.287091  1597 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:58.180037  1751 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:57.928740  2763 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.257774  2754 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.184844  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.149163  1594 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:57:58.276603  2716 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.299276  2716 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.299739  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.185322  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.300876  1670 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.301774  2716 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.302558  1677 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.161443  2756 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.185961  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:58.303081  2699 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 12:57:58.252187  2661 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.303421  2756 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.167039  2721 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.056897  2706 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.156260  2625 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:58.260182  1669 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:57.672956  2740 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.185385  1599 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:58.197443  2774 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.270426  2773 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.116288  2696 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:58.282935  2707 consensus_meta.cc:287] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.835s	user 0.010s	sys 0.003s
I20260709 12:57:58.257302  1603 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:58.206729  1743 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.258126  2687 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.188443  2722 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:58.303782  1672 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.308789  1748 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:58.320736  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:58.189478  2757 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.261631  1641 leader_election.cc:400] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3.
I20260709 12:57:58.276984  1745 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:58.281957  1674 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.188573  2658 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.249971  2777 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.208050  2671 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:57:58.263199  2769 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.631s	user 0.002s	sys 0.011s
I20260709 12:57:58.150761  2653 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.292682  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.259480  2565 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:58.314680  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.205976  2772 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.288646  2714 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.297768  2742 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.184653  1671 rpcz_store.cc:276] 0709 12:57:56.494847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.504275 (+  9428us) service_pool.cc:224] Handling call
0709 12:57:57.962075 (+1457800us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54003232d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:57.962307 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441301376}
I20260709 12:57:58.262082  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
W20260709 12:57:58.330374  2750 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 12:57:58.208304  2731 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.279139  2545 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:58.372529  1641 leader_election.cc:403] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:57:58.310426  2724 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.002s
I20260709 12:57:58.372583  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1137) took 1034 ms. Trace:
I20260709 12:57:58.405766  1745 rpcz_store.cc:276] 0709 12:57:57.338426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.253213 (+914787us) service_pool.cc:224] Handling call
0709 12:57:58.276638 (+ 23425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.372261 (+ 95623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.372523 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.371925  1749 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:58.406292  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.353230  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.283586  2715 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.296015  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.371960  1673 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:57:58.313941  2728 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
I20260709 12:57:58.294961  2631 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.366612  1744 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.293256  2738 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.256932  1601 rpcz_store.cc:276] 0709 12:57:56.616812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.438190 (+821378us) service_pool.cc:224] Handling call
0709 12:57:57.934367 (+496177us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000da554. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:57.934547 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346338176}
I20260709 12:57:58.311486  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:57:58.327329  2743 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.702s	user 0.013s	sys 0.000s
I20260709 12:57:58.308233  2706 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.305505  2756 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.255465  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.304080  2716 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:57:58.396083  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.432582  1602 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.305505  2661 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.313119  1678 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.432957  1603 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.433068  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 864) took 1127 ms. Trace:
W20260709 12:57:58.404923  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 143475us
W20260709 12:57:58.329252  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 166149us
I20260709 12:57:58.433549  1676 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:58.434203  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:58.382113  2671 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.388015  2783 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.387683  2753 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.316840  2696 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.387665  2736 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:57:58.415390  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 61078.1us
I20260709 12:57:58.402712  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 523) took 1535 ms. Trace:
I20260709 12:57:58.456169  1595 rpcz_store.cc:276] 0709 12:57:56.859204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.828593 (+969389us) service_pool.cc:224] Handling call
0709 12:57:58.394841 (+566248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.455807  2736 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.457405  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.458684  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.392583  2757 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:57:58.308609  2625 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.458678  2736 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.459589  2757 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.460009  1675 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:58.461319  2625 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.317068  2707 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.463083  2631 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.303519  2699 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.463701  2707 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.464571  1747 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.464743  2783 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:58.465312  2699 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.381479  2653 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.465795  2783 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.466459  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.467332  1747 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.467665  2653 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.468241  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.468942  2696 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.468933  1747 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:58.450865  2753 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.470917  1747 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:58.409036  2545 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.471801  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1139) took 1116 ms. Trace:
I20260709 12:57:58.472493  1747 rpcz_store.cc:276] 0709 12:57:57.355673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.469969 (+1114296us) service_pool.cc:224] Handling call
0709 12:57:58.470671 (+   702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.471497 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.471737 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.420744  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.423048  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1135) took 1094 ms. Trace:
I20260709 12:57:58.402330  2742 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.398826  2710 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:58.449258  2743 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.485917  2743 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:58.486876  2743 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.488101  2545 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.455807  1599 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:57:58.488966  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.489630  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.490468  1599 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:58.494517  2740 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.496826  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 498) took 1886 ms. Trace:
I20260709 12:57:58.429030  2715 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.382247  2769 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.429035  2731 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.429854  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.431726  1746 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:58.501750  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 871) took 1023 ms. Trace:
I20260709 12:57:58.501605  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1108) took 1032 ms. Trace:
I20260709 12:57:58.400372  1600 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:58.385422  2722 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.508826  1597 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:58.433601  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.435701  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.436442  1751 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:58.433446  1748 rpcz_store.cc:276] 0709 12:57:57.306198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.158453 (+852255us) service_pool.cc:224] Handling call
0709 12:57:58.432870 (+274417us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000d4b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.433004 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332321152}
W20260709 12:57:58.512116  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 76467.1us
I20260709 12:57:58.432511  2716 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.437501  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.438275  2565 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3.
I20260709 12:57:58.517131  2769 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.425889  2778 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.424049  2728 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.440405  2738 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.441417  2763 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.409895  2772 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.412016  2721 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.519876  2721 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.520907  2728 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.521590  2772 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.522415  2721 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.311992  2737 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:58.523770  1752 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:58.523940  2772 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.410982  2750 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.445868  1603 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.525023  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 527) took 1198 ms. Trace:
I20260709 12:57:58.525399  1603 rpcz_store.cc:276] 0709 12:57:57.326176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.395794 (+1069618us) service_pool.cc:224] Handling call
0709 12:57:58.524941 (+129147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.525962  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 869) took 1053 ms. Trace:
I20260709 12:57:58.385470  2714 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.447788  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.311867  2773 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.451946  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.452409  2687 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:58.453934  2723 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.002s
I20260709 12:57:58.535776  2772 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.455617  1743 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:58.536394  1748 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:58.536644  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 873) took 1043 ms. Trace:
I20260709 12:57:58.537086  1743 rpcz_store.cc:276] 0709 12:57:57.493478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.956556 (+463078us) service_pool.cc:224] Handling call
0709 12:57:58.536571 (+580015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.538378  1743 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:58.476223  1750 rpcz_store.cc:276] 0709 12:57:57.328486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.182188 (+853702us) service_pool.cc:224] Handling call
0709 12:57:58.182617 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:58.182888 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.182904 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:58.194746 (+ 11842us) log.cc:844] Serialized 506 byte log entry
0709 12:57:58.329034 (+134288us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:58.329072 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.329149 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:58.422684 (+ 93535us) raft_consensus.cc:1685] finished
0709 12:57:58.422708 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.422975 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":70361,"threads_started":1,"wal-append.queue_time_us":170536}
I20260709 12:57:58.478291  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:58.540231  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62081.7us
I20260709 12:57:58.541551  1672 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:58.497207  1596 rpcz_store.cc:276] 0709 12:57:56.610930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.447536 (+836606us) service_pool.cc:224] Handling call
0709 12:57:58.496410 (+1048874us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400408dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.496734 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066663296}
I20260709 12:57:58.432533  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.542063  2661 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:58.524718  2545 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:58.544212  1601 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.544545  2545 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.545071  2545 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.484447  2742 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.485591  2710 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.376626  2658 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.549355  2671 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.549891  2710 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.381119  2777 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.551151  2658 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.502399  1746 rpcz_store.cc:276] 0709 12:57:57.477842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.734574 (+256732us) service_pool.cc:224] Handling call
0709 12:57:58.501680 (+767106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.502550  1676 rpcz_store.cc:276] 0709 12:57:57.468970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.243724 (+774754us) service_pool.cc:224] Handling call
0709 12:57:58.433369 (+189645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.434142 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.501228 (+ 67086us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540006e850. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.501503 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423031168}
I20260709 12:57:58.508008  2753 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.511194  1602 raft_consensus.cc:2376] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3. Re-sending same reply.
I20260709 12:57:58.513866  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 509) took 1898 ms. Trace:
I20260709 12:57:58.564100  1600 rpcz_store.cc:276] 0709 12:57:56.615651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.153943 (+1538292us) service_pool.cc:224] Handling call
0709 12:57:58.513621 (+359678us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400024ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.513779 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564798720}
I20260709 12:57:58.565336  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.565995  1600 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.514194  1745 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.515345  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.568109  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 525) took 1242 ms. Trace:
I20260709 12:57:58.568514  1598 rpcz_store.cc:276] 0709 12:57:57.325533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.478507 (+1152974us) service_pool.cc:224] Handling call
0709 12:57:58.568036 (+ 89529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.570283  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 828) took 1971 ms. Trace:
I20260709 12:57:58.518199  2716 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.526407  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:57:58.528044  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 76205.1us
I20260709 12:57:58.571421  1603 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:57:58.491384  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.529003  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.572463  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.572561  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.461704  2757 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.544143  2661 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.439441  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 865) took 1132 ms. Trace:
I20260709 12:57:58.551873  2777 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.579813  1744 rpcz_store.cc:276] 0709 12:57:57.306619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.826399 (+519780us) service_pool.cc:224] Handling call
0709 12:57:58.439207 (+612808us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54004218d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.439374 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115295616}
I20260709 12:57:58.544239  2773 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.580488  2716 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:58.577333  2671 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.582324  2716 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.549389  2742 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.534984  2738 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.556543  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1136) took 1227 ms. Trace:
I20260709 12:57:58.502832  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 874) took 1007 ms. Trace:
I20260709 12:57:58.584566  2714 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.584900  1595 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.582901  2716 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.556942  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.559759  2787 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:58.543358  2750 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.522460  2646 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:57:58.572825  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 43868.9us
W20260709 12:57:58.529760  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82043.1us
I20260709 12:57:58.573378  1602 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.590077  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.591040  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1138) took 1242 ms. Trace:
I20260709 12:57:58.570716  1598 rpcz_store.cc:276] 0709 12:57:56.599132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.569281 (+1970149us) service_pool.cc:224] Handling call
0709 12:57:58.569707 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.569906 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.569938 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.569983 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:58.570019 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.570081 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.570220 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.574573  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.526381  1747 rpcz_store.cc:276] 0709 12:57:57.472393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.499616 (+1027223us) service_pool.cc:224] Handling call
0709 12:57:58.525414 (+ 25798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.525620 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.525650 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.525699 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:58.525734 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.525793 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.525903 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.578541  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 529) took 1251 ms. Trace:
I20260709 12:57:58.592550  1603 rpcz_store.cc:276] 0709 12:57:57.326853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.577840 (+1250987us) service_pool.cc:224] Handling call
0709 12:57:58.578195 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.578324 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.578340 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.578370 (+    30us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:58.578388 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.578423 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.578495 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.579368  2661 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.595137  1601 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.596439  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 531) took 1269 ms. Trace:
I20260709 12:57:58.596946  1601 rpcz_store.cc:276] 0709 12:57:57.327501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.432180 (+1104679us) service_pool.cc:224] Handling call
0709 12:57:58.596360 (+164180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.581670  1599 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
W20260709 12:57:58.554811  2785 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
I20260709 12:57:58.587855  1597 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:58.591445  1751 rpcz_store.cc:276] 0709 12:57:57.348996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.295173 (+946177us) service_pool.cc:224] Handling call
0709 12:57:58.436249 (+141076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.511970 (+ 75721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.590820 (+ 78850us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000d4b50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:58.590976 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323491584}
I20260709 12:57:58.600353  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 36) took 1124 ms. Trace:
I20260709 12:57:58.588475  2787 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:58.600884  2787 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:58.600728  1597 rpcz_store.cc:276] 0709 12:57:57.476298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.585833 (+1109535us) service_pool.cc:224] Handling call
0709 12:57:58.586218 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.600047 (+ 13829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.600285 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.601614  2646 tablet_bootstrap.cc:492] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:57:58.601969  2787 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.602721  2646 ts_tablet_manager.cc:1403] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.656s	user 0.032s	sys 0.028s
I20260709 12:57:58.584717  1749 rpcz_store.cc:276] 0709 12:57:57.495130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.502060 (+1006930us) service_pool.cc:224] Handling call
0709 12:57:58.502358 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.502558 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.502582 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.502622 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:58.502649 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.502695 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.502786 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:58.588979  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47351.9us
I20260709 12:57:58.591603  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.594362  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.606406  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.606568  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.607887  1750 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.609309  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.611146  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.583987  1752 rpcz_store.cc:276] 0709 12:57:57.328762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.239410 (+910648us) service_pool.cc:224] Handling call
0709 12:57:58.239823 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.524265 (+284442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.556261 (+ 31996us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54001c2fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:57:58.556476 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652429568}
I20260709 12:57:58.617766  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.625171  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.589192  1596 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:58.622637  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.615409  2787 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.603518  2714 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.610700  2774 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:58.615846  2777 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.615762  2687 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.618235  2773 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.616375  2740 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.660046  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.635370  2763 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.640117  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.619408  2772 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.642901  1748 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:58.633872  2739 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:58.633198  2722 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.646925  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.669878  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.671334  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.653599  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.673221  1751 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:58.666464  1594 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:58.638511  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.637203  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.650388  2774 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.673697  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.662343  1600 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:57:58.677513  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.673121  2763 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:58.681371  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.681775  2763 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.682780  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.669689  2789 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.684062  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.672362  2739 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.692802  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.644608  2545 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.694379  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.703903  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.704579  1677 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.705688  2545 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.707285  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:58.708393  1745 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.701541  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:57:58.667992  2773 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:58.697494  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.708281  2737 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.697906  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.688035  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:58.713271  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 98188.7us
W20260709 12:57:58.715075  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.715493  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.692718  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.712256  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.718259  1672 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.723711  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.725071  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:58.732295  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.732616  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.733934  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.734500  1600 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.732295  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.736565  1678 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.679924  2774 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.676014  2772 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:58.739313  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:58.739970  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.735435  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.741299  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.744930  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:58.747875  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.748863  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.750231  1677 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.747237  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.667572  2740 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:57:58.752532  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 115982us
I20260709 12:57:58.710394  2739 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.693885  2721 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.757026  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.771687  2789 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:58.779520  1597 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:58.780221  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 839) took 1127 ms. Trace:
I20260709 12:57:58.780727  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.780340  2789 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.781468  1597 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:58.780664  1601 rpcz_store.cc:276] 0709 12:57:57.653046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.597846 (+944800us) service_pool.cc:224] Handling call
0709 12:57:58.598223 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.598482 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:58.757807 (+159325us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.779734 (+ 21927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.779795 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:58.779852 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.779928 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.780163 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37528,"raft.queue_time_us":166,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":148,"thread_start_us":100439,"threads_started":2}
I20260709 12:57:58.782461  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.782666  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.783073  1597 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.757452  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 838) took 1106 ms. Trace:
I20260709 12:57:58.761983  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.783699  1603 rpcz_store.cc:276] 0709 12:57:57.651206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.593611 (+942405us) service_pool.cc:224] Handling call
0709 12:57:58.593924 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.594125 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:58.660583 (+ 66458us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.757056 (+ 96473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.757126 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:58.757182 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.757266 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.757390 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24503,"prepare.queue_time_us":172877,"raft.queue_time_us":417,"raft.run_wall_time_us":4038,"spinlock_wait_cycles":12686976,"thread_start_us":120732,"threads_started":2,"wal-append.queue_time_us":101443}
I20260709 12:57:58.784605  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.785524  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.786047  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.786285  1603 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
W20260709 12:57:58.762480  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.786940  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.787323  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.763207  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.763631  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.788883  1598 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:58.787922  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.674872  2722 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.738302  2783 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.729974  2738 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.729266  2742 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.729715  2757 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.766953  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.747077  2687 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.709757  2773 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.738636  2753 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.747495  2737 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:58.769678  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 837) took 1136 ms. Trace:
I20260709 12:57:58.771253  1600 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.773057  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.773919  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.763002  2777 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.790153  1603 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:58.767650  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.797998  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.809015  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.811129  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.773412  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:58.817319  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 43486.6us
I20260709 12:57:58.816854  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.818885  1603 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:58.808123  1602 rpcz_store.cc:276] 0709 12:57:57.633457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.591399 (+957942us) service_pool.cc:224] Handling call
0709 12:57:58.591796 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.592008 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:58.669900 (+ 77892us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.769195 (+ 99295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.769275 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:58.769340 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.769438 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.769604 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163067,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1345,"raft.queue_time_us":1215,"raft.run_wall_time_us":5008,"spinlock_wait_cycles":31246208,"thread_start_us":146256,"threads_started":2}
I20260709 12:57:58.820045  2782 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:58.820822  1595 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:58.820878  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.821266  2782 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:58.794064  2731 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.821708  2782 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:57:58.807504  2757 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.824095  2737 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.826455  1596 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:58.828207  1597 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.832230  2314 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:58.816654  2753 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.833142  2661 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.816972  2631 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:58.835999  2631 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.835718  2772 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.836431  2631 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.821708  1602 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.841667  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.842283  2800 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.842988  2756 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:58.843436  2661 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.843564  2756 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.844259  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.844295  2756 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.845201  1596 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.844945  2646 raft_consensus.cc:359] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:58.845894  2646 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:57:58.846356  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.847213  1596 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.846674  2646 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:58.809257  2738 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.856577  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.812574  2742 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:58.817454  2750 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.838790  2736 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:58.816890  2728 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:58.835405  2753 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.791596  2653 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.808951  2721 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.868604  1497 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.872154  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.872412  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:57:58.873075  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 116166us
I20260709 12:57:58.872234  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.918095  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.875691  1602 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:58.919173  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.791219  2745 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.880313  1674 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 3. Ops: [1.2-1.2]
I20260709 12:57:58.848187  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.878825  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.920809  1596 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:58.920985  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.921303  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.921789  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.922312  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.922482  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.911476  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:58.916689  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.835225  2716 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.873991  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.922514  1596 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:58.924489  1746 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.919674  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.925326  2716 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:58.925612  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.921327  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.916462  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.877561  2800 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:58.928162  2716 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.928889  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.928637  2800 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.930275  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.931504  2708 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.931985  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.932289  2708 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.929044  2742 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.933450  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.934160  1599 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:58.934260  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:58.935439  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.935885  2687 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:58.936147  1601 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:58.936291  2687 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.936735  2687 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.937371  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.823066  2782 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.938221  1601 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:58.938907  2782 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.941509  2738 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:58.942129  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.942390  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:58.943743  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.944017  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:58.926985  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.945429  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.884181  2740 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:58.889916  2736 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:58.939249  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.935201  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:58.947599  2714 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:58.955164  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:58.915086  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.965866  1669 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:57:58.928709  2716 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:58.973235  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.950821  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:58.960845  1602 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:58.962087  1597 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:58.962568  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.943032  2799 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.957022  2736 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.968248  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.968892  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.978329  1597 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:58.979156  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:58.986398  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:58.988065  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:58.989863  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:58.959698  2763 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.001688  2699 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.002120  2715 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:59.002620  2715 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.003021  2715 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.003262  2696 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.004035  2696 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:59.005151  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:59.005287  2696 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.999714  1596 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:58.981806  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:58.989526  2739 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.009274  2646 ts_tablet_manager.cc:1434] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.406s	user 0.011s	sys 0.002s
I20260709 12:57:58.964057  2714 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.010388  2714 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.000216  2653 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.011415  2653 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.014204  2653 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.000062  2708 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.015168  2710 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:57:58.999639  2740 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:59.016398  2740 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:57:59.016913  2740 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.017155  2774 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.019788  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:58.981539  2778 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:58.967698  1601 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:59.022531  2756 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:58.960208  2631 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.010579  2739 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.026800  1599 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:57:59.059948  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70184.1us
I20260709 12:57:59.061308  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:59.030202  2778 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.067158  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-22373089b38b498393c2161e53b5f016 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:57:59.069416  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-22373089b38b498393c2161e53b5f016 on tablet 22373089b38b498393c2161e53b5f016 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:59.067453  2787 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.053115  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:57:59.075165  2772 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.076669  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.077299  2772 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:59.078148  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.078320  2772 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:59.078893  1748 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:59.080025  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.080744  1747 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:57:59.082312  1752 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.085783  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 844) took 1411 ms. Trace:
I20260709 12:57:59.073176  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:59.089064  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.089731  1752 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.091655  1751 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:59.091950  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:57:59.095818  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 129155us
I20260709 12:57:59.098109  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.099159  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.099987  2737 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:59.100158  2739 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.102262  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.106109  2687 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.063325  2716 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.108263  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:59.110136  2708 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.110872  2708 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:59.111716  2739 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:59.101437  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.112636  2631 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.113191  2739 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.113363  2800 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.075625  2802 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:57:59.115092  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.115396  2802 consensus_queue.cc:1243] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:57:59.116007  1747 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:59.086287  1594 rpcz_store.cc:276] 0709 12:57:57.674210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.299289 (+625079us) service_pool.cc:224] Handling call
0709 12:57:59.075305 (+776016us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400039654. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:57:59.085703 (+ 10398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724628352}
I20260709 12:57:59.078173  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.118764  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.119833  2315 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:57:59.120190  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:59.120651  2800 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.122064  1601 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.122287  2661 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:59.122540  1596 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.122691  2661 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:59.124228  2699 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.125479  2722 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.129917  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.130156  2800 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.130393  2699 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:59.133090  2699 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.133862  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.134970  1594 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.136489  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.136831  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.138342  2800 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.066704  2778 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.140287  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.143728  2800 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.144762  2721 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.144258  1497 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 2, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:59.145505  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.148953  2800 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.149662  2800 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:59.150905  2800 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.156131  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:59.156893  1595 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.156714  1496 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.162402  2757 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.087836  2787 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:59.164006  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.164748  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:59.165416  1598 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:57:59.166813  2787 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.168219  1743 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:59.172969  2687 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.175432  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.176828  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.177578  2661 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:59.179097  2661 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.188796  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.190845  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.192795  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:57:59.193763  2670 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.195813  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.197976  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.198175  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.204103  1752 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:57:59.217300  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:59.218174  1597 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.219156  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.256173  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.249644  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:57:59.260637  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.265733  1597 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:59.271028  1598 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.272711  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.273710  2802 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.276677  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.276993  2802 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:57:59.278234  2802 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:59.279695  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:57:59.281284  1673 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:57:59.194327  2757 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.252918  2721 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:59.194846  2736 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.282188  2715 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.274334  2631 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:59.283111  2631 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.283488  2631 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.270603  2809 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.284405  2736 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.105159  2737 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.285429  2715 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.285825  2737 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.254395  2769 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:59.287323  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.159332  2740 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.253109  2699 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:59.290738  2740 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.290874  2699 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.269713  2628 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.291633  2699 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.105340  2728 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.253559  2671 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.295441  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:57:59.295773  1599 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:59.296862  2797 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:59.297258  2797 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.297591  2797 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.278860   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:59.104947  2774 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.223196  2545 raft_consensus.cc:2764] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:57:59.269714  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:57:59.316334  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46758us
I20260709 12:57:59.318397  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.105223  2756 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.319280  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.286451  2769 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.321969  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.326748  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:59.103422  2714 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.328715  1748 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:59.328742  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:57:59.330539  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.330662  2714 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:57:59.320000  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47623.8us
I20260709 12:57:59.274380  2773 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.331951  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.332480  1599 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.334591  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:59.316478  2736 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:59.335403  1599 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.343616  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.341089  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:59.346383  1597 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:57:59.282598  2757 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:57:59.337260  2721 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.337818  2715 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.342234  2716 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.323114  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:57:59.339115  2736 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.342525  2740 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.343751  2662 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.323609  2722 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:57:59.365893  1743 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.342137  2661 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:57:59.380996  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:59.372455  2736 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.348362  2696 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:57:59.349954  2777 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:59.373805  2716 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:59.433604  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:57:59.419514  2815 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:57:59.481197  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:59.406548  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57128.1us
I20260709 12:57:59.481159  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:59.464581  1672 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.545077  2699 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.499639  1595 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.465734  1676 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.391674  2708 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.462915  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:57:59.488699  2822 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:57:59.487881  1669 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.541396  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.427919  2315 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:57:59.560245  1748 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:59.560787  2315 pending_rounds.cc:85] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 4
I20260709 12:57:59.465003  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:59.418695  2757 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.380828  2778 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.456481  2799 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:57:59.548491  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.561156  2315 pending_rounds.cc:107] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:57:59.568531  1675 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.568800  2315 raft_consensus.cc:2889] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:59.423059  2670 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.571841  2699 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.584699  2813 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.585632  2813 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:59.586872  2813 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.602048  2783 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:59.602732  2783 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:59.663463  2777 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:59.647832  2824 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:57:59.536834  2631 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:59.541005  2769 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.567760  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.661360  2699 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:59.664425  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:57:59.452054  2797 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:57:59.696659  2715 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:57:59.664180  2714 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:59.698446  2708 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:57:59.723078  2687 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:59.705427  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 147776us
I20260709 12:57:59.771307  1749 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.773844  2799 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:59.749811  1673 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.804140  2800 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:59.810400  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.815762  2769 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.818701  2631 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:57:59.818202  2769 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:57:59.820770  2797 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:57:59.822340  2769 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:57:59.823266  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 102488us
W20260709 12:57:59.825434  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:59.823848  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 256141us
I20260709 12:57:59.826108  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:59.826433  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:59.828054  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.736493  2721 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:57:59.723253  2737 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.829975  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.832327  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:57:59.828948  1747 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:57:59.838061  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:57:59.838999  1746 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:57:59.841734  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:57:59.828049  2631 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:59.748591  2715 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.737152  2716 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.854070  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:57:59.855835  1750 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:59.844086  2740 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:59.838615  2671 consensus_meta.cc:287] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.540s	user 0.014s	sys 0.000s
I20260709 12:57:59.846912  1673 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.850354  2769 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:59.854780  2670 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.859608  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.851226  2778 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.854759  2631 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.876137  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.888600  2631 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.852281  2783 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.889493  2783 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.864480  2736 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.877641  1595 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.881812  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:59.882390  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:59.910360  1602 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:57:59.883862  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:57:59.885344  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:57:59.858035  1599 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:57:59.852551  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:57:59.873173  2769 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.887756  2670 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.872359  2708 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:57:59.893535  2740 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.876740  2545 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:59.894232  1603 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:59.895066  2715 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.875013  2809 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:59.889523  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:57:59.937299  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47873.9us
I20260709 12:57:59.938125  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.939385  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.901216  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:57:59.940280  1747 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.862144  2826 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:59.910979  1600 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.886479  2737 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:57:59.910228  1598 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:57:59.857681  2800 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:57:59.915045  1602 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:59.863914  2671 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.921453  1748 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:59.933290  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.971457  1746 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:59.922398  2769 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.945782  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.969408  1600 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:57:59.976375  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.982123  1670 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:59.942029  2722 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:59.962054  2740 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.942191  2825 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.962002  2757 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.969825  2826 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:57:59.997969  1598 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.001811  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:00.010103  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 76886.3us
I20260709 12:57:59.987835  2756 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.021564  1747 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:00.037277  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.022765  1746 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.042048  1747 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.997539  2800 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.052731  1596 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:59.997607  2740 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.044246  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.049587  2844 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.021458  1594 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.021914  2545 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:00.001875  2764 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.060711  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:00.001590  2826 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.039822  2722 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.059665  2756 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.042335  2757 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.068213  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.085065  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.069707  2736 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.074043  1673 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:00.077550  1747 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.087061  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:57:59.999006  2825 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:00.089287  1670 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:00.075766  2740 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.094375  2843 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:58:00.095356  2628 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.095855  2825 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.103228  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.109623  2774 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:00.063987  2844 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.111853  2545 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.113642  2844 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.104344  2740 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.093443  2764 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.118371  1672 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.119756  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.120198  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.120582  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.139474  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:00.141654  1602 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:00.129901  1603 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.144215  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:00.132184  1747 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.093143  2670 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.157553  1673 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.157996  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.158854  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.135583  2800 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.159837  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.160471  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.161075  1672 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.161108  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.162046  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.162292  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.163128  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.159128  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.164723  1674 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:00.165326  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.165506  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.166746  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.167299  1674 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:00.168109  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.168213  2315 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:58:00.168656  2315 pending_rounds.cc:85] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 4
I20260709 12:58:00.168931  2315 pending_rounds.cc:107] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:58:00.169148  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.169203  2315 raft_consensus.cc:2889] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:00.170578  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.165426  2317 raft_consensus.cc:1217] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:00.172127  2774 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:00.172518  2774 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:00.172869  1674 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.171258  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.173496  2774 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.164177  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.174753  1672 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:00.174482  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.176079  1677 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.178282  1678 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.182287  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.097193  2722 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:00.185215  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:00.188396  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 54188us
W20260709 12:58:00.188431  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 121050us
I20260709 12:58:00.102799  2736 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:00.158990  2631 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.174964  2774 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:00.190151  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.179148  1671 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:00.135947  2737 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:00.199740  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:00.201186  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.202600  2844 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:00.199462  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.205101  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:00.205883  1746 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:00.207849  1602 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:00.211161  1602 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.207998  1600 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.107847  2565 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:58:00.214062  1600 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:00.218883  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:00.219772  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:00.214277  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.181788  2787 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:00.214949  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:00.215572  2813 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.215775  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:00.216756  1603 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.217861  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:00.199174  2740 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.217631  2844 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.229394  2844 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.233120  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:00.198287  2783 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:58:00.194044  2722 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.234175  2853 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.225760  1596 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.221820  2721 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:58:00.222096  2628 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:00.258390  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.275527  2772 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.276315  1746 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:00.199882  2736 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:00.277354  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 43692.1us
I20260709 12:58:00.278988  2722 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.212551  2737 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.204560  2833 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:00.226625  2714 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:00.230967  2800 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:00.256932  2670 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:00.236382  2846 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.262182  2844 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:00.231763  2787 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:00.208863  2764 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:58:00.283377  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.285300  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:00.295109  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.317248  1599 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.262504  2853 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:00.275629  2628 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.239279  2728 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:58:00.280144  2736 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.318632  2844 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.321139  2670 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:00.338814  2628 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.339875  2714 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:00.323879  2721 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:58:00.363277  2844 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:00.396199  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 180488us
I20260709 12:58:00.318874  2800 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.380503  2846 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.381748  2736 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.408066  2662 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:00.410372  2850 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:58:00.414038  2714 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.393818  2740 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.404489  2854 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:58:00.434089  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:00.435689  1750 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.427178  2722 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.429634  2708 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:00.454617  1750 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.473812  2670 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.435487  2631 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.432647  2859 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.431644  2736 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.404110  2787 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:00.434828  2843 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:58:00.438608  2740 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.456485  2853 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.476432  2863 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:58:00.511308  2847 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.480697  2722 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.549366  2631 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.522156  2721 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:58:00.563984  2737 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:00.511492  2708 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:00.427378  2846 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.521692  2859 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.579416  2631 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:00.620023  2830 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.058s	user 0.008s	sys 0.009s
I20260709 12:58:00.621460  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1175) took 1117 ms. Trace:
I20260709 12:58:00.622020  2631 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:00.624387  2769 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 12:58:00.633824  2737 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:00.634610  2737 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.636999  2737 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:00.571208  2847 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:00.638774  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 207280us
I20260709 12:58:00.630317  2769 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:00.645483  2769 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.647519  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:00.621860  1743 rpcz_store.cc:276] 0709 12:57:59.504632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.508733 (+  4101us) service_pool.cc:224] Handling call
0709 12:57:59.543449 (+ 34716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:59.543927 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.543963 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:59.544522 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:57:59.562627 (+ 18105us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:59.562693 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.562816 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:00.598850 (+1036034us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:00.621136 (+ 22286us) raft_consensus.cc:1685] finished
0709 12:58:00.621166 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.621391 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2162,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":298065792,"thread_start_us":17631,"threads_started":1,"wal-append.queue_time_us":17294}
W20260709 12:58:00.652261  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 201616us
I20260709 12:58:00.639961  2870 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.641232  2631 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.658807  2863 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:58:00.666769  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:00.700755  2708 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:00.732499  1743 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.734117  2862 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.734804  2862 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.738189  2862 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:00.740042  2862 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:00.701722  2875 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.703668  2847 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.703449  2878 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.653218  2872 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.706013  2857 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.655022  2737 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.664714  2870 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.748206  2875 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:00.748824  2875 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:00.716482  2869 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:00.663585  2687 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:58:00.668017  2736 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.724483  2740 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.725234  2722 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.666993  2631 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:00.728529  2774 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.001s
W20260709 12:58:00.744239  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 135282us
I20260709 12:58:00.748852  2857 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:58:00.716094  2865 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:58:00.731419  2611 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:00.715096  2844 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.741055  2862 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.762270  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:00.798629  2611 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:00.846750  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.850795  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:00.851874  1749 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.852900  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.853783  1750 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.855198  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.857179  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.858035  1747 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.859270  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.860186  1748 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.762884  2875 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.752823  2872 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.862003  2875 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:00.765230  2857 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:00.867429  2863 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.878089  2859 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:00.841566  2722 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:00.844741  2740 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:00.864879  2736 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:00.754055  2869 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:00.893334  1598 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.897456  1600 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:00.898887  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.901623  1747 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:00.882483  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:00.903947  1748 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:00.905388  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58762.2us
I20260709 12:58:00.906322  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.886097  2722 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.890450  2740 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:00.913246  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.923686  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.924088  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:00.925243  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.925863  1678 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.908107  2871 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:00.911954  2769 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.890823  2736 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:00.898694  2628 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.949033  2872 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.949796  2872 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:00.950743  2872 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.950932  2628 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.935949  2871 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:00.943943  2828 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 1.383s	user 0.006s	sys 0.007s
I20260709 12:58:00.896510  2611 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.946357  2870 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.931931  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:00.928476  1596 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:00.938494  2826 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.850s	user 0.017s	sys 0.000s
W20260709 12:58:00.952207  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.941632  2869 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.914199  1743 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.953388  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.951177  2872 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.947357  2736 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:00.937896  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.942828  2740 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.969554  1678 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.934154  2846 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.914636  2857 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:00.956315  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.958495  2871 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:00.976073  2826 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:00.981815  2844 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:00.988991  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:00.992229  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68236.7us
I20260709 12:58:00.993228  1749 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.994876  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.003971  1678 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:00.978447  2611 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:00.996899  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63058.8us
I20260709 12:58:00.998740  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 575) took 1512 ms. Trace:
I20260709 12:58:01.006450  1597 rpcz_store.cc:276] 0709 12:57:59.483998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.484182 (+   184us) service_pool.cc:224] Handling call
0709 12:57:59.484655 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:59.485180 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.485223 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:59.502339 (+ 17116us) log.cc:844] Serialized 26 byte log entry
0709 12:57:59.563745 (+ 61406us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:59.563946 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.564015 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:00.844376 (+1280361us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:00.994785 (+150409us) raft_consensus.cc:1685] finished
0709 12:58:00.994819 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.995107 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":662,"raft.run_cpu_time_us":979,"raft.run_wall_time_us":981,"spinlock_wait_cycles":5574912,"thread_start_us":23759,"threads_started":1,"wal-append.queue_time_us":37061}
I20260709 12:58:00.991173  2764 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:00.983404  1675 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:01.012637  1676 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:01.001485  2857 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.004941  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.015664  1678 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:01.016534  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.017401  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:00.991367  1671 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:01.004606  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:01.013783  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 351474us
I20260709 12:58:01.025808  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:01.020710  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:01.027871  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:01.011173  2809 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:01.028538  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:01.009508  2862 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:01.013836  2764 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:01.034560  2885 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:01.039232  2722 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.013212  2628 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:58:01.029225  1677 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:01.045390  2714 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:01.046687  2722 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:01.048249  2628 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:01.048715  2628 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:01.050028  2883 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:58:01.052040  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:01.049672  2628 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.058115  1674 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:01.058940  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.061331  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.062458  1678 raft_consensus.cc:2368] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:01.063697  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.064764  1678 raft_consensus.cc:2368] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
W20260709 12:58:01.066643  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.035172  2809 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.069284  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.028824  2886 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:01.051512  2764 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:01.051986  2846 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:01.075629  2887 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:58:01.076802  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:01.044086  2875 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:58:01.068439  2847 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:01.101622  2849 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.888s	user 0.000s	sys 0.004s
I20260709 12:58:01.104812  2631 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.089030  2628 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.114509  2826 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:01.122507  2852 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.885s	user 0.016s	sys 0.005s
I20260709 12:58:01.113035  2871 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:58:01.136518  2777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.007s	sys 0.013s
W20260709 12:58:01.138823  2777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.007s	sys 0.013s
I20260709 12:58:01.139356  2809 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.139351  2872 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.138237  2871 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:01.142285  2872 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.179445  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:01.186645  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 119592us
I20260709 12:58:01.196244  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 600) took 1052 ms. Trace:
I20260709 12:58:01.198494  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.201128  1675 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:01.201520  1715 leader_election.cc:400] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:01.202020  1715 leader_election.cc:403] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:01.203804  1715 leader_election.cc:400] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:01.204278  1715 leader_election.cc:403] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:01.197048  1672 rpcz_store.cc:276] 0709 12:58:00.146006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.175635 (+ 29629us) service_pool.cc:224] Handling call
0709 12:58:00.175977 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:00.176513 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:00.176547 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:00.178197 (+  1650us) log.cc:844] Serialized 26 byte log entry
0709 12:58:00.230282 (+ 52085us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:00.230355 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.230446 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:01.121847 (+891401us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:01.195141 (+ 73294us) raft_consensus.cc:1685] finished
0709 12:58:01.195197 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:01.195885 (+   688us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1153,"raft.queue_time_us":376,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":67,"spinlock_wait_cycles":178161664,"thread_start_us":51608,"threads_started":1,"wal-append.queue_time_us":52043}
I20260709 12:58:01.206641  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:01.204444  2611 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:01.210175  2611 consensus_queue.cc:1243] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:01.217610  2714 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.220033  2896 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:01.221329  2772 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.221227  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.143146  2809 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.224329  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.225732  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.233600  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.234683  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.236702  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:01.253347  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61927.2us
W20260709 12:58:01.255249  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51900.2us
I20260709 12:58:01.256824  1750 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.258001  2875 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:01.258514  2875 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:01.254729  1743 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:01.256948  2872 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:01.263721  2872 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:01.265028  2872 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.267618  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:01.273257  2875 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.273455  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.290143  1749 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:01.294975  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:01.296171  2887 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:01.286986  2825 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:01.304309  2825 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:01.306964  2756 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:01.308097  2756 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.306393  2825 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.312600  2825 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.314131  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 595) took 1197 ms. Trace:
I20260709 12:58:01.316218  1671 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:01.319775  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 67) took 1247 ms. Trace:
I20260709 12:58:01.276603  2671 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:01.311160  2756 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:01.339922  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 70005.8us
I20260709 12:58:01.341615  2800 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.350363  2872 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.350816  2809 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:01.383104  2670 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:01.354983  2875 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.388713  2778 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:01.373695  1670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 584) took 1874 ms (client timeout 2160 ms). Trace:
W20260709 12:58:01.390993  1670 rpcz_store.cc:269] 0709 12:57:59.461496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.461658 (+   162us) service_pool.cc:224] Handling call
0709 12:58:01.315323 (+1853665us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54001847d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:01.336242 (+ 20919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010649216}
I20260709 12:58:01.352803  1669 rpcz_store.cc:276] 0709 12:58:00.117067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.135040 (+ 17973us) service_pool.cc:224] Handling call
0709 12:58:00.157132 (+ 22092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:00.163389 (+  6257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:00.163427 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:00.163485 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:00.163519 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.313522 (+1150003us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b54001d3dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:01.313620 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:01.313912 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13787904}
I20260709 12:58:01.358873  2671 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:01.382418  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 87739.5us
I20260709 12:58:01.396354  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:01.396065  2671 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.397336  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 887) took 1270 ms. Trace:
I20260709 12:58:01.397939  2671 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.383220  2809 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:01.400393  2867 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:01.400475  2887 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:01.401906  2809 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.405364  2628 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:01.406208  2887 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:01.384176  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 159) took 2360 ms. Trace:
I20260709 12:58:01.397950  1601 rpcz_store.cc:276] 0709 12:58:00.126381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.135829 (+  9448us) service_pool.cc:224] Handling call
0709 12:58:00.164446 (+ 28617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:00.317264 (+152818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:00.317297 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:00.317349 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:00.317397 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.396674 (+1079277us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400025dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:01.396771 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:01.397080 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264647424}
I20260709 12:58:01.352115  1676 rpcz_store.cc:276] 0709 12:58:00.044263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.044494 (+   231us) service_pool.cc:224] Handling call
0709 12:58:00.044811 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.013097 (+968286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.255080 (+241983us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54001ab8d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:01.291861 (+ 36781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225066240}
I20260709 12:58:01.406240  2809 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:01.410835  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.385759  2756 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.405691  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.353514  1750 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:01.373333  2772 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
W20260709 12:58:01.419193  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.429347  2757 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.430394  2757 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.424862  2778 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:01.436833  2778 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:01.424328  2565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.010s	sys 0.005s
W20260709 12:58:01.443017  2565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.011s	sys 0.005s
I20260709 12:58:01.444099  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.447806  2811 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:01.448596  2811 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:01.450800  2662 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:58:01.459376  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.460251  2708 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.461184  2708 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.463789  2714 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:01.463948  2699 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.464829  2699 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.466809  2757 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.467514  2756 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:01.469264  2708 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:01.470235  2756 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:01.470494  2699 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:01.473100  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.473802  2869 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:01.474020  2787 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:01.474920  2787 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:01.474713  2869 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:01.476248  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.478169  2787 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:01.478528  2869 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:01.478782  1743 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:01.484648  1678 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:01.488920  2872 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.479049  2787 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:01.492268  2869 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:01.493001  2869 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:01.494525  2869 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:01.496749  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.496592  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:01.497743  1747 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.502925  1601 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:01.506094  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:01.506505  1595 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:01.510931  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 116974us
I20260709 12:58:01.520680  1747 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:01.521793  2778 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:01.547801  1601 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:01.555130  1670 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:01.562155  2869 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.568394  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:01.569465  1597 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.570676  2757 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.571689  2757 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.408779  1496 rpcz_store.cc:276] 0709 12:57:59.023367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.031371 (+  8004us) service_pool.cc:224] Handling call
0709 12:58:01.383857 (+2352486us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:59.388774 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:59.412613 (+ 23839us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:59.412658 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:57:59.412679 (+    21us) tablet.cc:662] Decoding operations
0709 12:57:59.413082 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:59.413183 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:59.413226 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:59.413435 (+   209us) tablet.cc:701] Row locks acquired
0709 12:57:59.413456 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:57:59.413633 (+   177us) write_op.cc:270] Start()
0709 12:57:59.413784 (+   151us) write_op.cc:276] Timestamp: P: 1783601879413575 usec, L: 0
0709 12:57:59.413813 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:57:59.414652 (+   839us) log.cc:844] Serialized 540 byte log entry
0709 12:57:59.997696 (+583044us) op_driver.cc:464] REPLICATION: finished
0709 12:58:00.202107 (+204411us) write_op.cc:301] APPLY: starting
0709 12:58:00.202179 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:00.202260 (+    81us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:00.202366 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:00.202687 (+   321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:00.202865 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:00.202919 (+    54us) write_op.cc:312] APPLY: finished
0709 12:58:00.203130 (+   211us) log.cc:844] Serialized 22 byte log entry
0709 12:58:00.203339 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:00.203424 (+    85us) write_op.cc:454] Released schema lock
0709 12:58:00.203468 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:00.225093 (+ 21625us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:00.226536 (+  1443us) write_op.cc:454] Released schema lock
0709 12:58:00.387699 (+161163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:00.391765 (+  4066us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":74181,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":193563,"apply.run_cpu_time_us":1832,"apply.run_wall_time_us":10561,"num_ops":1,"prepare.queue_time_us":215726,"prepare.run_cpu_time_us":88677,"prepare.run_wall_time_us":326846,"raft.queue_time_us":316043,"raft.run_cpu_time_us":32243,"raft.run_wall_time_us":359184,"replication_time_us":583688,"thread_start_us":596011,"threads_started":4,"wal-append.queue_time_us":446287,"wal-append.run_cpu_time_us":14536,"wal-append.run_wall_time_us":1414289}]]}
I20260709 12:58:01.578047  2757 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.579001  2628 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.580118  2628 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.581549  1678 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:01.581123  2811 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.582535  1743 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:01.584527  2756 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:01.585242  2756 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.588557  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.590358  1595 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:01.593031  1670 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:01.579111  1599 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:01.567108  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 71) took 3382 ms. Trace:
I20260709 12:58:01.597415  1602 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:01.600978  1748 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:01.619611  2757 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.663939  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:01.664767  1672 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:01.656291  2756 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.678648  2756 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:01.679955  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:01.680346  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67055.1us
I20260709 12:58:01.680943  1675 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:01.681370  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.682085  1602 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:01.679467  2756 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:01.688305  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.689869  2825 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:01.691148  2825 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:01.692196  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:01.694213  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.695679  2757 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.696158  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.697669  2728 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:01.698873  2757 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.700281  1601 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:01.697853  1600 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:01.698727  2728 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.663702  2628 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.675657  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.741827  1601 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:01.791754  2883 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:58:01.792248  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.793179  1601 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:58:01.808442  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 66043.5us
I20260709 12:58:01.809412  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:01.809969  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.754853  2757 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.790843  2778 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:01.824947  1597 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:01.836184  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.824805  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:01.808805  2756 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:01.796546  2811 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.872628  2925 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:01.874231  2756 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:01.789759  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:01.819672  2825 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:01.892472  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 134219us
I20260709 12:58:01.817903  2883 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:58:01.905431  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:01.911152  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.920583  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:01.893285  2772 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:01.921147  2777 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:01.925523  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.886762  2699 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:01.945909  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.946318  1597 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:01.926076  2772 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.909411  2778 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.921630  2757 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.018138  2809 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:02.051733  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.959576  2772 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.959784  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:01.959203  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:02.080248  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.956629  2721 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:01.965453  2777 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:01.957360  2825 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.083722  1670 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:02.106950  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 194014us
I20260709 12:58:01.951864  2756 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:02.090389  1750 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:02.092551  2907 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 12:58:01.945010  2925 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:02.083920  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:02.081496  2859 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:02.094906  2911 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:58:02.092460  2813 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:02.095068  2880 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:58:02.084583  2757 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:01.956836  2696 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.319s
I20260709 12:58:02.083274  2893 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.110616  2872 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.111661  2699 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.083302  2809 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.093859  2867 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:58:02.127480  2859 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.119227  2737 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.087918  2875 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:58:02.185531  2756 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:02.093987  2721 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.135463  2708 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.110646  2910 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:58:02.150369  2825 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.182669  2859 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.190351  2931 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:02.231101  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 315007us
W20260709 12:58:02.258119  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 308410us
W20260709 12:58:02.216812  2869 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.654s	user 0.013s	sys 0.004s
I20260709 12:58:02.197633  2756 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:02.191885  2872 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.272954  2899 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.255614  1743 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:02.289637  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:02.293545  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:02.294711  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:02.295729  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:02.296482  2852 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:58:02.295773  2871 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:02.193615  2813 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:02.200313  2737 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:02.296969  2924 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:58:02.299932  2922 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:58:02.227505  2708 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:02.295722  2919 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:58:02.297011  2926 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:58:02.307649  2756 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.212136  2893 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.310474  2809 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.307170  2708 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:02.321319  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:02.357276  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.308247  2932 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.300935  2871 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:02.332319  1598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.017s
W20260709 12:58:02.358598  1598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.005s	sys 0.017s
I20260709 12:58:02.295828  2757 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:02.309131  2899 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.349432  2813 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:02.350178  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 607) took 1244 ms. Trace:
I20260709 12:58:02.360384  2757 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.276257  2931 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.360522  2871 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:02.378013  1601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.030s	sys 0.056s
I20260709 12:58:02.381414  2757 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.359812  2932 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.420392  2825 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.422820  2899 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.424608  2872 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.425402  2872 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:02.425765  2756 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.426684  2756 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:02.427162  2756 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.595283  1497 rpcz_store.cc:276] 0709 12:57:58.184378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.186870 (+  2492us) service_pool.cc:224] Handling call
0709 12:58:01.566839 (+3379969us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:59.739700 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:59.872015 (+132315us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:59.875147 (+  3132us) write_op.cc:435] Acquired schema lock
0709 12:57:59.886922 (+ 11775us) tablet.cc:662] Decoding operations
0709 12:57:59.896072 (+  9150us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:59.896126 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:59.896154 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:57:59.896628 (+   474us) tablet.cc:701] Row locks acquired
0709 12:57:59.896648 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:57:59.896808 (+   160us) write_op.cc:270] Start()
0709 12:57:59.896974 (+   166us) write_op.cc:276] Timestamp: P: 1783601879896759 usec, L: 0
0709 12:57:59.897007 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:57:59.933809 (+ 36802us) log.cc:844] Serialized 918 byte log entry
0709 12:58:00.191079 (+257270us) op_driver.cc:464] REPLICATION: finished
0709 12:58:00.261235 (+ 70156us) write_op.cc:301] APPLY: starting
0709 12:58:00.271126 (+  9891us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:00.271289 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:00.271442 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:00.271912 (+   470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:00.272122 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:00.272648 (+   526us) write_op.cc:312] APPLY: finished
0709 12:58:00.272920 (+   272us) log.cc:844] Serialized 28 byte log entry
0709 12:58:00.315434 (+ 42514us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:00.320217 (+  4783us) write_op.cc:454] Released schema lock
0709 12:58:00.321738 (+  1521us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":487255,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":50512,"apply.run_cpu_time_us":3207,"apply.run_wall_time_us":78773,"num_ops":2,"prepare.queue_time_us":420378,"prepare.run_cpu_time_us":4915,"prepare.run_wall_time_us":207308,"replication_time_us":287344,"thread_start_us":167726,"threads_started":1}]]}
I20260709 12:58:02.465178  2932 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.443282  2899 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.467957  2899 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:02.427457  2937 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:02.425819  2872 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.430009  2756 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.444077  2925 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:02.477604  2721 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.483383  2872 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.482682  2699 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.521209  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:02.522954  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 427808us
I20260709 12:58:02.496673  2937 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:02.543627  2811 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.005s
I20260709 12:58:02.551131  2893 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:02.546824  2935 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 12:58:02.520483  2925 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.553040  2931 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:02.580585  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 402878us
I20260709 12:58:02.552111  2737 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.564714  2811 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:02.590598  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 316187us
I20260709 12:58:02.593186  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:02.617442  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.553079  2565 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:58:02.631929  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:02.645174  2899 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.597059  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:02.650396  1603 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:02.589774  2925 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.376477  1673 rpcz_store.cc:276] 0709 12:58:01.055797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.326303 (+270506us) service_pool.cc:224] Handling call
0709 12:58:01.326949 (+   646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:01.386232 (+ 59283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.386273 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:01.387209 (+   936us) log.cc:844] Serialized 26 byte log entry
0709 12:58:01.523757 (+136548us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:01.530352 (+  6595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.538020 (+  7668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.285181 (+747161us) raft_consensus.cc:1685] finished
0709 12:58:02.285234 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.300560 (+ 15326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25488,"raft.queue_time_us":44588,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":244,"thread_start_us":125354,"threads_started":1,"wal-append.queue_time_us":274707}
I20260709 12:58:02.634475  2811 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.641685  2737 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:58:02.678470  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 85431.9us
W20260709 12:58:02.681878  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 384960us
I20260709 12:58:02.699102  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:02.707516  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.708045  2708 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.708694  2708 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.709147  2938 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.709767  2938 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.710229  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:02.712459  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:02.712690  2938 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.716439  2925 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.718622  2925 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:02.720047  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.003s	sys 0.040s
I20260709 12:58:02.725021  2948 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:02.725150  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.611704  2937 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:02.719244  2925 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.728580  2946 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:02.729307  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.003s	sys 0.040s
I20260709 12:58:02.729724  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:02.734488  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:02.700929  2931 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.749982  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 601) took 1054 ms. Trace:
I20260709 12:58:02.757802  1603 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:02.699054  2940 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:58:02.738956  2721 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:02.750698  1600 rpcz_store.cc:276] 0709 12:58:01.703832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.713179 (+  9347us) service_pool.cc:224] Handling call
0709 12:58:01.742378 (+ 29199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.886612 (+144234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:02.128332 (+241720us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.747526 (+619194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:02.747673 (+   147us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:02.747740 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.747847 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.749879 (+  2032us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168278,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"thread_start_us":760675,"threads_started":2}
W20260709 12:58:02.755088  2281 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.034s	sys 0.066s
I20260709 12:58:02.742377  2925 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.739471  2757 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.764456  2565 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:02.776671  2281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.035s	sys 0.067s
I20260709 12:58:02.795249  2565 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:02.796252  2757 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.797508  2708 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.796939  2565 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:02.806874  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.809298  2961 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.810020  2961 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.814195  2628 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:02.814664  2628 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:02.763528  2946 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.819092  2946 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.819710  2728 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.819767  2946 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.824056  2714 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:02.824357  2946 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.826704  2946 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.824693  2714 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:02.830473  2714 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.832326  2714 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.791433  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:02.823257  2772 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.000s
I20260709 12:58:02.849494  2942 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:02.841547  2955 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.852119  2955 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.845777  2777 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.854365  2811 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.855667  2942 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:02.856980  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77484.8us
W20260709 12:58:02.859087  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 146721us
I20260709 12:58:02.779675  2721 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.775064  2931 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:02.818959  2778 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.844043  2628 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.863641  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:02.870417  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.877571  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.869551  2867 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:02.888700  1670 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:02.849030  2772 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:02.912395  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.915971  2628 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.872673  2942 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.895043  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.922394  1496 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.924918  1496 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.927042  2945 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.926553  1496 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.927518  2721 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.925556  2955 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.927874  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.928412  1496 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.914778  2961 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.930869  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.882654  2757 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:02.932744  2772 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.933007  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:02.934206  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.934921  1670 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:02.936514  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:02.937273  1672 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:02.935868  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:02.937891  1670 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:02.927708  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.939759  2958 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:02.916199  2884 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.940632  2884 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.940507  2958 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.943033  2884 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:02.943190  2958 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:02.930352  1496 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.932878  2757 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:02.944324  2945 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.946095  1670 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:02.946412  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:02.946638  2809 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.914690  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:02.949543  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.950052  2317 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:02.951834  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:02.952117  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:02.952333  2875 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.005874  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 627) took 1047 ms. Trace:
I20260709 12:58:03.006007  2875 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.006543  1677 rpcz_store.cc:276] 0709 12:58:01.957944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.962586 (+  4642us) service_pool.cc:224] Handling call
0709 12:58:02.070929 (+108343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:02.434226 (+363297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:02.437052 (+  2826us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:02.477991 (+ 40939us) log.cc:844] Serialized 26 byte log entry
0709 12:58:02.781802 (+303811us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:02.781872 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.788017 (+  6145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:03.005530 (+217513us) raft_consensus.cc:1685] finished
0709 12:58:03.005551 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.005672 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43851,"raft.queue_time_us":83278,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":13064,"thread_start_us":556868,"threads_started":2,"wal-append.queue_time_us":465774}
I20260709 12:58:03.008383  2875 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.008955  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.951851  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:02.952863  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:02.951927  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:02.952991  2813 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.952796  2867 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:02.957199  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:02.964354  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.913239  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:02.965137  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 160940us
I20260709 12:58:03.018424  2813 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:02.978453  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.026422  1747 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:03.000093  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:03.006039  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:02.997311  1496 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.957141  2756 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.017531  2958 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.017401  1600 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:03.009891  1677 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:03.022038  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:02.957082  2871 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.511s	user 0.014s	sys 0.000s
I20260709 12:58:03.040104  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 619) took 1452 ms. Trace:
I20260709 12:58:03.041038  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.042297  2931 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.044772  2945 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.064500  2961 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:03.064925  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.065164  2961 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.009845  2809 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.044373  2757 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.019955  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:03.047971  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:03.048262  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.028230  1678 raft_consensus.cc:2376] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2. Re-sending same reply.
I20260709 12:58:03.062301  2867 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:03.132355  1672 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:03.134014  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:03.162485  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.163048  1600 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:03.056095  1671 rpcz_store.cc:276] 0709 12:58:01.588617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.590132 (+  1515us) service_pool.cc:224] Handling call
0709 12:58:01.609191 (+ 19059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.609690 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:01.875073 (+265383us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.310489 (+435416us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b18000ca6c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 12:58:02.829655 (+519166us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18000ca6c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:03.025213 (+195558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:03.037357 (+ 12144us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:03.039767 (+  2410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.039860 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.040024 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104052,"prepare.queue_time_us":311547,"prepare.run_cpu_time_us":175,"prepare.run_wall_time_us":10427,"raft.queue_time_us":7013,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":1967,"spinlock_wait_cycles":17073408,"thread_start_us":847341,"threads_started":3,"wal-append.queue_time_us":980536}
I20260709 12:58:03.158128  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.173688  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.163107  1678 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:58:03.135457  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.066684  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:03.065575  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.180271  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.181209  1752 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:03.185061  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.186132  1748 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:03.188512  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.193222  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.194787  1747 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:03.073223  2859 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.000s
I20260709 12:58:03.138796  1594 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:03.157634  1595 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:03.053282  1675 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:03.218794  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:03.075585  2872 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.550s	user 0.003s	sys 0.008s
W20260709 12:58:03.173676  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.794s (SENT) [suppressed 13 similar messages]
I20260709 12:58:03.157203  2721 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.202768  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.227167  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:03.228063  2317 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:03.172456  2945 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.232465  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.177160  2565 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.159088  2813 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.219614  1678 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:03.224835  1746 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:03.075044  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:03.228753  1752 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:03.230875  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57220us
I20260709 12:58:03.176992  2825 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.236902  1670 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:03.249598  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.233393  1677 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:03.133803  2958 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.199278  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.256163  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:03.239115  1676 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:03.059923  2871 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.256857  1672 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.259562  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.259897  2965 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.251912  2937 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.192132  1599 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:03.228951  2875 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.259958  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:03.272070  2965 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.274121  1602 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:03.217528  2859 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.275056  2871 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.244366  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:03.230424  2872 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:03.420126  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 69856.9us
W20260709 12:58:03.353825  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.437906  1670 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:03.483481  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:03.252516  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1924695199999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:58:03.527019  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1070250939999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 12:58:03.528499  1672 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:03.510300  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:03.279063  2968 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:58:03.534473  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.269932  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.281211  2809 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.259073  2825 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.251896  2721 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.543915  1603 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:03.294287  1673 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:03.276803  2859 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:03.261760  2945 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.539062  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:03.248101  2565 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.547430  1601 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:03.549607  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.550627  2872 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.421125  2777 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 12:58:03.397457  2937 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.279721  2714 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.261s
I20260709 12:58:03.525310  2965 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.278290  2925 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.526944  2875 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:03.543298  2628 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.576982  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.577850  1750 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:03.546142  1671 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:03.561072  2942 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:03.574354  2813 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.592062  2721 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:03.591974  2813 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.585016  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.585386  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:03.579903  2628 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.598662  2565 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.598838  2875 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.599476  2628 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.586320  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.600292  2945 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.600695  1750 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:03.601850  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.603113  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.591158  1596 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:03.603492  2825 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.604344  2872 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:03.561172  2859 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:03.605715  2859 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.606935  1744 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.580485  2955 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:03.608330  2955 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:03.608760  2955 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.600817  2813 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.563835  2961 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.583405  2714 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:03.615654  2714 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:03.616706  2714 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:03.618057  2714 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.619072  2859 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:03.592651  2937 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.624939  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.637214  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.638262  1749 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:03.637290  1744 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:03.640445  2756 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.651499  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.656565  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.658143  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.664732  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:03.679498  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 62168.8us
I20260709 12:58:03.664726  1743 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:03.670980  2756 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:03.694602  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 175151us
I20260709 12:58:03.700579  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.682585  2937 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:03.693112  2756 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:03.729602  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.728328  2756 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.739121  2925 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.740650  2966 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.732093  2937 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.770690  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.777292  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:03.765228  2958 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:03.781397  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 247033us
W20260709 12:58:03.789510  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.773031  2966 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:03.800706  2981 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:58:03.794014  2985 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:03.805105  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:03.808866  2978 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.224s	user 0.003s	sys 0.002s
I20260709 12:58:03.809763  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.811233  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.811051  2757 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.813388  2958 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:03.813920  2756 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.814312  2951 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.815011  2951 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:03.817502  2951 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.819782  2985 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.820961  2872 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.821141  2937 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.821355  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:03.821555  2872 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.822371  2985 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:03.824472  2985 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.836697  2966 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.839676  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.834172  2955 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:03.839529  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49294.2us
W20260709 12:58:03.853266  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48265.8us
I20260709 12:58:03.853809  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.844930  2756 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.845559  2872 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.860685  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:03.858861  2985 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.873951  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.868027  2777 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:03.873740  2937 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:03.867419  2987 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:03.866487  2859 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:58:03.866173  2714 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:58:03.876739  2966 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.877837  2875 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.885752  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:03.886453  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50931.3us
I20260709 12:58:03.884730  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.868067  2988 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:58:03.890743  2825 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.890561  2945 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.878620  2777 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:03.888906  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.896129  2777 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.897332  2955 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:03.897265  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.898339  2872 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.899848  2756 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.898165  2987 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:03.903162  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.886651  2867 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:58:03.905324  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:03.906339  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:03.906814  2987 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:03.907366  2987 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.908680  2987 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.911777  2966 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.914836  2966 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.915329  2872 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:03.917014  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:03.918157  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.876821  2985 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.920904  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.921633  2756 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:03.927893  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.893157  2937 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:03.937448  2809 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:03.929450  2951 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:03.946614  2988 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:03.947132  2988 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:03.948741  2757 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:03.920042  2945 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.953999  2945 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:03.955971  2985 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:03.956378  2777 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:03.921888  2875 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:03.922139  2984 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.963232  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.926688  2966 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:03.960484  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57408.6us
I20260709 12:58:03.966750  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.969364  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.967618  2945 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:03.970584  2945 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:03.971062  2945 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.974042  2628 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:03.961920  2875 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.970973  2777 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:03.984474  2875 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.971367  2825 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:03.972573  2757 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.958524  2937 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.984807  1743 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:04.000389  2965 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:04.000892  2965 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:04.001724  2965 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:03.991844  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:03.975247  2565 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:58:03.990999  2756 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.985146  2988 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.003049  2951 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:04.004900  2988 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.005470  2948 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:03.966043  2966 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.008728  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.030871  1598 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:04.037448  2825 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:04.005988  2948 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:04.046218  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.040154  2756 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.046984  1597 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:58:04.047039  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.047851  1598 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.047431  2948 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:04.036863  2777 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.039041  2565 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:58:04.048875  2948 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.049033  2777 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.049398  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.050114  1743 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:04.046314  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:04.038255  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.037434  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.051620  1594 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:58:04.052729  1595 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:04.032058  2945 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.027665  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.056808  2945 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.009325  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:04.046566  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.062538  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.032634  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.069005  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.059365  1751 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:04.069092  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.073534  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.003034  2965 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.077291  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.077338  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.077827  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.080633  1748 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:04.080790  1750 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
W20260709 12:58:04.082799  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 73588.1us
I20260709 12:58:04.051370  2777 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.086300  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.074465  1600 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.071038  2966 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:04.057575  2984 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:04.071425  2756 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:04.095074  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.087157  1599 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:04.073952  2757 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:04.101821  1751 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:03.983455  2987 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.087229  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.092228  2945 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:04.110024  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.114295  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.116048  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.118117  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.094341  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:04.132876  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 196414us
I20260709 12:58:04.130393  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.129812  1598 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:04.133942  1676 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:04.136762  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.139508  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.140659  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.139519  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.141151  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.141305  1748 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.105190  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.144076  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.139945  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.140058  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.142966  1751 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:04.148254  1600 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:04.148553  1598 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:04.148270  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.149803  1748 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:04.145067  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.152594  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.120465  2945 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:04.155200  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.102344  2984 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.155751  1748 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:04.128157  2813 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:04.133118  1744 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.161028  2985 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:04.157925  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.154716  1595 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:04.170113  1670 raft_consensus.cc:2410] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:04.172528  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.173527  1598 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:04.174774  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.170542  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.162254  1601 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:04.176656  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.176967  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.177239  1598 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.177824  1601 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:04.178063  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.153852  1743 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:04.183372  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.162427  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.164160  2985 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.162150  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.194192  1599 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:04.194046  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.194914  1596 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.186991  2996 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:04.195956  2996 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.196426  2996 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.181674  2809 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:04.200912  2809 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:04.203322  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.203810  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.204233  1596 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:04.203984  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.213201  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.214905  1598 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:04.215376  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:04.219280  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:04.223134  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.226316  2987 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.213956  1600 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:04.198047  2985 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.168991  2813 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:04.257635  2998 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:58:04.198998  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.205680  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.267367  1677 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:04.267760  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.268532  1670 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:04.273521  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.274904  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:04.275120  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.276387  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.277261  1601 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:58:04.278254  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 79312.2us
I20260709 12:58:04.278998  2777 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:04.279577  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.283339  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.284255  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.286026  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.288820  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:04.289780  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.290088  1596 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:04.291093  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.291872  1674 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.198673  2945 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.260028  1744 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:04.298170  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:04.298833  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:04.282452  3005 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.082s	user 0.001s	sys 0.001s
W20260709 12:58:04.305770  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 83215.4us
I20260709 12:58:04.306391  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.283408  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.283048  2777 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:04.294586  3001 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:04.229388  2809 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.313719  2999 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:04.388504  2999 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:04.389034  2999 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:04.310105  3019 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:04.321173  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.393813  3019 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:04.394716  3019 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:04.394760  1671 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:04.316722  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.324256  1675 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:04.318322  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.329087  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:04.398196  1672 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:04.398458  1677 raft_consensus.cc:606] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:04.399048  1677 raft_consensus.cc:614] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:04.329403  2777 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.330000  2984 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.330394  3001 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.404762  3001 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:04.331509  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45589.6us
W20260709 12:58:04.317180  3006 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:58:04.408223  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.320719  1669 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:04.409497  2721 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:04.334949  2951 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:04.413064  2951 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:04.338004  2316 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:04.339608  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:04.417482  1595 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.340713  2809 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.422170  2951 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.423599  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.371907  2945 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:04.376257  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.369302  2813 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.446914  2985 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.448446  1746 raft_consensus.cc:2368] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4.
I20260709 12:58:04.467567  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.467907  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:04.468446  1596 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.472580  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.473685  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.477051  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.315788  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:04.485962  1600 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:58:04.328879  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:04.488322  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 159641us
I20260709 12:58:04.327623  3009 raft_consensus.cc:1064] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:58:04.489764  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.490850  2813 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:04.491242  2813 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.491816  2984 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:04.491838  2813 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:04.492440  2984 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.492833  2984 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:04.492914  3009 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:04.491204  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.495369  2825 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:04.324036  2867 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:04.495579  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.495976  2825 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:04.496101  2867 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:04.513247  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.518215  1674 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:04.498215  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.525105  1678 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:04.537321  1746 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.541316  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.544202  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.547452  2955 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.548118  2955 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.549135  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.550267  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.542116  1745 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:04.557747  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.558668  1745 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:04.502564  2825 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.551185  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.564914  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:04.522761  2987 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:04.562711  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.568393  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.385180  2875 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.550572  2955 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.572830  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.552119  2628 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:04.580439  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5122317940000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 12:58:04.587998  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4978317940000352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 12:58:04.585071  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 174417us
I20260709 12:58:04.590871  1749 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:04.571770  3003 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:04.593868  1566 leader_election.cc:336] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.530s (SENT)
I20260709 12:58:04.615583  1745 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:04.614178  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:04.585029  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.570048  2987 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.581305  1744 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.579847  2565 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:04.642988  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54476.9us
I20260709 12:58:04.618469  3003 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:04.647325  1566 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.623s (SENT)
W20260709 12:58:04.648515  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 164134us
I20260709 12:58:04.623457  2757 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:04.575816  3016 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:58:04.651515  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:04.631312  2565 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.654994  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:04.625680  2987 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:04.587790  2628 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:04.652776  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.647686  3003 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:04.673420  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.589743  3001 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.660102  2565 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.665999  2714 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:04.685849  1678 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:04.666132  2756 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:04.666913  2628 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:04.687439  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 118918us
I20260709 12:58:04.771380  1641 leader_election.cc:400] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4.
I20260709 12:58:04.771835  1641 leader_election.cc:403] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:04.652618  2721 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:04.734865  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.736753  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.735713  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.775507  1678 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:04.765504  2966 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.658s	user 0.014s	sys 0.000s
W20260709 12:58:04.749085  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 105254us
I20260709 12:58:04.750985  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.751703  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.752007  2777 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:04.732412  2996 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.000s
I20260709 12:58:04.678810  3020 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:04.807936  3020 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:04.810510  3020 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:04.760591  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 107274us
I20260709 12:58:04.689498  2714 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.628815  2867 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.811296  2714 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:04.811707  2867 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.813531  2777 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.773020  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:04.741313  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.815311  1677 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:04.820261  3021 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:04.822584  2714 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.825317  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.825675  2714 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.759865  2985 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.792102  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:04.794351  1678 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:04.847247  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:04.798242  2859 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.850708  2859 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.852206  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.853025  2859 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:04.798718  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0255993820000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 12:58:04.854614  2714 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:04.855120  2714 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.855418  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:04.857172  2714 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.857663  2777 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.857788  2714 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:04.858248  2777 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.820246  2867 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.860410  2777 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.861542  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:04.806931  2996 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.872861  2996 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.780895  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.789593  2813 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:04.843830  1566 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.644s (SENT)
I20260709 12:58:04.795998  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:04.857101  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:04.804250  2721 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:04.873095  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.894009  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:04.906998  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:04.913151  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:04.786805  3016 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 12:58:04.917729  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:04.919185  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:04.919350  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 132382us
W20260709 12:58:04.920552  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.920861  2988 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:04.921689  3025 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:58:04.922533  2988 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:04.923588  3001 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.926918  2867 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4.
I20260709 12:58:04.873668  2999 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.927677  3015 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:04.928741  1672 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:04.929461  2999 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:04.929754  3016 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:04.930187  3016 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:04.908301  2825 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:04.931105  3016 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.931439  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.932178  2825 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.932459  3016 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.932713  1672 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.934110  1596 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:04.928682  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.938920  1744 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:04.902643  2965 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:04.914903  3010 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:04.910872  2985 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:04.882493  2875 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.945082  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:04.918439  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.947430  2813 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:04.911017  3033 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:04.950551  3019 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.003s
I20260709 12:58:04.948123  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:04.955229  3028 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.905316  2996 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:04.844410  2966 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:04.957427  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 94732.1us
W20260709 12:58:04.957814  1566 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.662s (SENT)
W20260709 12:58:04.959441  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 186472us
I20260709 12:58:05.008327  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:04.941392  1672 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:05.009331  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 89299.4us
I20260709 12:58:05.010107  2757 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:05.010079  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:04.968859  1670 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.011598  1672 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:05.012275  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.013070  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.012830  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.013561  1670 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:04.944794  2628 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:04.993001  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.015991  2628 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.011525  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.018510  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.019201  1678 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:04.960407  2965 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:04.964130  2985 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.003417  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:05.022403  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47842.2us
I20260709 12:58:05.023650  2965 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.027318  1675 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.028136  2985 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.035735  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.031193  2565 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:04.967798  2984 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.019100  3019 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.021353  2757 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.064774  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.033110  3028 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:05.072960  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.078104  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.043995  2714 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:05.080410  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.047047  2951 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.084617  1674 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.086984  2628 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.089444  2315 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:05.092358  3028 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.093055  2714 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.093250  2984 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.032357  2756 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:58:05.094113  2714 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.079933  2955 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:58:05.095770  2966 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.096743  2628 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.097107  3019 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.076740  3016 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.098153  2951 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:05.084836  2999 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.101262  2999 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.101755  2951 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.102210  2999 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.097036  2565 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:05.109319  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44642.3us
I20260709 12:58:05.111945  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.112845  2565 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.113260  2565 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:05.113631  2565 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.114408  2985 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:05.116014  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 96196.8us
I20260709 12:58:05.118323  3016 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.118922  3016 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.119477  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.120533  3044 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.121057  3044 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.121399  3044 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.121464  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.122524  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.125451  2985 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.121577  3016 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.128062  2966 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:05.130169  3032 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 12:58:05.130285  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.131428  2966 raft_consensus.cc:2764] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:05.132905  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.134361  2966 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.134588  2756 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.135041  2756 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:05.135138  2966 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:05.136696  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.137629  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.139374  3020 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:05.139591  2966 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.140000  2966 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:05.140372  2966 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.143640  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.135444  2756 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.146284  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.151862  2966 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:05.153353  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 75646.7us
I20260709 12:58:05.155190  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.138828  3051 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.167682  1673 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.169857  2757 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.170516  2757 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.170979  2757 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.172379  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.172380  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.061794  3003 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.189823  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.194684  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:05.195647  1603 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:05.157872  3019 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.198346  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:05.196996  2714 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:05.199064  3051 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.199384  2714 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.199690  3051 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:05.200934  3051 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.202039  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:05.199904  2714 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:05.204629  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:05.199748  3027 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.199692  1600 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.202795  1596 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:05.210491  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 178) took 3118 ms. Trace:
I20260709 12:58:05.199083  1751 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.208776  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.188876  3009 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.220860  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.221129  1672 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.222079  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.224814  1597 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:05.222993  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.213884  3027 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.222136  3019 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.228384  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.176393  2965 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.239388  1676 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:05.228240  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.232061  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.215893  1496 rpcz_store.cc:276] 0709 12:58:02.092035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.119009 (+ 26974us) service_pool.cc:224] Handling call
0709 12:58:05.210424 (+3091415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:03.652726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:03.653548 (+   822us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:03.653603 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:58:03.653624 (+    21us) tablet.cc:662] Decoding operations
0709 12:58:03.654555 (+   931us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:03.654677 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:03.654712 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:58:03.655450 (+   738us) tablet.cc:701] Row locks acquired
0709 12:58:03.655504 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:58:03.672986 (+ 17482us) write_op.cc:270] Start()
0709 12:58:03.694016 (+ 21030us) write_op.cc:276] Timestamp: P: 1783601883669261 usec, L: 0
0709 12:58:03.697171 (+  3155us) op_driver.cc:348] REPLICATION: starting
0709 12:58:03.785161 (+ 87990us) log.cc:844] Serialized 2481 byte log entry
0709 12:58:04.251326 (+466165us) op_driver.cc:464] REPLICATION: finished
0709 12:58:04.685534 (+434208us) write_op.cc:301] APPLY: starting
0709 12:58:04.749763 (+ 64229us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:04.891999 (+142236us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:04.939692 (+ 47693us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:04.940667 (+   975us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:04.940978 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:58:04.941056 (+    78us) write_op.cc:312] APPLY: finished
0709 12:58:04.941459 (+   403us) log.cc:844] Serialized 52 byte log entry
0709 12:58:04.941705 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:04.941833 (+   128us) write_op.cc:454] Released schema lock
0709 12:58:04.941903 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:04.942350 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:04.942381 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":402973,"apply.run_cpu_time_us":3889,"apply.run_wall_time_us":270253,"num_ops":6,"prepare.queue_time_us":595351,"prepare.run_cpu_time_us":28835,"prepare.run_wall_time_us":225732,"raft.queue_time_us":261312,"raft.run_cpu_time_us":48637,"raft.run_wall_time_us":331411,"replication_time_us":515022,"thread_start_us":945451,"threads_started":4,"wal-append.queue_time_us":105845}]]}
I20260709 12:58:05.237385  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.250579  1598 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.240129  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.230172  3027 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.242453  1673 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.245343  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.245549  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:05.283874  1603 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.239389  3009 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.285297  3009 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.244148  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.288019  1602 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:05.288182  1594 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:58:05.235002  2987 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.004s
I20260709 12:58:05.291857  2987 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.292371  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.293550  3015 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.293947  3015 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.294111  2987 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.294374  3015 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.253072  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.295166  1596 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.276273  2714 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:05.253737  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.233309  2565 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.245911  2756 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.261698  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.305222  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.259475  1677 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.237133  2777 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:05.263760  1601 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.227839  3010 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.275473  2966 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.233625  3019 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.280354  2316 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:05.300629  1597 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:05.277299  3003 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.277938  2965 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.304463  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.328152  1673 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:05.307137  1752 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.310004  1598 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:05.313093  1748 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:05.298631  2714 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.303236  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:05.335768  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 95722.5us
W20260709 12:58:05.336263  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.336645  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.326018  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.344180  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.345273  1747 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.313371  1674 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:05.313761  2777 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.300419  2757 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.356207  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:05.354110  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.354535  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.359905  1745 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.360427  1674 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:05.367000  1673 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:05.367496  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.351173  2756 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.371305  3051 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:05.377696  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.378285  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.379284  1677 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:05.374305  1678 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:05.368583  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.379503  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.380126  1752 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.374557  1670 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:05.375325  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.380347  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.337297  3010 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.382392  1747 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:05.383877  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.384141  1674 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:05.382936  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.350323  2565 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.385154  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.387734  1672 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.322850  3053 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:58:05.390120  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.398200  2756 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:05.398928  2757 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.381821  3051 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:05.387567  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.412235  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.413317  3010 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:05.391599  2777 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.385540  2965 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:58:05.394104  2984 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:58:05.447288  1598 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.457995  1751 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.403398  3054 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.457738  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.465183  1597 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.444763  1673 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:05.436075  1671 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.405566  3051 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:05.468372  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 80674.8us
I20260709 12:58:05.469130  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.469336  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:05.470827  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.471438  1744 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.439134  2867 raft_consensus.cc:2764] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:05.478071  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:05.478380  1597 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.477417  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.480382  1598 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:05.468880  3054 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:05.405290  3044 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.467593  2777 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.484244  3044 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.481930  3053 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:05.485742  3003 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:05.486388  1596 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:05.435504  3027 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.482059  3054 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.492492  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.469254  1594 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:05.496163  3053 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.496276  3027 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.498292  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.500907  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.502251  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.502985  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.503235  1672 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.506187  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.508011  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.508775  1597 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.509819  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.510703  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.511075  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.512142  1751 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.519652  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.519879  2721 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.528438  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.528548  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.505267  2714 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:58:05.530390  2999 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:05.531100  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.532783  3027 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:05.525462  3015 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:05.516541  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.536486  3063 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.503386  1669 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:05.567198  1752 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.503769  3044 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.502521  3053 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:05.568048  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.578644  1672 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.536653  3015 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.527854  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.507010  3060 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.537467  1500 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.538344  2999 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.576290  3063 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:05.584194  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56423.2us
I20260709 12:58:05.578524  1597 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.535324  1745 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:05.586179  1500 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.541709  1601 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.581460  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:05.582657  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:05.526279  3062 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:05.519241  3056 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:05.537010  2721 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.570855  2757 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:05.592911  3059 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.538777  2955 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:05.588410  1673 raft_consensus.cc:606] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.537660  2756 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:05.537945  2714 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:05.589437  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.590179  1744 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:05.591948  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.594538  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.596377  1500 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 2 to 3, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.598829  1672 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:05.598824  1673 raft_consensus.cc:614] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:05.587846  3053 raft_consensus.cc:2764] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:58:05.586087  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:05.592864  2757 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:05.604053  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.608129  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.609628  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.610519  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.593721  3063 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.617796  1751 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:05.598677  2955 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.611738  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:05.663324  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51676us
I20260709 12:58:05.608027  2966 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.604039  2714 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.628291  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.663592  1500 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:05.607445  3010 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.604455  3060 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:05.613664  2756 raft_consensus.cc:2764] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:58:05.624387  2813 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:05.673461  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67652.2us
I20260709 12:58:05.677253  1500 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.613420  1675 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.675030  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.679770  1673 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:05.624743  2628 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:05.680687  1672 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:05.678861  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.682685  1500 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:05.667383  3056 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.668304  2966 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:05.672487  3053 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.670288  3016 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:05.687906  2628 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.693264  2714 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.626350  3009 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:58:05.715778  3068 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.716506  3068 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:05.717520  3068 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.694562  3027 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:05.719805  3027 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.721939  3027 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.723222  2757 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:05.675765  2721 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.668030  2999 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.697747  2985 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:58:05.696786  2966 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.695973  3060 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:05.691597  3028 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.700965  2628 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:05.696796  3053 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:05.709475  1500 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.689889  3010 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.683925  3044 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 12:58:05.729245  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64691.4us
W20260709 12:58:05.748343  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 73441.1us
I20260709 12:58:05.750211  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.741308  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.753181  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.754818  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.754885  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:05.757371  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.757553  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.758350  1674 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:05.761343  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:05.731812  3053 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.762485  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:05.764271  3067 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:05.697507  3001 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:58:05.760694  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.728392  3016 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.727658  3060 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:05.740790  3028 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:05.769683  1500 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.753459  3054 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:05.760617  2756 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.768507  2565 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:05.766073  3009 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.757685  3056 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.781617  1500 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 2 to 3, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.784945  1500 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.770784  2945 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:05.789381  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:05.790983  1674 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.791215  3010 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.791874  3009 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.740913  2955 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.762315  3003 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:58:05.798295  2565 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.800202  3009 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.800843  2565 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.787014  2757 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.804315  2987 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.804888  2987 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.805835  2987 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.807876  2984 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:05.808252  3073 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:05.808468  2984 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.808903  3073 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.809458  2984 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.809796  3028 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:05.811009  2984 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.815198  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:05.821045  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63564.6us
I20260709 12:58:05.821874  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.787276  1500 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.822968  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.826723  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:05.794697  1675 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:05.834024  1674 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:05.827461  1500 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.836748  1500 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.839352  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:05.847774  1500 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.824244  3056 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:05.847474  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.820081  2945 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.811535  3073 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:05.854589  3074 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:05.856067  3016 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.857807  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:05.878276  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:05.866278  1749 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:05.833645  2756 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:05.876763  3063 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.786799  3071 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:58:05.833503  3070 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.899394  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:05.903339  1747 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:05.911381  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.865298  2757 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:05.916832  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.918103  1751 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.918036  1750 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:05.904567  3015 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.864812  3027 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:58:05.908034  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:05.941867  1751 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:05.919049  3070 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:05.938743  2757 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:05.916169  2999 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:05.921810  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:05.935006  2313 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:05.948482  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:05.953377  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:05.897014  3080 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:58:05.963943  1746 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:05.934602  2813 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:05.965229  3075 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:58:05.966132  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57254.3us
I20260709 12:58:05.940011  3015 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:05.973163  3063 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:05.897504  3074 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.932570  3051 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.962034  2999 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:05.997973  3081 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:58:05.976631  3015 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.010299  1598 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:06.021296  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:06.064649  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.003662  2628 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.069535  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:05.976788  2813 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:05.955745  2945 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.076309  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.080441  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:06.074498  3066 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:58:06.115482  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.118559  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.122066  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.127751  2813 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.135696  1602 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:06.071609  3059 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:06.083524  2867 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:06.079499  3062 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.980198  3070 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.112962  3054 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.147094  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.150862  1600 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.124675  3009 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.154438  1602 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:06.140682  1669 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:06.147007  3059 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.010053  2757 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:06.166152  3076 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:58:06.152531  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.160584  3074 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:06.173389  3085 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:06.190872  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:06.191376  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 108601us
I20260709 12:58:06.194768  1602 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.195114  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.197108  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.198230  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.199116  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.199831  1597 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.153903  3054 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.202661  3009 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.213616  3051 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.214089  2628 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.162393  3062 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:06.215687  3003 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:06.216863  3062 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:06.161948  2999 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.222723  1600 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:06.227768  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:06.228096  2966 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.001s
I20260709 12:58:06.228930  1603 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:06.224694  2965 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:06.230386  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.231298  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.228919  2966 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.241870  1600 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:06.243803  1676 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.244048  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.244983  1600 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.244959  2966 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.248204  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.257275  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:06.237263  1566 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 516703d5c9f14537854665616191b5aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:06.263147  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 12:58:06.260172  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 65155.4us
I20260709 12:58:06.266472  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.268934  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.270284  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.270602  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.272281  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.273056  1603 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:58:06.273304  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.247287  1596 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.256296  2628 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.276726  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.277163  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.249051  3003 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:06.255786  2867 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:06.305030  2628 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.312033  3049 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.278369  3074 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.278841  2965 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:06.276172  3089 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.240293  3053 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.347995  3054 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.348173  2628 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.332492  1600 raft_consensus.cc:2368] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
W20260709 12:58:06.327157  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 50527.1us
I20260709 12:58:06.351357  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.354107  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.363976  2965 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.365460  3003 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.360608  1602 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:06.336045  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.285154  3009 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:58:06.344421  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:06.349668  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 70957.6us
I20260709 12:58:06.335006  3010 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.371215  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:06.373478  3106 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:58:06.375138  1602 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:06.364339  3015 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.376221  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.377059  1602 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:06.368986  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.377581  3015 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:06.378010  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.379868  2985 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.380941  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.387985  1602 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.388602  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.389526  1603 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
W20260709 12:58:06.389704  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 119475us
I20260709 12:58:06.368992  3074 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.389842  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.391191  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.391705  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.386233  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:06.392095  3089 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.392625  1601 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:06.392956  3074 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:06.393477  3074 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:06.393553  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.393924  1715 leader_election.cc:400] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:06.394451  3074 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.382294  3059 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.396804  3053 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.336602  1597 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:06.384579  1600 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:06.400404  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.400547  3054 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.401319  1597 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:06.402382  1597 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.394831  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.405927  3051 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.406359  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.403366  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.409668  1602 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:06.410595  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:06.411242  1597 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.404968  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.406973  3080 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.411391  1602 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.421118  1597 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:06.421960  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.407050  2721 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.430797  3044 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:06.414304  2999 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.436131  3044 consensus_queue.cc:1243] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:58:06.435982  2757 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.414857  3084 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.442332  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:06.443084  1603 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.433718  2756 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.444832  3084 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.447161  3084 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.447628  2867 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:06.450775  1603 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:06.427150  2721 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:06.452754  1603 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:06.453100  2714 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.452371  2721 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.454053  2721 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.455381  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.456089  1745 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:06.459256  1603 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.459884  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:59744
I20260709 12:58:06.460577  1602 raft_consensus.cc:606] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.461011  1602 raft_consensus.cc:614] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:06.430092  3059 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.468425  1673 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.470219  1678 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: [1.2-3.3]
I20260709 12:58:06.473940  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:06.427337  1596 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:06.472332  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:06.478363  1672 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.478700  1674 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:06.475041  1670 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.475067  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:06.474464  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:06.475999  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:06.476471  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:06.482713  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:06.484107  1673 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:06.484503  1677 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.480217  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.483147  1670 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.485527  1603 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.485580  1749 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:06.494611  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:06.496572  1670 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.497648  1603 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.497991  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:06.499663  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:06.499689  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.518905  3071 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.501339  3080 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:58:06.522176  2757 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:06.523137  2757 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.524348  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:06.527799  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 113814us
I20260709 12:58:06.531646  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.532963  1749 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:06.534214  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.532974  1672 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
W20260709 12:58:06.528927  1715 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.692s (SENT)
I20260709 12:58:06.536121  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:06.536767  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46475.3us
I20260709 12:58:06.537060  3074 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.535171  1602 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:06.495865  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:06.539866  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.523824  2757 consensus_queue.cc:1243] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:06.543095  1715 leader_election.cc:400] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:06.545254  1747 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.529296  1744 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:06.546682  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 143842us
I20260709 12:58:06.546268  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.549134  3110 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:06.550951  3060 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:06.552250  3112 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:58:06.553579  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.557116  1748 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:06.546871  2777 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:58:06.496826  3044 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:58:06.564954  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:06.567624  3053 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:06.586855  3053 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:06.578966  3074 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.587899  3053 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.589320  3053 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.568897  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:06.569074  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51184.2us
W20260709 12:58:06.569746  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.572911  1677 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:06.548321  1744 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:06.593859  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.576961  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.576779  3084 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.596402  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.579394  1601 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.598716  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:06.600780  1748 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:06.601976  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.603487  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.604053  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.578972  3110 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:06.612762  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.629343  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.600320  3019 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.630463  2777 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.602921  3080 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.632465  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.602720  2756 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.610087  3010 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.636101  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.612898  3110 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.612519  3034 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.605698  3084 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.643208  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.636662  2714 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:06.676815  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48321.8us
I20260709 12:58:06.646380  3073 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.678000  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.664337  3034 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.701167  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.703218  3128 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.661608  3080 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:58:06.711248  3122 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:06.724290  3119 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:58:06.728500  2999 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.728758  3084 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.707047  2565 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.708176  2714 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:58:06.672852  1744 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.744140  1744 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.747715  3073 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.748349  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:06.748989  3073 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.750581  3034 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:06.751524  3092 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.563s	user 0.000s	sys 0.004s
W20260709 12:58:06.723035  3120 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:58:06.731731  2565 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:06.775894  3124 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:58:06.777314  1669 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:06.773640  2565 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.753437  2948 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:06.773609  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:06.779436  2948 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:06.782783  2948 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.721735  3122 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.788111  3122 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.789108  3019 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.803791  2948 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:06.804863  2948 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:06.816399  2948 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:06.820075  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 218888us
W20260709 12:58:06.822880  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 222072us
I20260709 12:58:06.829166  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.829522  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.831897  3068 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.832573  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:06.836823  3063 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.837527  3063 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:06.839861  3068 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.851126  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.843287  1675 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:06.855077  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.856869  2756 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:58:06.856756  3016 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:06.855402  3051 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.838891  3063 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.858927  2757 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.858542  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.873260  2565 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.875128  3110 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.886472  3054 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.891811  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:06.912737  3054 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:06.893499  3130 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:06.894659  2955 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.898393  3110 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.926997  2985 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.901857  3071 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.927973  3071 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:06.927775  2985 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.903026  3074 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:06.905049  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:06.756484  2777 consensus_queue.cc:1175] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "693257b3078444e0bd26d3e82159d452" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:06.911985  2565 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:06.938731  3074 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:06.930963  3060 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:06.923832  3130 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:06.934204  1749 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.929116  3071 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:58:06.915884  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:06.957628  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.944640  2985 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:06.951908  3060 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:06.964733  1750 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:06.965288  3060 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.973380  3130 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:06.976370  1748 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:06.977083  2951 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:06.978638  1743 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:06.978945  2951 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:07.033031  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.035279  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.024071  3074 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.043570  3074 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.043879  3122 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:07.046535  3122 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.046628  2955 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.047353  2955 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.047825  3071 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:07.024648  3028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.023s	sys 0.040s
W20260709 12:58:07.048966  3028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.024s	sys 0.040s
I20260709 12:58:07.025791  3054 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.050416  1752 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:58:07.050854  3054 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.050976  3080 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:07.051723  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1241) took 1120 ms. Trace:
I20260709 12:58:07.052134  1752 rpcz_store.cc:276] 0709 12:58:05.933623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.933804 (+   181us) service_pool.cc:224] Handling call
0709 12:58:05.934185 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:07.050837 (+1116652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.051421 (+   584us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540029e854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:07.051638 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566155648}
I20260709 12:58:07.050256  2955 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:07.062819  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 313128us
I20260709 12:58:06.982457  1671 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:07.065138  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:07.070946  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.067189  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:07.075245  1752 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.070644  3063 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.079950  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.081248  1744 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.080204  2948 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.068282  3122 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:58:07.082355  3089 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.096768  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.098073  1600 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:07.100594  1597 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.103237  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:07.104084  1597 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:07.121999  1595 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:07.126921  1752 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:07.130692  1597 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:07.135252  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:07.136051  1594 raft_consensus.cc:2376] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4. Re-sending same reply.
I20260709 12:58:07.136998  2316 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:07.130692  3109 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:07.140539  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.135300  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:07.126566  1599 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.145555  1600 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:58:07.170327  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 467924us
I20260709 12:58:07.141413  2951 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.181607  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:07.198858  1673 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.185706  1678 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.205372  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.206138  1678 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:58:07.187034  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:07.214501  1673 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:07.220443  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.175989  2948 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.233445  1673 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.242018  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.203899  3080 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:07.138165  3109 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.246348  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.249004  1678 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:07.232774  2984 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.257083  1602 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:07.237855  2987 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:07.277334  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.280247  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.282433  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.285236  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.254684  2951 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:07.259428  3015 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.233198  3001 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:58:07.240149  2948 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:07.233053  3010 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:58:07.254688  1669 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.295964  1676 raft_consensus.cc:2368] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5.
I20260709 12:58:07.233479  2955 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:58:07.306059  1672 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:07.233261  3140 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:58:07.233325  2985 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:07.247185  2945 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:58:07.325472  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.313622  3070 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:07.315187  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.262159  3080 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:07.310227  3141 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.187s	user 0.002s	sys 0.000s
I20260709 12:58:07.306654  2951 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:07.341544  2951 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:07.345772  3143 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:58:07.317885  3015 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.287243  2987 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:07.350282  3015 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.350631  2987 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:07.336625  3108 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.347675  1596 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.353392  3080 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:07.358764  2948 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.268679  2984 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.360168  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:07.361367  2984 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:07.365774  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47926.4us
I20260709 12:58:07.335026  3070 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:07.382264  3107 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:58:07.382956  3070 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.331108  3028 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:58:07.384560  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:07.385296  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 213446us
I20260709 12:58:07.386097  3146 ts_tablet_manager.cc:933] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 12:58:07.375754  3010 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.378953  3109 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.288269  3034 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:58:07.401659  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:07.425595  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:07.408083  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:07.429353  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:07.430001  1747 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.428068  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.435863  1745 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:07.436709  1715 leader_election.cc:400] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5.
I20260709 12:58:07.437080  1715 leader_election.cc:403] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:07.409760  2955 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.398969  3054 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.402789  3010 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.439352  3142 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.449852  3142 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.455623  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:07.427740  3126 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:58:07.444886  2721 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:07.470412  2721 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:07.444172  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:07.448182  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:07.474617  1602 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.405442  3122 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.428838  3068 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.497922  1747 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:07.404147  3157 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:58:07.407366  2987 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:58:07.472815  3034 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.445406  2955 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.486194  3060 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.536840  1602 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:07.506718  2777 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5.
I20260709 12:58:07.548756  3153 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.552752  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.446408  3054 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:07.558301  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 124977us
I20260709 12:58:07.510890  3034 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:07.498575  3122 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.547613  2565 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.566555  1672 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:07.567507  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.564321  3156 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:07.568523  1602 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
W20260709 12:58:07.569188  3149 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:58:07.561146  3140 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.569532  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.569980  3140 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.570740  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.572299  3140 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.572883  1674 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.574898  3034 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.576262  3034 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.577332  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.555613  3126 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.579802  3142 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.579946  3010 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.555672  3015 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.582204  3015 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:07.584935  3054 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:07.585187  3015 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:07.508460  3068 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:07.588729  3063 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.006s
I20260709 12:58:07.589622  1600 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.547817  2955 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.527772  3109 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:07.590531  3109 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.592933  3109 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.593331  3122 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.546671  2721 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.593451  2565 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.564904  1677 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:07.578960  3126 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:07.598421  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.602244  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.614885  1674 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.626497  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:07.602651  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.623045  1677 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:07.622406  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:07.646186  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.554616  3060 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.625109  3068 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.622516  3126 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.695981  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.701823  1602 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:07.697526  2999 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:07.704694  3145 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.406s	user 0.004s	sys 0.000s
I20260709 12:58:07.707931  3132 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.708422  3132 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:07.709328  3132 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.710765  3132 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.710500  3140 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:07.713343  3122 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.561903  3153 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.713950  3122 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.709666  3166 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:07.697624  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.715533  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.665794  1599 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:07.627094  3142 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:58:07.605764  3146 tablet_copy_client.cc:323] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
I20260709 12:58:07.717250  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.667745  2565 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:07.724718  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 516703d5c9f14537854665616191b5aa. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:07.729331  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 163158us
I20260709 12:58:07.720808  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.721843  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:07.715127  2999 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:07.733388  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.731168  3156 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:07.722087  2951 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:07.742125  2999 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.742766  3071 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.743310  2951 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.743595  2999 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.744068  2312 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.745246  3156 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.747998  1595 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.732036  3130 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:07.753551  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:07.735738  1675 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.766355  2565 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:07.776153  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:07.786586  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53334.8us
I20260709 12:58:07.759253  3130 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:07.784754  2565 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.794236  2565 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.794782  2565 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.809345  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:07.813437  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:07.784240  3153 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.848766  2565 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.852041  2565 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.779939  3142 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:58:07.855464  1612 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet 516703d5c9f14537854665616191b5aa from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
W20260709 12:58:07.855983  3172 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:58:07.857826  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:07.844058  3158 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.861078  2565 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:07.861212  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:07.844599  3166 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.856280  1612 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet 516703d5c9f14537854665616191b5aa from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-516703d5c9f14537854665616191b5aa
I20260709 12:58:07.863224  2987 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.863741  2987 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:07.864176  2987 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.865469  1678 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:07.862982  2565 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:07.807389  3173 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:58:07.866549  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.867437  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:07.870388  1673 raft_consensus.cc:606] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.853861  2777 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:58:07.870218  2565 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.874673  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:07.875231  1676 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:07.878044  2777 consensus_queue.cc:1243] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:07.878418  3173 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:07.878906  3173 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:07.879952  3173 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.881294  3173 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:07.881892  1678 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:07.860980  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.883366  1595 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:07.885216  1678 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.886833  1612 tablet_copy_source_session.cc:215] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:07.888149  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.896272  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.896574  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:07.897296  1678 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:07.866170  3166 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.867208  3060 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:07.901974  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.851732  3171 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:58:07.861559  2955 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:07.905217  3135 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.727s	user 0.001s	sys 0.007s
I20260709 12:58:07.905434  2948 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.905591  3166 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.945647  2948 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:07.949002  2955 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.949461  2948 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.939265  3060 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:58:07.945308  3175 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.953683  3175 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.959587  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:07.961731  1678 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.941327  3059 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:58:07.958885  2955 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.968295  2955 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.960068  3044 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.959930  3158 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.969405  3044 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.969810  3158 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.970131  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:07.970798  1594 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.972087  3158 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.975742  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:07.976526  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:58:07.899511  3130 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:07.985211  1678 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:07.985728  1597 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.986785  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:07.987511  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:07.990453  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:07.991012  3068 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:58:07.991473  3080 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:07.991367  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:07.992190  3080 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:07.994400  3080 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:07.998273  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:07.998754  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:08.000558  2955 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:07.964022  3060 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.004101  3060 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.005416  3071 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:08.006039  3071 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.006517  3071 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.006711  3060 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.009076  3175 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.011629  1678 raft_consensus.cc:606] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.012907  3146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516703d5c9f14537854665616191b5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.002974  1594 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:08.026260  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.027146  1596 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:08.013523  3044 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.014020  3059 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:58:08.031258  1596 pending_rounds.cc:85] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
I20260709 12:58:08.033346  1596 pending_rounds.cc:107] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:58:08.021109  3034 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:08.026916  3166 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.007416  3060 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:08.035358  2948 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:08.078504  3044 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.047039  3034 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.081396  2955 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.090903  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:08.091122  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.074887  1596 raft_consensus.cc:2889] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:08.099339  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62534.4us
I20260709 12:58:08.101269  2316 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:08.102839  2777 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:08.096655  3034 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:08.103427  2777 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.104149  2777 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.096859  3068 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.105702  3068 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.108563  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:08.109766  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.110005  1750 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:08.087308  3102 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.110953  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.112306  1749 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:08.096925  3044 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.114984  1744 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:08.115906  3159 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.417s	user 0.001s	sys 0.007s
I20260709 12:58:08.115985  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:08.117246  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.117677  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1263) took 1033 ms. Trace:
I20260709 12:58:08.122597  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.118114  1743 rpcz_store.cc:276] 0709 12:58:07.084611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.085181 (+   570us) service_pool.cc:224] Handling call
0709 12:58:07.085606 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:07.144291 (+ 58685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.166300 (+ 22009us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:07.237253 (+ 70953us) log.cc:844] Serialized 26 byte log entry
0709 12:58:07.405070 (+167817us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:07.431987 (+ 26917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.441118 (+  9131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.115127 (+674009us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:08.117216 (+  2089us) raft_consensus.cc:1685] finished
0709 12:58:08.117245 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.117608 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46554,"raft.queue_time_us":58476,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":23561,"spinlock_wait_cycles":5232896,"thread_start_us":80791,"threads_started":1,"wal-append.queue_time_us":332725}
I20260709 12:58:08.095705  2721 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:08.128857  2721 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:08.131088  2721 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:08.095476  3059 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.132020  3059 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.134578  3059 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.136664  3128 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:08.137301  3128 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.140115  1603 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:08.144059  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.145171  1674 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:08.145769  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.150838  3071 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:08.151674  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.152426  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.146538  3044 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.187925  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.188908  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.122503  2999 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:08.192574  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.197960  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.205577  1749 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:08.166894  3059 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.107936  2955 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.215835  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:08.221417  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.221619  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.203459  3128 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.122622  3102 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.230142  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:08.183774  2987 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.234141  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.237192  1748 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:08.212034  2999 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:08.217941  3059 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:08.239440  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.240228  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.246202  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.243217  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:08.225191  2945 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.240552  1743 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:08.247905  3157 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:08.300930  3166 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.305116  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.251261  3068 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:08.325457  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77821.3us
I20260709 12:58:08.303489  3157 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.254976  2945 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.340742  1677 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:08.341250  1677 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:08.343418  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:08.344396  1603 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.342068  1677 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:08.399945  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:08.400454  1677 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:08.405175  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 104379us
I20260709 12:58:08.328414  3158 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.340871  3157 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.343647  2948 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.343997  3068 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.344707  2955 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:08.419642  3179 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
I20260709 12:58:08.398998  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
W20260709 12:58:08.420323  3183 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:58:08.441802  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:08.420213  2314 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:08.463435  1677 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:58:08.464201  1677 pending_rounds.cc:85] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 2
I20260709 12:58:08.464653  1677 pending_rounds.cc:107] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:08.465077  1677 raft_consensus.cc:2889] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.417501  3071 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.421993  3034 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.327862  2999 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.510738  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 678) took 1338 ms. Trace:
I20260709 12:58:08.454881  3027 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:58:08.514662  3187 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:58:08.516328  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1023) took 1075 ms. Trace:
I20260709 12:58:08.521358  2945 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.521663  2987 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.527016  1600 rpcz_store.cc:276] 0709 12:58:07.172107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.172948 (+   841us) service_pool.cc:224] Handling call
0709 12:58:07.173376 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.589981 (+416605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.510470 (+920489us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54004092d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:08.510662 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956408064}
I20260709 12:58:08.527386  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 718) took 1290 ms. Trace:
I20260709 12:58:08.506157  1675 raft_consensus.cc:606] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.505290  2955 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:08.533967  3189 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:58:08.502534  3102 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.540779  1670 rpcz_store.cc:276] 0709 12:58:07.236597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.236776 (+   179us) service_pool.cc:224] Handling call
0709 12:58:07.552944 (+316168us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:07.553181 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.593771 (+ 40590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.593805 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:07.593852 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:07.593882 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.527094 (+933212us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b54003e6cd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:08.527155 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.527316 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99382784}
I20260709 12:58:08.553534  1747 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:08.526290  3193 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.453279  3068 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.558537  1600 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:08.564724  1600 pending_rounds.cc:85] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 1
I20260709 12:58:08.536579  3060 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.420503  3158 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.559875  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.559522  1603 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:08.572005  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.573792  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.574610  1603 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:08.576304  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.576514  1601 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:08.577175  3034 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.561494  2955 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.572379  3060 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.531097  3166 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:08.563659  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:08.565099  1600 pending_rounds.cc:107] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:08.584025  1600 raft_consensus.cc:2889] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.584293  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:08.559464  1597 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:08.554992  1675 raft_consensus.cc:614] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:08.537956  2777 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.535259  1599 rpcz_store.cc:276] 0709 12:58:07.441221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.468861 (+ 27640us) service_pool.cc:224] Handling call
0709 12:58:07.469287 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.718503 (+249216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.516013 (+797510us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001b4254. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:08.516244 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290729344}
I20260709 12:58:08.538655  3027 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:08.582329  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.592561  1598 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:58:08.589936  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 181411us
I20260709 12:58:08.590000  3197 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.589057  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.587901  1597 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:08.599933  1603 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:08.579697  2955 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.601958  1670 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:08.611059  3060 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.584657  1594 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:08.614212  3068 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.615391  1751 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:08.616930  2777 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:08.621892  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.589533  3199 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:08.566632  3193 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.627454  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.628566  1603 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:58:08.628675  1749 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:08.629058  1603 pending_rounds.cc:85] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 1
I20260709 12:58:08.629469  1603 pending_rounds.cc:107] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:58:08.629739  1603 raft_consensus.cc:2889] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.629174  1749 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:08.643375  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.644415  1750 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:08.589926  3166 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.619696  3027 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:08.641979  1749 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:08.697501  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.697721  1749 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.621584  3019 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:08.659696  2777 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.677026  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:08.678503  1669 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:08.706247  2777 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.685429  1743 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:08.707930  1743 pending_rounds.cc:85] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 1
I20260709 12:58:08.708280  1743 pending_rounds.cc:107] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:08.708613  1743 raft_consensus.cc:2889] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.709125  2777 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.709901  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.693651  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.620048  3197 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.680483  3202 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:08.711225  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.731731  3165 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:08.733309  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.681023  2985 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.733646  3165 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:08.728744  3074 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.734309  2985 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.734591  3074 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.712090  1744 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:08.736611  2985 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.736915  3130 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:08.737584  3130 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.646118  3199 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:08.684211  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:08.685323  3166 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.687258  3193 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.694976  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.704582  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.746035  1678 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:08.706569  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:08.680666  3158 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.746593  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.723206  2312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 141) took 1132 ms. Trace:
I20260709 12:58:08.723678  3202 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:08.728703  1748 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:08.750172  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.729012  3027 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:08.730345  3191 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:08.730943  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.731526  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:08.737601  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:08.748826  2312 rpcz_store.cc:276] 0709 12:58:07.588656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.590864 (+  2208us) service_pool.cc:224] Handling call
0709 12:58:07.591257 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.744518 (+153261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.718353 (+973835us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400550fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:08.718632 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350821760}
I20260709 12:58:08.752772  3034 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.756471  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:08.756515  3034 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:08.757551  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.757776  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.760070  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:08.760535  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.734047  1743 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:08.758416  1744 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:08.763144  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:08.766515  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.767096   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:08.778435  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:08.781719  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:08.784145  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:08.767656  3158 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.763401  2951 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.765241  3193 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:08.767436  3038 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.790264  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.774885  3138 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.758798  3027 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.788268  2628 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:08.789348  3009 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:08.767980  3166 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:58:08.779711  3019 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:58:08.787933  3165 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:08.778153  3207 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.825824  3165 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.817126  3074 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.816823  2945 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:08.795507  3038 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.797755  3138 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.814610  3009 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.828030  3009 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.828636  3138 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.828653  3038 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.829411  3130 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.830785  3202 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:08.826315  3165 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.832279  2966 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:08.832743  2966 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:08.819835  3027 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:08.834270  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47567us
I20260709 12:58:08.835723  1749 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:08.837699  1749 pending_rounds.cc:85] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 1
I20260709 12:58:08.838008  1749 pending_rounds.cc:107] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:08.838325  1749 raft_consensus.cc:2889] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.832485  3157 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.816390  1750 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:08.841579  2966 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.843103  2966 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.847926  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:08.856454  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72396.2us
I20260709 12:58:08.848723  2628 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:58:08.848862  3138 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:58:08.857710  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:08.860492  3122 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.846410  3038 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:08.851472  1744 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:58:08.866331  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.854208  3157 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.867359  1597 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:08.851639  3104 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:58:08.871222  3199 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:08.865649  1744 pending_rounds.cc:85] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 1
I20260709 12:58:08.899020  1744 pending_rounds.cc:107] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:58:08.899343  1744 raft_consensus.cc:2889] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.865576  3001 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:58:08.869673  3027 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:08.872460  3009 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.873124  3146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36884 (request call id 102) took 1937 ms. Trace:
I20260709 12:58:08.873665  3217 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:08.877454  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:08.881678  3216 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:08.883622  3122 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:08.872341  3162 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.246s	user 0.000s	sys 0.020s
I20260709 12:58:08.889951  3157 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:08.893181  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.897379  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.903581  3027 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:08.898175  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.903414  3109 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:08.906474  3217 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:08.916360  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.916831  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.907509  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.906446  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:08.915683  3157 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.921702  3220 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:08.902819  3165 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.924796  3157 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:08.905416  3146 rpcz_store.cc:276] 0709 12:58:06.935411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.951772 (+ 16361us) service_pool.cc:224] Handling call
0709 12:58:07.386456 (+434684us) ts_tablet_manager.cc:934] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
0709 12:58:07.984889 (+598433us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:08.578366 (+593477us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:08.578499 (+   133us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:08.871941 (+293442us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:08.872391 (+   450us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:08.872950 (+   559us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:08.873033 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":58991,"tablet-copy.queue_time_us":433561,"thread_start_us":511703,"threads_started":2}
I20260709 12:58:08.927105  3146 tablet_copy_client.cc:806] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:08.927906  3146 tablet_copy_client.cc:670] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:08.927162  3038 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:08.901715  2966 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:58:08.920806  1669 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:08.920883  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 705) took 1738 ms. Trace:
I20260709 12:58:08.940042  3009 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:08.940709  3168 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.279s	user 0.004s	sys 0.004s
I20260709 12:58:08.940857  3009 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.938781  1671 rpcz_store.cc:276] 0709 12:58:07.181616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.198177 (+ 16561us) service_pool.cc:224] Handling call
0709 12:58:07.244894 (+ 46717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:07.376935 (+132041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.376994 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:07.378243 (+  1249us) log.cc:844] Serialized 26 byte log entry
0709 12:58:07.513317 (+135074us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:07.524743 (+ 11426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.768728 (+243985us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001833d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:07.768786 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.857513 (+1088727us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:08.915598 (+ 58085us) raft_consensus.cc:1685] finished
0709 12:58:08.919191 (+  3593us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.919427 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6769,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":141,"spinlock_wait_cycles":312405760,"thread_start_us":128855,"threads_started":1,"wal-append.queue_time_us":247301}
I20260709 12:58:08.941390  3009 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.928930  3109 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.911773  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.944094  3109 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.944473  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.944695  3109 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:08.910792  3122 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.945770  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.946911  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:08.915966  3027 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.930418  3104 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:08.953209  1675 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:08.934290  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:08.915454  3217 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:08.955405  3217 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.947348  3122 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:08.961429  1595 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:08.968967  1673 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:08.970304  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1230) took 1104 ms. Trace:
I20260709 12:58:08.973994  1673 rpcz_store.cc:276] 0709 12:58:07.865721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.880048 (+ 14327us) service_pool.cc:224] Handling call
0709 12:58:08.955349 (+1075301us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:08.968589 (+ 13240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.969486 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.970207 (+   721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3460864}
I20260709 12:58:08.981137  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:08.982246  1670 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:08.985095  1670 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:08.973883  3010 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:08.988957  3028 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 12:58:08.995070  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 65756.1us
I20260709 12:58:08.997090  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.998494  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.000190  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:08.998719  2987 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.001581  3104 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:08.994894  3009 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.002251  3165 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.006371  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.007267  3104 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.008090  2628 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.011219  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.015129  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:09.013597  3165 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.015494  2966 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.028713  3059 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:09.014489  3027 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.032793  3027 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.047160  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.050035  2965 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.052060  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:09.052724  1669 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.035039  3165 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.059597  3165 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:09.061488  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.060168  3054 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:09.062096  3054 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:09.042392  3224 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:09.063122  3224 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.063490  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.063268  3054 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.063962  3224 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.064525  3054 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.064812  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:09.067471  2987 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:09.068998  3034 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.067581  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.074170  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.074523  2965 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.075045  2628 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:09.075448  2628 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.075870  2628 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.076079  3138 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:09.076332  3217 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:09.077239  3138 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:09.077612  3138 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:09.078176  3104 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:09.078600  3138 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.079355  3226 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:09.079798  3226 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:09.079985  3138 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.133045  3015 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.081854  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:09.088459  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.088840  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.109881  2316 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:09.090806  3160 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.144961  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.113250  2721 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.129681  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.222232  1677 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:09.223660  3160 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:09.226064  3160 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.145877  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.226744  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 190) took 4433 ms. Trace:
I20260709 12:58:09.146575  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:09.147219  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.228233  1748 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:09.149415  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.134923  2965 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.151489  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:09.152855  2777 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:09.154846  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:09.234320  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79580us
W20260709 12:58:09.156139  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.088279  2628 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.238101  2628 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.158273  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:09.165958  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 692) took 1347 ms. Trace:
W20260709 12:58:09.167634  3210 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.436s	user 0.004s	sys 0.000s
I20260709 12:58:09.173096  3197 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.176550  1675 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:09.176774  3224 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.179260  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:09.179888  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.179975  3202 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:09.183156   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:09.184957  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.184273  1497 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.186628  1669 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:09.189893  3228 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 12:58:09.080909  3226 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.196219  3068 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.197165  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.197733  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:09.268357  1745 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:09.201414  1598 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:09.268811  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.203166  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.271826  1598 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:58:09.272245  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1233) took 1405 ms. Trace:
I20260709 12:58:09.272647  1676 rpcz_store.cc:276] 0709 12:58:07.867155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.876353 (+  9198us) service_pool.cc:224] Handling call
0709 12:58:09.203002 (+1326649us) spinlock_profiling.cc:243] Waited 938 us on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:58:09.272172 (+ 69170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156928}
I20260709 12:58:09.192258  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:09.273902  1600 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.209671  1599 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:09.137564  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.229822  2721 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.215438  3015 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.278753  2721 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.235697  2965 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.279752  1744 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:09.281639  2965 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.282523  1600 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:09.237870  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.192471  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.239733  1602 rpcz_store.cc:276] 0709 12:58:07.818309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.932673 (+114364us) service_pool.cc:224] Handling call
0709 12:58:07.933085 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:07.936827 (+  3742us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:07.942904 (+  6077us) log.cc:844] Serialized 14 byte log entry
0709 12:58:07.951344 (+  8440us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180034b700. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:08.820231 (+868887us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180034b700. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:09.163435 (+343204us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b180034b700. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a
0709 12:58:09.163737 (+   302us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.164327 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:58:09.165592 (+  1265us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:09.165634 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.165704 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:09.165745 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:09.165756 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:09.165889 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3286,"prepare.queue_time_us":8180,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":64,"raft.queue_time_us":12218,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":4189,"spinlock_wait_cycles":33420032,"thread_start_us":20594,"threads_started":1,"wal-append.queue_time_us":20525}
I20260709 12:58:09.279070  3015 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.255577  1603 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:09.235765  3073 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:09.239220  2777 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:09.282457  1752 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:09.227342  1500 rpcz_store.cc:276] 0709 12:58:04.779811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.792002 (+ 12191us) service_pool.cc:224] Handling call
0709 12:58:09.212913 (+4420911us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:06.220383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:06.221081 (+   698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:06.221120 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:58:06.221140 (+    20us) tablet.cc:662] Decoding operations
0709 12:58:06.353347 (+132207us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:06.353438 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:06.353467 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:58:06.354761 (+  1294us) tablet.cc:701] Row locks acquired
0709 12:58:06.354782 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:58:06.354931 (+   149us) write_op.cc:270] Start()
0709 12:58:06.355033 (+   102us) write_op.cc:276] Timestamp: P: 1783601886354898 usec, L: 0
0709 12:58:06.355046 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:58:06.355852 (+   806us) log.cc:844] Serialized 6337 byte log entry
0709 12:58:06.864254 (+508402us) op_driver.cc:464] REPLICATION: finished
0709 12:58:07.443395 (+579141us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b1800120c40. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:07.443566 (+   171us) write_op.cc:301] APPLY: starting
0709 12:58:07.443656 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:07.444018 (+   362us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:07.444045 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:07.446139 (+  2094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:07.446424 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:58:07.446466 (+    42us) write_op.cc:312] APPLY: finished
0709 12:58:07.446882 (+   416us) log.cc:844] Serialized 112 byte log entry
0709 12:58:07.447099 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:07.494374 (+ 47275us) write_op.cc:454] Released schema lock
0709 12:58:07.499110 (+  4736us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:07.549100 (+ 49990us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:07.552643 (+  3543us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15531,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":472056,"apply.run_cpu_time_us":4630,"apply.run_wall_time_us":68368,"num_ops":16,"prepare.queue_time_us":230835,"prepare.run_cpu_time_us":26119,"prepare.run_wall_time_us":208834,"raft.queue_time_us":272246,"raft.run_cpu_time_us":59969,"raft.run_wall_time_us":469955,"replication_time_us":509066,"spinlock_wait_cycles":109410176,"thread_start_us":848967,"threads_started":4,"wal-append.queue_time_us":161098,"wal-append.run_cpu_time_us":21986,"wal-append.run_wall_time_us":1926917}]]}
I20260709 12:58:09.238672  3161 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 12:58:09.283520  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45717.8us
W20260709 12:58:09.284509  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92130.3us
I20260709 12:58:09.299427  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.285657  1672 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:09.266568  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:09.254992  3202 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:09.259269  3197 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.297212  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.266036  3054 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.292209  2945 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:09.286164  2721 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:09.336257  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:09.338898  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.338114  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.310009  3038 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.323294  2945 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.322950  3054 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.297694  3068 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:09.356858  2777 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:09.358405  3202 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:09.347718  3204 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:09.318244  3199 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:58:09.318398  3197 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.396790  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.398739  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.400451  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.404614  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.407859  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.408696  1747 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:09.409788  3197 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.366540  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.371889  3015 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:09.317178  3071 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:09.313584  3226 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.379276  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.316540  3073 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:09.322423  2721 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:09.386018  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48010.1us
I20260709 12:58:09.391259  1596 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:09.323078  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.337970  3034 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:09.389449  3156 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.390420  3202 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.390468  3068 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:09.384816  2945 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.333609  3063 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 12:58:09.424155  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45131.6us
I20260709 12:58:09.427219  3054 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.427819  3166 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:09.430408  3073 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.432260  3224 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.407823  3161 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:09.434464  3237 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 12:58:09.444198  1752 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:09.411684  2777 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.442499  2721 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:09.508886  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47640.6us
W20260709 12:58:09.514040  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 196774us
I20260709 12:58:09.514772  3054 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.515446  3054 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.517755  3054 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.453311  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.445124  3028 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:09.519518  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 66302.9us
I20260709 12:58:09.520004  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.524956  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.525770  1745 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:09.527261  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:09.528348  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:09.528959  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.447983  3166 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:09.538671  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:09.545274  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:09.562283  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.536214  3197 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.568511  3038 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.569036  3038 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.569578  3038 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.569077  3197 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.575855  3226 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:09.576603  3226 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:09.576781  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:09.518374  3068 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:58:09.564417  3200 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.565531  3059 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.566547  3122 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:09.568361  3060 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.537439  3015 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:09.510046  3034 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.572322  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:09.586148  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:09.588636  1602 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:09.523984  3028 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.577541  1596 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.591740  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.531448  3054 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.536620  3071 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.509142  3161 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.545349  3192 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.599282  3175 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:09.605746  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.545075  3102 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:09.599025  3166 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:09.623096  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 75549.6us
I20260709 12:58:09.523355  3138 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:58:09.632095  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:09.670338  1751 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:09.549880  3132 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:58:09.658689  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:09.603432  3028 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.594075  3034 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.607005  3015 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:09.654136  2965 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.662503  3175 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:09.629980  3197 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.628636  3059 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:09.577644  3226 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:09.677603  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45621.1us
I20260709 12:58:09.736891  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:09.680750  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:09.738533  1747 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:09.648607  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:09.694747  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:09.678315  3212 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:58:09.678565  1594 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:09.638733  3063 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:58:09.717563  3197 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.759708  3197 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:09.761338  3059 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.762187  3197 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.761906  3059 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.764081  3059 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:09.720167  3244 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:58:09.721931  3161 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.703040  3175 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.683495  3192 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.675077  3071 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:09.686326  3121 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.721618  3015 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.714172  3132 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:09.775588  3200 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:09.777311  3161 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:09.795120  3200 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:09.795217  3161 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.710582  3166 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.784534  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:09.675617  3102 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.773370  2985 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:09.789732  3059 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.817822  3059 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:09.778542  3109 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.819139  3109 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.819234  3161 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.819636  3109 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.820215  3059 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:09.798045  3122 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:09.821830  3122 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.788847  3121 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.703279  2965 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.788625  3071 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:09.843816  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 59409.5us
I20260709 12:58:09.860448  2965 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.865804  3192 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.813091  3132 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.833519  3121 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.870529  3132 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:09.873250  3102 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:09.813956  2985 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:09.832864  3138 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:09.891690  1675 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:09.891995  1669 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:09.893559  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.895147  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.896765  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.897639  1670 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:09.898916  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.900836  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:09.911334  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 293266us
I20260709 12:58:09.913769  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.918087  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:09.919193  3060 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.888999  3138 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.930948  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:09.903064  3122 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:09.945060  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.928946  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.957216  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:09.960310  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:09.915824  3199 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.954579  3138 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:10.012493  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 369602us
I20260709 12:58:09.907366  3034 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:09.964269  3122 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:09.960919  3060 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:10.053877  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 384349us
I20260709 12:58:10.055439  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:10.066331  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:10.066555  1746 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.024s	sys 0.057s
W20260709 12:58:10.091841  1746 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.025s	sys 0.057s
W20260709 12:58:10.106945  3249 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.083s	user 0.001s	sys 0.010s
I20260709 12:58:10.108904  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.112645  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.113348  1597 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:10.117763  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.119154  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.131007  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.122980  3034 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:10.114362  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:10.055244  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:10.053998  3063 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.085232  1601 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:09.956342  2985 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.055289  3122 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.058948  3060 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:10.134302  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.135592  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.015448  3199 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.112386  1743 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:10.133145  3234 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:58:10.145846  3156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.034s	sys 0.072s
W20260709 12:58:10.220523  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.013s	sys 0.056s
W20260709 12:58:10.221083  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.013s	sys 0.056s
I20260709 12:58:10.164142  3122 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.142059  3200 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.222080  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1249) took 1143 ms. Trace:
I20260709 12:58:10.232530  1603 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:10.196285  3060 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:10.220826  3156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.034s	sys 0.074s
I20260709 12:58:10.257977  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:10.259997  1676 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:10.265594  1672 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:10.276361  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.278074  1747 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:10.223915  2985 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.234514  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:10.293074  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:10.286089  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:10.325160  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.564s (SENT) [suppressed 6 similar messages]
W20260709 12:58:10.259013  3038 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.008s
I20260709 12:58:10.151739  3063 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:10.339725  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46795.3us
W20260709 12:58:10.342773  3259 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:58:10.356163  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:10.360311  1676 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:10.337002  2721 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.001s
W20260709 12:58:10.364698  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81041.4us
I20260709 12:58:10.280817  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.367830  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:10.343357  3073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.035s	sys 0.088s
I20260709 12:58:10.400940  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:10.288506  3015 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:10.406291  3073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.037s	sys 0.095s
I20260709 12:58:10.419121  1676 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:10.345153  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:10.336687  3158 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:10.353487  3142 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.382409  3264 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:10.444160  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1084) took 1038 ms. Trace:
I20260709 12:58:10.388437  3262 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.410040  3059 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.349704  3038 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.348817  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:10.423321  1594 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:10.566287  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.563412  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1081) took 1158 ms. Trace:
W20260709 12:58:10.447085  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.622393  1750 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
W20260709 12:58:10.562538  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.051s	sys 0.111s
W20260709 12:58:10.623587  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.053s	sys 0.111s
I20260709 12:58:10.599014  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.595666  1745 rpcz_store.cc:276] 0709 12:58:09.405937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.561242 (+155305us) service_pool.cc:224] Handling call
0709 12:58:09.566578 (+  5336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.566982 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.567013 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.567902 (+   889us) log.cc:844] Serialized 26 byte log entry
0709 12:58:09.907512 (+339610us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:09.907587 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.907689 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:10.443869 (+536180us) raft_consensus.cc:1685] finished
0709 12:58:10.443894 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.444071 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29420,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":8025,"spinlock_wait_cycles":5504,"thread_start_us":339194,"threads_started":1,"wal-append.queue_time_us":560850}
I20260709 12:58:10.599504  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.417773  2987 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.624567  1747 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
W20260709 12:58:10.437474  1596 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.810s	user 0.014s	sys 0.000s
I20260709 12:58:10.627068  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.634239   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:10.635146  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:10.448769  3252 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 12:58:10.469811  3028 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.001s
I20260709 12:58:10.431725  2628 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:10.578058  3146 tablet_copy_client.cc:538] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:58:10.486119  2945 consensus_meta.cc:287] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.034s	user 0.012s	sys 0.002s
I20260709 12:58:10.622267  1746 rpcz_store.cc:276] 0709 12:58:09.404964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.409903 (+  4939us) service_pool.cc:224] Handling call
0709 12:58:09.523768 (+113865us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:09.524030 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:09.524276 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:10.097217 (+572941us) log.cc:844] Serialized 14 byte log entry
0709 12:58:10.562956 (+465739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.563029 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:10.563083 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.563178 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.563318 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40427,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":30,"raft.queue_time_us":120,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":7353,"spinlock_wait_cycles":5565312,"thread_start_us":1021479,"threads_started":2}
W20260709 12:58:10.456573  3274 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:58:10.449360  3265 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:58:10.560493  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:10.581399  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:10.652571  3130 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.403210  2721 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.436175  3158 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.648885  1747 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:10.457226  3071 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 12:58:10.651894  1678 raft_consensus.cc:2368] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:10.463343  3199 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.472425  3122 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.593591  3015 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.538290  3224 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:10.689234  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.637780  1596 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:10.639600  2987 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.435920  3142 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.695802  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.656188  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.484689  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.669147  2628 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.623139  3059 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.732169  1749 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:10.683663  2965 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:10.738195  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.670437  2945 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.700469  3263 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.666990  3028 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:10.627017  3262 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.738201  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.682235  3130 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:10.646608  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1567112919999545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 12:58:10.732988  3199 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.739046  3063 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.735333  3105 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.696897  3071 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:10.765868  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 440681us
I20260709 12:58:10.741107  3156 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.746340  2628 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.774587  1676 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:10.748289  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 1072) took 1161 ms. Trace:
I20260709 12:58:10.778676  1751 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:10.739732  3224 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.789283  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:10.752213  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.804503  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.766683  3102 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:10.815191  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:10.791255  3121 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.920s	user 0.013s	sys 0.004s
I20260709 12:58:10.751427  2965 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:10.826093  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 249280us
I20260709 12:58:10.774046  3063 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.762379  3263 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.830858  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:10.819929  1599 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:10.773144  3199 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.785338  3156 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:10.827719  3166 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.012s	user 0.012s	sys 0.005s
W20260709 12:58:10.828058  3109 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.999s	user 0.016s	sys 0.000s
W20260709 12:58:10.846498  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 420854us
I20260709 12:58:10.788056  1596 rpcz_store.cc:276] 0709 12:58:09.576203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.576457 (+   254us) service_pool.cc:224] Handling call
0709 12:58:10.737034 (+1160577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.829075  3275 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:10.780804  3105 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:10.861636  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:10.834137  3160 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.865206  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.875206  1597 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:10.868589  1747 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:10.876587  3271 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:58:10.877286  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.827987  3121 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.850443  3038 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.827082  3102 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.854447  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.844249  3063 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:10.898948  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 109739us
I20260709 12:58:10.883351  3084 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:10.902114  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:10.905319  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.864543  3109 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.897672  3038 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.235257  1674 rpcz_store.cc:276] 0709 12:58:09.078687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.233791 (+155104us) service_pool.cc:224] Handling call
0709 12:58:09.237739 (+  3948us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:09.237973 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:09.238220 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:09.238514 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 12:58:10.221627 (+983113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.221699 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:10.221767 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.221861 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.222010 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":618,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":8831,"spinlock_wait_cycles":4851968,"thread_start_us":982694,"threads_started":1,"wal-append.queue_time_us":784901}
I20260709 12:58:10.900405  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:10.895270  3122 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.901816  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.904803  3084 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.883140  3160 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:10.934597  1670 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
W20260709 12:58:10.922302  3272 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.188s	user 0.000s	sys 0.002s
I20260709 12:58:10.879160  3275 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:10.936808  3294 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.913693  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.915506  3142 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:10.924062  3280 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:58:10.943838  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:10.924252  3015 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:10.915923  3158 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:10.914209  3290 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:10.935171  3287 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.935379  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.959146  1745 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:58:10.960610  3283 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:58:10.961145  3063 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.933951  3173 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:10.933490  3225 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.961686  3295 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:10.962633  3105 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:10.963721  3054 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:10.966359  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:10.961560  3160 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:10.967530  2966 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.969386  3199 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.001097  3290 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:10.941221  3130 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:10.972936  3284 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:58:10.973508  2985 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 12:58:10.947700  3122 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:10.974200  3281 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:58:10.943516  3291 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.046861  3291 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.041626  2966 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.049386  3291 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:10.934315  3289 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:11.049837  2966 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:10.951992  3278 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:58:11.030869  3173 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.050225  3289 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:10.912573  3038 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:10.976858  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:10.980782  3175 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.183s	user 0.014s	sys 0.000s
I20260709 12:58:10.941545  3084 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.944947  1599 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:11.055912  3289 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.056411  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.056684  3175 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.057178  1599 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:58:11.058346  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.058931  3175 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.991987  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1087) took 1347 ms. Trace:
I20260709 12:58:11.012612  3287 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.059659  1752 rpcz_store.cc:276] 0709 12:58:09.644447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.742837 (+ 98390us) service_pool.cc:224] Handling call
0709 12:58:09.743344 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.756214 (+ 12870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.756263 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.756905 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.120525 (+363620us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:10.121017 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.121820 (+   803us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:10.991683 (+869863us) raft_consensus.cc:1685] finished
0709 12:58:10.991717 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.991904 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69975,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"thread_start_us":322299,"threads_started":1,"wal-append.queue_time_us":852020}
I20260709 12:58:11.061712  3287 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.063359  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1085) took 1110 ms. Trace:
I20260709 12:58:11.064199  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.063911  1595 rpcz_store.cc:276] 0709 12:58:09.952715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.953996 (+  1281us) service_pool.cc:224] Handling call
0709 12:58:10.069851 (+115855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.139525 (+ 69674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.143912 (+  4387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.239759 (+ 95847us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.774060 (+534301us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:10.782898 (+  8838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.788162 (+  5264us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.063065 (+274903us) raft_consensus.cc:1685] finished
0709 12:58:11.063098 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.063271 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3754,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":14566,"thread_start_us":376185,"threads_started":1,"wal-append.queue_time_us":520554}
I20260709 12:58:11.066787  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.002511  2628 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.003957   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:11.003602  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 101565us
I20260709 12:58:10.983527  2945 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.000659  3121 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.944540  3293 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:10.988809  2965 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.990584  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:10.994264  3275 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.015393  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.104382  1598 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:11.106312  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 708) took 1143 ms. Trace:
I20260709 12:58:11.106652  1598 rpcz_store.cc:276] 0709 12:58:09.965969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.105358 (+1139389us) service_pool.cc:224] Handling call
0709 12:58:11.105742 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.105946 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.105973 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.106018 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:11.106047 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.106105 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.106248 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.984102  3109 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.954603  3294 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.098277  3291 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.108258  3291 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.017366  3285 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.020326  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:11.112031  1745 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.999449  3262 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:11.021929  3060 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.749s	user 0.005s	sys 0.009s
I20260709 12:58:11.024461  3263 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:11.008993  3138 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.955s	user 0.015s	sys 0.002s
I20260709 12:58:10.987011  3258 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:10.941699  3028 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:10.988443  3156 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.026939  3295 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:10.995041  3102 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.987468  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.151836  1596 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:10.989070  3224 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:10.990374  2987 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:11.041282  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115033us
I20260709 12:58:11.155689  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 718) took 1185 ms. Trace:
I20260709 12:58:11.156262  1594 rpcz_store.cc:276] 0709 12:58:09.970599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.990127 (+1019528us) service_pool.cc:224] Handling call
0709 12:58:11.155609 (+165482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:11.156598  3295 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.157013  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:11.157770  3034 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.158468  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:11.030467  3158 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.157866  1594 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:10.991214  3146 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:58:11.160509  3294 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.161072  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.161777  1602 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:11.162060  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 724) took 1189 ms. Trace:
I20260709 12:58:11.162340  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 714) took 1192 ms. Trace:
I20260709 12:58:11.033468  3225 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.146513  3060 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:11.164105  1749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1090) took 1518 ms (client timeout 1992 ms). Trace:
W20260709 12:58:11.164558  1749 rpcz_store.cc:269] 0709 12:58:09.645327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.658148 (+ 12821us) service_pool.cc:224] Handling call
0709 12:58:11.163844 (+1505696us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540013ae54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:11.164003 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385268608}
I20260709 12:58:11.165683  3225 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.043061  3290 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.149819  3138 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.052166  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 706) took 1090 ms. Trace:
I20260709 12:58:11.167922  1601 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:10.975766  3288 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:11.168505  3138 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.149772  3258 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.159348  3158 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.053339  3122 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.070464  3038 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.000798  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.084623  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:11.177145  1673 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:11.177953  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 93488.6us
I20260709 12:58:11.178853  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:11.091701  2628 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.093487  3173 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.097604  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.090814  3130 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.181650  3130 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.102926  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.183960  1599 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.110453  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.188892  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.190008  1678 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:11.191045  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.091325  3175 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:11.137014  3277 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.455s	user 0.000s	sys 0.003s
I20260709 12:58:11.139144  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 777) took 1008 ms. Trace:
I20260709 12:58:11.141194  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.141759  3300 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.191941  3175 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.142086  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1260) took 1228 ms. Trace:
I20260709 12:58:11.130044  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:11.144007  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.148353  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 773) took 1026 ms. Trace:
I20260709 12:58:11.149008  1597 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:11.153564  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1087) took 1190 ms. Trace:
I20260709 12:58:11.162788  1602 rpcz_store.cc:276] 0709 12:58:09.969445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.217005 (+247560us) service_pool.cc:224] Handling call
0709 12:58:11.160903 (+943898us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:58:11.162184 (+  1281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26303872}
I20260709 12:58:11.167745  1600 rpcz_store.cc:276] 0709 12:58:09.962166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.962286 (+   120us) service_pool.cc:224] Handling call
0709 12:58:09.962558 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.962919 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.962958 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.963461 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.624079 (+660618us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:10.624127 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.624212 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.051947 (+427735us) raft_consensus.cc:1685] finished
0709 12:58:11.051967 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.052098 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1208,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":48605,"thread_start_us":660233,"threads_started":1,"wal-append.queue_time_us":781989}
I20260709 12:58:11.172188  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:11.162603  1595 rpcz_store.cc:276] 0709 12:58:09.972440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.161064 (+1188624us) service_pool.cc:224] Handling call
0709 12:58:11.161452 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.161653 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.161683 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.161745 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:11.161780 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.161867 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.161994 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:11.127878  3285 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.246608  1745 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:11.198074  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:11.295490  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:11.275908  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:11.356743  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 158777us
I20260709 12:58:11.356752  1672 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:11.358232  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:11.358515  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.249226  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.360399  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:11.362242  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.363122  1678 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:11.363579  1672 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:11.301680  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 713) took 1332 ms. Trace:
I20260709 12:58:11.364720  1598 rpcz_store.cc:276] 0709 12:58:09.969138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.111230 (+1142092us) service_pool.cc:224] Handling call
0709 12:58:11.135126 (+ 23896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.135383 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:11.135911 (+   528us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.301162 (+165251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.301246 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:11.301312 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.301421 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.301595 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1023,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":58,"raft.queue_time_us":15721,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":164752,"threads_started":1}
I20260709 12:58:11.366811  1670 rpcz_store.cc:276] 0709 12:58:09.913284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.913436 (+   152us) service_pool.cc:224] Handling call
0709 12:58:11.141878 (+1228442us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540006de54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:11.142009 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345365760}
I20260709 12:58:11.355156  1603 rpcz_store.cc:276] 0709 12:58:09.962776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.964009 (+  1233us) service_pool.cc:224] Handling call
0709 12:58:10.210763 (+246754us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:10.210978 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.236698 (+ 25720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.153219 (+916521us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54000249d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:11.153482 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63086720}
W20260709 12:58:11.368971  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 238969us
I20260709 12:58:11.359489  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 721) took 1388 ms. Trace:
I20260709 12:58:11.371349  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.371706  1597 rpcz_store.cc:276] 0709 12:58:09.971452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.145611 (+1174159us) service_pool.cc:224] Handling call
0709 12:58:11.145875 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.359230 (+213355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.359429 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:11.373718  1603 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:11.373306  1670 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:58:11.165766  3060 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.199864  1674 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:11.374750  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 202631us
I20260709 12:58:11.380779  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:11.381819  1672 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:11.360046  1676 rpcz_store.cc:276] 0709 12:58:10.121994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.420810 (+298816us) service_pool.cc:224] Handling call
0709 12:58:10.429636 (+  8826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.782524 (+352888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.144707 (+362183us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002571d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:11.148279 (+  3572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792586496}
I20260709 12:58:11.376175  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:11.377451  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:11.389328  1674 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:58:11.340893  3248 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.271s	user 0.005s	sys 0.005s
I20260709 12:58:11.392647  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.395656  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.172891  3275 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:11.394797  1678 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:11.401319  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:11.335145  1601 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:11.404458  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:11.407085  1566 leader_election.cc:400] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:11.404858  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:11.176862  3015 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:11.409581  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:11.273022  3293 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:11.319454  3138 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.324609  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.232074  3262 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:11.412504  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 774) took 1286 ms. Trace:
I20260709 12:58:11.412748  3299 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:11.374274  3295 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:11.265949  3258 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.265250  3158 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.158459  3034 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.377188  3270 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:11.378825  3226 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:11.406500  3027 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:11.193827  3084 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.404458  2951 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:11.264079  3294 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 12:58:11.410043  3199 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:11.432417  3275 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.435678  3073 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.468325  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83499.5us
I20260709 12:58:11.413699  3102 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:58:11.435793  3130 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.436067  3122 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.444056  3299 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.476826  3301 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:11.430711  3138 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.457870  3258 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.376932  3300 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.464402  3202 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.468988  2951 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.478024  3299 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:11.488276  3276 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.742s	user 0.005s	sys 0.000s
I20260709 12:58:11.489514  3285 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:11.489915  3256 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.807s	user 0.003s	sys 0.000s
I20260709 12:58:11.497656  3300 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.478381  3275 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.482790  3258 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.505663  3258 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.505663  3275 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.510319  3290 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.542253  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 728) took 1260 ms. Trace:
I20260709 12:58:11.418246  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:11.545262  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 126929us
I20260709 12:58:11.547049  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 733) took 1138 ms. Trace:
I20260709 12:58:11.547703  1601 rpcz_store.cc:276] 0709 12:58:10.409048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.334398 (+925350us) service_pool.cc:224] Handling call
0709 12:58:11.334798 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.429493 (+ 94695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.546765 (+117272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:11.543617  1596 rpcz_store.cc:276] 0709 12:58:10.281908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.152627 (+870719us) service_pool.cc:224] Handling call
0709 12:58:11.153014 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.153243 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:11.153619 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.540582 (+386963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.540792 (+   210us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:11.540972 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.541240 (+   268us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.541755 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22503,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"thread_start_us":385682,"threads_started":1,"wal-append.queue_time_us":328483}
W20260709 12:58:11.554167  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 119006us
I20260709 12:58:11.192131  1675 rpcz_store.cc:276] 0709 12:58:10.130382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.752033 (+621651us) service_pool.cc:224] Handling call
0709 12:58:10.783420 (+ 31387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.888757 (+105337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.890618 (+  1861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.896528 (+  5910us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:10.897948 (+  1420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.138779 (+240831us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b54003e71d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:11.138858 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.139050 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214251776}
I20260709 12:58:11.461086  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:11.557485  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 96322.3us
I20260709 12:58:11.484450  2951 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.562642  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1080) took 2158 ms. Trace:
I20260709 12:58:11.563207  1748 rpcz_store.cc:276] 0709 12:58:09.404452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.404614 (+   162us) service_pool.cc:224] Handling call
0709 12:58:09.511223 (+106609us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:09.511587 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.513321 (+  1734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.513378 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.514080 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 12:58:09.963819 (+449739us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:09.963856 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.963920 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.489278 (+1525358us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:11.561900 (+ 72622us) raft_consensus.cc:1685] finished
0709 12:58:11.561949 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.562363 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1128,"raft.queue_time_us":6506,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":38128384,"thread_start_us":449315,"threads_started":1,"wal-append.queue_time_us":1106110}
I20260709 12:58:11.567221  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 760) took 2614 ms. Trace:
I20260709 12:58:11.567843  1677 rpcz_store.cc:276] 0709 12:58:08.952681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.224913 (+272232us) service_pool.cc:224] Handling call
0709 12:58:09.225232 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.225662 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:58:09.225694 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.226189 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:58:09.607759 (+381570us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:09.607806 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.607897 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.340182 (+1732285us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:11.566453 (+226271us) raft_consensus.cc:1685] finished
0709 12:58:11.566515 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.566957 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11425,"raft.queue_time_us":1091,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":3516,"spinlock_wait_cycles":38179200,"thread_start_us":381173,"threads_started":1,"wal-append.queue_time_us":722983}
I20260709 12:58:11.484426  3202 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.577414  3063 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.578425  3122 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:11.559055  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:11.480306  3073 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.577101  3054 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:11.581278  3175 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.581542  3130 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.582051  3202 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.582291  3175 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.432075  1671 rpcz_store.cc:276] 0709 12:58:10.126040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.578564 (+452524us) service_pool.cc:224] Handling call
0709 12:58:10.652101 (+ 73537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.683177 (+ 31076us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:10.746042 (+ 62865us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.072552 (+326510us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b18003414a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 12:58:11.411957 (+339405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.412038 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:11.412094 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.412211 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.412438 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21185,"prepare.queue_time_us":38695,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":1828,"raft.queue_time_us":32942,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":9546112,"thread_start_us":301192,"threads_started":1,"wal-append.queue_time_us":674562}
I20260709 12:58:11.582840  3130 consensus_queue.cc:1243] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:58:11.583323  3059 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.582115  3084 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.579103  3122 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.603117  3122 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:11.593451  3109 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:11.489549  3138 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.512929  3299 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:11.605764  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47069us
I20260709 12:58:11.642648  3291 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.599092  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:11.640547  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53422.6us
I20260709 12:58:11.638742  3300 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.652361  3300 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.645921  3295 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:11.647393  3269 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.363s	user 0.000s	sys 0.004s
I20260709 12:58:11.592656  2985 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:11.648414  3165 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:11.649798  2721 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.650511  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:11.578621  3063 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.659472  3287 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:11.583189  3175 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.665985  3287 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:11.666224  3063 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.667018  3300 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.669535  3293 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.656586  3295 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:11.657619  2985 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.672881  3073 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.674144  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1259) took 1763 ms. Trace:
I20260709 12:58:11.675356  3034 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:11.676947  3071 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.680222  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1287) took 2295 ms. Trace:
I20260709 12:58:11.679342  2721 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.636554  3109 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:11.658756  3165 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.703800  3165 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.704247  1675 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:11.706336  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.684110  3287 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:11.704282  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.689153  1673 rpcz_store.cc:276] 0709 12:58:09.910380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.910533 (+   153us) service_pool.cc:224] Handling call
0709 12:58:09.911129 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.177566 (+1266437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.673422 (+495856us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400194e54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:11.673852 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897596800}
I20260709 12:58:11.708834  3287 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.710322  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.693552  3295 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.695204  3293 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:11.696849  1743 rpcz_store.cc:276] 0709 12:58:09.384929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.387575 (+  2646us) service_pool.cc:224] Handling call
0709 12:58:09.548664 (+161089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.218006 (+669342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.130731 (+912725us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54000d4b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:11.679722 (+548991us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000d4b50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:11.680003 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475255296}
I20260709 12:58:11.701099  1669 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:58:11.701920  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.702546  3290 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.695837  2985 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:11.710686  3287 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:11.693197  3175 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.719213  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:11.719365  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:11.715823  1669 pending_rounds.cc:85] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 2
I20260709 12:58:11.720360  1669 pending_rounds.cc:107] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:11.720705  1669 raft_consensus.cc:2889] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:11.721371  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.721998  3295 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.722311  1752 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:11.723203  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.725101  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.714713  3293 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:11.736485  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:11.736670  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.737670  1748 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:11.739790  3299 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.726218  2721 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.749642  1744 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:11.759232  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:11.762712  2721 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.765491  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.752849  3060 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:11.752758  2565 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.739048  3293 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:11.777329  3264 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:11.778455  3166 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.779806  3060 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.768313  3122 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.782861  3122 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.782989  3060 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.789690  2565 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.792901  2565 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.794231  3166 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.797502  2721 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:11.802007  2721 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:11.803323  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:11.804108  2721 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.808055  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.809208  1600 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.810052  2721 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.813690  3109 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.815130  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.815963  3109 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.818331  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.806175  3293 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.827732  3285 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:11.828876  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.828723  3285 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:58:11.815208  3317 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.121s	user 0.003s	sys 0.001s
I20260709 12:58:11.845160  3054 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:11.845712  3054 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:11.846161  3054 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:11.849067  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45856.3us
I20260709 12:58:11.855683  3299 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.857162  3122 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:11.857676  3122 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:11.859081  3122 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.861153  3285 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:11.866436  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 72) took 8786 ms. Trace:
W20260709 12:58:11.777405  1594 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.007s
I20260709 12:58:11.807617  1744 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:11.930143  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:11.804746  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 116711us
W20260709 12:58:11.819592  1599 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.543s	user 0.016s	sys 0.007s
I20260709 12:58:11.934170  1599 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:11.928149  1497 rpcz_store.cc:276] 0709 12:58:03.079504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.079817 (+   313us) service_pool.cc:224] Handling call
0709 12:58:11.866116 (+8786299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:09.395946 (+     0us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f947e3830ac 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484ec216c
0709 12:58:09.639527 (+243581us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:09.708701 (+ 69174us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:09.708741 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:58:09.708758 (+    17us) tablet.cc:662] Decoding operations
0709 12:58:09.709211 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:09.709295 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:09.709342 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:09.709644 (+   302us) tablet.cc:701] Row locks acquired
0709 12:58:09.709672 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:58:09.709894 (+   222us) write_op.cc:270] Start()
0709 12:58:09.715163 (+  5269us) write_op.cc:276] Timestamp: P: 1783601889709825 usec, L: 0
0709 12:58:09.715213 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:58:09.853842 (+138629us) log.cc:844] Serialized 535 byte log entry
0709 12:58:11.234969 (+1381127us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:11.513599 (+278630us) op_driver.cc:464] REPLICATION: finished
0709 12:58:11.611918 (+ 98319us) write_op.cc:301] APPLY: starting
0709 12:58:11.661557 (+ 49639us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:11.687725 (+ 26168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:11.694987 (+  7262us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:11.695506 (+   519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:11.715069 (+ 19563us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:11.723938 (+  8869us) write_op.cc:312] APPLY: finished
0709 12:58:11.801088 (+ 77150us) log.cc:844] Serialized 22 byte log entry
0709 12:58:11.829390 (+ 28302us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:11.829531 (+   141us) write_op.cc:454] Released schema lock
0709 12:58:11.829602 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:11.874862 (+ 45260us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:11.874908 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1024891,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":97795,"apply.run_cpu_time_us":7510,"apply.run_wall_time_us":262997,"num_ops":1,"prepare.queue_time_us":217481,"prepare.run_cpu_time_us":27646,"prepare.run_wall_time_us":599668,"raft.queue_time_us":23764,"raft.run_cpu_time_us":1666,"raft.run_wall_time_us":83610,"replication_time_us":1798184,"spinlock_wait_cycles":40577152,"thread_start_us":478548,"threads_started":4,"wal-append.queue_time_us":751966}]]}
I20260709 12:58:11.873420  2985 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.877128  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.878651  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.880581  1598 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:11.784466  2951 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:11.889881  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.897926  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.898203  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:11.898654  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.898229  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.899461  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:11.896415  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44608.2us
I20260709 12:58:11.901176  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.902391  3122 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:11.949774  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.902514  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:11.887269  3165 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.952329  1602 raft_consensus.cc:2368] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5.
I20260709 12:58:11.954447  3165 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:11.906770  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.911619  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.913280  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:11.956404  1601 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:11.914588  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:11.921944  3146 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260709 12:58:11.958200  2985 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:11.959281  3146 tablet_bootstrap.cc:492] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:58:11.924817  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.929033  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.960598  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:11.960865  1747 raft_consensus.cc:2410] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:11.935497  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.806320  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:11.948520  1595 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:11.961759  2951 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:11.961973  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 155819us
I20260709 12:58:11.962536  3158 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:11.963032  3158 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:11.949357  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.963363  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:11.963943  1744 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:11.968775  3146 ts_tablet_manager.cc:1403] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.978s	user 0.056s	sys 0.037s
I20260709 12:58:11.967914  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:11.969458  2721 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.969714  1596 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:11.963474  3158 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:11.973615  3073 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:11.974061  1496 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:11.935379  3054 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:11.979746  1597 raft_consensus.cc:2410] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:58:11.981524  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48144.5us
I20260709 12:58:11.990572  1748 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:11.991008  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:11.991452  3275 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:11.992331  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:11.991003  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:11.997040  2317 raft_consensus.cc:2368] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4.
I20260709 12:58:11.995798  3275 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:11.992148  3073 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:58:12.002038  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.013505  1749 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:12.013131  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.020241  1747 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:12.021047  3275 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.000203  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55876 (request call id 4) took 17851 ms. Trace:
I20260709 12:58:12.022719  3275 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:12.022604  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.998991  1669 raft_consensus.cc:606] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:12.033903  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.031303  3109 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:12.030149  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:12.041528  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:12.041883  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56443.2us
I20260709 12:58:12.042753  1595 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:12.023736  1594 rpcz_store.cc:276] 0709 12:57:54.147467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.159926 (+ 12459us) service_pool.cc:224] Handling call
0709 12:57:54.232004 (+ 72078us) log.cc:844] Serialized 506 byte log entry
0709 12:58:11.998303 (+17766299us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":185,"raft.queue_time_us":225960,"raft.run_cpu_time_us":2360,"raft.run_wall_time_us":56660,"thread_start_us":312738,"threads_started":3,"wal-append.queue_time_us":166779,"wal-append.run_cpu_time_us":2499,"wal-append.run_wall_time_us":1134955}
I20260709 12:58:12.043283  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.043818  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.043366  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.047113  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:12.058200  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 729) took 1767 ms. Trace:
I20260709 12:58:12.059748  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.060746  1669 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.061671  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.062441  1750 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.061678  3054 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.059787  1598 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:12.064337  3166 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:12.064379  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.064913  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.065425  1751 raft_consensus.cc:2368] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:12.065717  2317 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:12.066828  1597 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:12.067483  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.068259  1743 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:12.068121  1496 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:12.069224  3264 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:12.069739  3264 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.070158  3264 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.070034  1496 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:12.070793  1671 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:12.071904  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.072377  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.072981  1747 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.077811  1599 raft_consensus.cc:2410] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:12.060115  1594 rpcz_store.cc:276] 0709 12:58:10.290701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.157103 (+866402us) service_pool.cc:224] Handling call
0709 12:58:11.157467 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.157707 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:11.929900 (+772193us) log.cc:844] Serialized 14 byte log entry
0709 12:58:12.057366 (+127466us) log.cc:844] Serialized 14 byte log entry
0709 12:58:12.057628 (+   262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:12.057702 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:12.057770 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.057863 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.058099 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1586,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":7197,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":11040,"thread_start_us":60020,"threads_started":1,"wal-append.queue_time_us":98804}
W20260709 12:58:12.078847  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 51801.7us
W20260709 12:58:12.090931  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47759.1us
I20260709 12:58:12.045269  3109 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:12.100806  1669 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:12.107199  3109 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.112548  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:12.113818  2951 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:12.114501  2951 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:12.120079  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.095494  3285 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:12.123845  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.123845  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.126271  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.126190  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.132090  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.130824  1751 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:12.123432  3285 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.080780  3146 raft_consensus.cc:359] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.141106  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.143863  2565 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:12.144610  2565 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.144882  2565 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.145802  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.142766  3285 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.149134  1746 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:12.153928  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.157508  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.155913  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.138440  2951 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:12.160459  1746 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.165503  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.178905  2317 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:12.138957  1496 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:12.161549  1743 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:12.185165  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.200073  3084 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:12.203264  3084 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.214601  1747 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:12.186486  3158 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.207509  3146 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:58:12.225180  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.233768  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.233672  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.235339  1752 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.235378  1747 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:12.239503  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.237708  3084 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:12.242298  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94790.1us
I20260709 12:58:12.233729  2628 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:58:12.228159  3034 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:12.246181  1596 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:12.247363  1745 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:12.268944  1750 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:12.274274  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.262291  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.259483  3034 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.262688  3084 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:58:12.299237  1496 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:12.261775  3146 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:58:12.329330  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.336169  2565 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:12.337240  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 100007us
I20260709 12:58:12.341569  2565 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.338826  3084 raft_consensus.cc:993] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:58:12.349368  3158 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:12.353588  3084 raft_consensus.cc:1081] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:58:12.368299  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.369280  1744 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.365509  3331 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:12.372535  3331 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:12.377298  3331 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.378765  3331 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:12.344154  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.380250  1671 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:12.349442  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.352814  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.364856  3034 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:12.354457  1752 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:12.389024  3175 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:12.395617  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.395952  3175 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:12.393043  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 84900.2us
I20260709 12:58:12.358559  3146 ts_tablet_manager.cc:1434] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.378s	user 0.013s	sys 0.000s
I20260709 12:58:12.410454  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.410055  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.367664  3285 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.415349  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.409781  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.402158  3054 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:12.402266  3293 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.421437  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.422410  1597 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.422978  1599 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:12.424029  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.423827  3054 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:12.426587  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:12.426795  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.427168  2317 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:58:12.427976  3054 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.427862  3293 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.409852  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.432204  1746 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:12.435966  1670 raft_consensus.cc:2368] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:12.412179  3299 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:12.437014  1677 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:58:12.443508  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.448774  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.453418  1597 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:12.461695  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.462627  1598 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:12.462941  3285 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.464002  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.465155  3293 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.444180  3175 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:12.465734  3299 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.476743  1672 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:12.476855  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.479748  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.482612  3299 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.470880  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.488241  1594 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.497102  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.498051  1599 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:12.501143  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.501888  1598 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:12.502107  1597 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:12.487867  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.504630  1595 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:12.504988  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.505899  1600 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:12.504654  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.507473  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.512377  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.513572  1599 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:12.487502  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.519138  1594 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:12.518999  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.520113  1600 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.523655  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.524874  1594 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:12.530040  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.530961  1594 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:12.528046  3331 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:12.487363  3264 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:12.535948  3331 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:12.534813  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:12.537454  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 117326us
I20260709 12:58:12.538570  2314 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:12.541613  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.542867  1641 leader_election.cc:400] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5.
I20260709 12:58:12.543219  1641 leader_election.cc:403] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:58:12.545591  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:12.553979  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.555572  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.554896  3084 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.549223  3331 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.564646  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.574270  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:12.575093  1594 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:12.572110  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.576586  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.577423  3338 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:12.578521  3264 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.579278  3034 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:12.579672  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.580284  1746 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.577841  3338 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.588030  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.577570  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.589303  1746 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:12.589859  3336 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:12.590323  3336 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:12.590708  3336 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.590694  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:12.578497  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:12.591998  3264 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:12.592597  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:12.592792  3264 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:12.593616  3158 raft_consensus.cc:2764] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:12.588477  3338 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.577665  3138 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:12.599902  3331 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:12.600672  3166 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.600895  3331 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:12.601315  3331 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:12.601617  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.602375  1596 raft_consensus.cc:2368] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5.
I20260709 12:58:12.602133  3331 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.602723  3084 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5.
I20260709 12:58:12.593946  3264 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:12.597330  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.596712  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.600164  3138 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:12.606487  1594 raft_consensus.cc:2368] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:12.590632  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.607380  3138 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.607992  3084 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:12.608147  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.608616  3084 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:12.609136  3084 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.609335  3285 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:12.610042  3285 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.610422  3285 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.608290  3331 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.612920  3336 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.608059  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:12.621958  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.625905  3175 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.625999  3166 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:12.628099  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.628348  3336 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.628250  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:12.629117  3175 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.630403  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.631975  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:12.633100  3175 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:12.633530  3175 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:12.633916  3175 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.635418  2565 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:12.636037  2565 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:12.636739  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.636878  2565 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.637436  1752 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:12.637629  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.638363  1596 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:12.639415  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.639613  3034 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:12.643584  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.647042  3073 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:12.654270  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.662065  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.662241  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.663260  1594 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:12.668594  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.672881  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.673158  1597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:58:12.674564  1597 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:12.674943  1597 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.677723  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.678501  1598 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.684249  1597 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.652220  3285 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.695355  1597 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:12.697561  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 43731.3us
W20260709 12:58:12.697592  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71466.3us
I20260709 12:58:12.689906  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.702780  1596 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:12.703822  1598 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:12.706035  1752 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:58:12.708428  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.711521  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.712205  1751 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.714910  3285 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.717746  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.730513  1670 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:12.732227  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.738698  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.741057  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.742336  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.742812  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.732180  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:12.743645  1672 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.738770  2314 pending_rounds.cc:85] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 2
I20260709 12:58:12.753578  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.751070  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.755316  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.750769  2314 pending_rounds.cc:107] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:58:12.759047  2314 raft_consensus.cc:2889] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:12.760490  2314 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:12.762192  2317 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:12.767992  3344 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.219s	user 0.005s	sys 0.000s
I20260709 12:58:12.768986  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.769860  1670 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.735620  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.750886  1671 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:12.776315  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44217.4us
I20260709 12:58:12.779273  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.780776  1715 leader_election.cc:400] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:12.781172  1715 leader_election.cc:403] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:12.781765  3073 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:12.785012  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.785619  1612 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-516703d5c9f14537854665616191b5aa received from {username='slave'} at 127.0.0.1:55880
I20260709 12:58:12.786165  1612 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-516703d5c9f14537854665616191b5aa on tablet 516703d5c9f14537854665616191b5aa with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:12.785033  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:12.788028  1601 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:12.788095  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.788878  1596 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.790270  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.790390  3338 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.792001  1678 raft_consensus.cc:2368] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:12.753350  3158 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.792028  3293 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.749007  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.793892  1669 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.795346  3338 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.797253  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:12.800794  1672 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:12.798486  1596 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:12.801337  1669 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:12.803064  3291 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:58:12.805039  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.805280  3175 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:12.795393  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.774922  3084 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.812106  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.815471  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.816242  3034 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:12.817549  2721 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:12.817971  2721 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:12.819060  2721 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.820936  2721 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.824355  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.841593  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.842777  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.828645  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.843740  1671 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 12:58:12.844857  3352 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:12.830000  3293 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.829376  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.830768  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.832765  3084 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:12.837838  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.839671  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.854171  3299 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.854976  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.840121  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:12.845273  1670 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:12.856204  3299 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:12.846122  1672 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:12.858300  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.850975  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:12.859339  1678 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.860283  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.861493  3295 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:12.862836  3295 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:12.863855  3054 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:12.864542  3054 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:12.865478  3054 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:12.863814  3295 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.815883  1751 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:12.882244  1676 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:12.882045  1678 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:12.883682  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 101787us
I20260709 12:58:12.885807  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:12.892625  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.896991  1677 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:12.898402  1751 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:12.899945  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.887853  3054 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.912005  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.916025  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:12.930382  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:12.931818  1751 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:12.934811  1566 leader_election.cc:400] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:12.935688  1566 leader_election.cc:403] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:12.897765  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.938410  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:12.943954  1748 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.918279  3034 raft_consensus.cc:2764] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 12:58:12.953439  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67694.5us
I20260709 12:58:12.953735  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:12.956877  1749 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:12.959115  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:12.959575  1748 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:12.960105  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.948374  3175 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:12.964761  3122 raft_consensus.cc:2764] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:12.954576  3295 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
W20260709 12:58:12.969352  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.967054  2951 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.975502  3360 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:12.977357  3336 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.979079  2721 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:12.954520  3338 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:58:12.979756  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:12.979534  2721 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:12.986106  2721 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:13.002714  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.008242  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 2 to 3, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:13.011565  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 2 to 4, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:13.015868  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55815.3us
I20260709 12:58:13.017194  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.025677  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.027074  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:13.024484  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44833.2us
I20260709 12:58:13.034060  2951 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.015110  1501 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 2 to 3, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:13.035061  3299 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:13.035564  3299 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:13.035979  3299 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:13.018564  3338 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.041142  3331 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.043996  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.047132  3338 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.051236  3054 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:13.052050  3054 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:13.055142  3054 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:13.063776  3073 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.064797  3073 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.069180  3073 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:13.073657  2951 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:58:13.081633  3293 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.088061  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.072751  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 160) took 7213 ms. Trace:
I20260709 12:58:13.093681  1496 rpcz_store.cc:276] 0709 12:58:05.859343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.872595 (+ 13252us) service_pool.cc:224] Handling call
0709 12:58:13.072629 (+7200034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:12.528130 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:12.564280 (+ 36150us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:12.567847 (+  3567us) write_op.cc:435] Acquired schema lock
0709 12:58:12.568829 (+   982us) tablet.cc:662] Decoding operations
0709 12:58:12.570794 (+  1965us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:12.570917 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:12.570950 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:12.571642 (+   692us) tablet.cc:701] Row locks acquired
0709 12:58:12.571714 (+    72us) write_op.cc:260] PREPARE: finished
0709 12:58:12.573820 (+  2106us) write_op.cc:270] Start()
0709 12:58:12.574000 (+   180us) write_op.cc:276] Timestamp: P: 1783601892573741 usec, L: 0
0709 12:58:12.574021 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:12.591836 (+ 17815us) log.cc:844] Serialized 2344 byte log entry
0709 12:58:12.737573 (+145737us) op_driver.cc:464] REPLICATION: finished
0709 12:58:12.958863 (+221290us) write_op.cc:301] APPLY: starting
0709 12:58:12.962291 (+  3428us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:12.964353 (+  2062us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:12.964519 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:12.970842 (+  6323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:12.980260 (+  9418us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:12.980326 (+    66us) write_op.cc:312] APPLY: finished
0709 12:58:12.981953 (+  1627us) log.cc:844] Serialized 46 byte log entry
0709 12:58:12.983412 (+  1459us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.983716 (+   304us) write_op.cc:454] Released schema lock
0709 12:58:12.983785 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:12.984238 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.984269 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":207980,"apply.run_cpu_time_us":3758,"apply.run_wall_time_us":29444,"num_ops":5,"prepare.queue_time_us":89593,"prepare.run_cpu_time_us":4814,"prepare.run_wall_time_us":70310,"replication_time_us":154439,"thread_start_us":79473,"threads_started":2}]]}
I20260709 12:58:13.098181  3338 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:13.096858  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 129296us
I20260709 12:58:13.099709  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.102331  1497 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:13.104573  3338 raft_consensus.cc:2764] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:13.106038  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.105967  1497 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.106981  3338 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.107797  1497 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.104535  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.109076  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.109956  3338 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.109823  1497 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.110558  3293 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.111671  1497 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } }
I20260709 12:58:13.116853  1497 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.119016  1497 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.113595  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.124150  3338 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:13.124719  3338 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:13.125756  3338 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:13.130203  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 171882us
I20260709 12:58:13.131279  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.135106  2721 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:13.136811  3054 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:13.137254  3054 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:13.137302  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.137775  3054 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.138803  3295 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:13.139200  3295 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.139532  3295 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.146386  3054 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.130873  1497 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 4, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.148069  3295 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.149142  3054 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.134879  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.148609  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:13.153515  1497 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.155253  1677 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:13.155766  2721 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:13.150359  3295 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.156304  2721 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:13.155397  1497 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:13.157760  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.158560  2721 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.159370  1497 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.161351  1497 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:13.163460  1497 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:13.166754  1497 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.168797  1497 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 2 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.151796  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.171366  3054 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:13.171795  3054 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:13.172154  3054 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.172382  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.108307  1744 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:13.173823  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.174947  3338 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:13.175416  3338 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.175819  3338 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.178145  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:13.185889  3295 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:13.185881  3122 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:13.123297  3299 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.189004  3293 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:13.188505  3122 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:13.190335  3175 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:13.190929  3175 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:13.190368  3122 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.191632  3299 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.181676  3054 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.191810  3175 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.170588  1497 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:58:13.176477  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.202373  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.202520  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 1 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.204406  1497 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 2, term changed from 3 to 4, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:13.201043  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.214638  1497 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:13.185789  3338 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.201030  3295 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:13.228297  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.220096  3360 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.237272  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:13.238484  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:13.238893  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.229295  3175 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.230152  3054 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.235965  3299 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:13.251717  3374 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:13.252370  3353 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.252676  3374 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:13.248314  3331 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:13.254722  3299 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:13.254253  3374 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.250211  2721 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:13.262754  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.264804  3338 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.257679  3331 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:13.266155  3331 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.241185  3336 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:58:13.275678  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.251356  3359 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:58:13.278805  1641 leader_election.cc:400] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4.
W20260709 12:58:13.280387  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52148.1us
I20260709 12:58:13.261262  2721 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:13.282239  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:13.282392  2721 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.282959  1597 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:13.283890  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:13.284052  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:13.284482  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:13.284889  1598 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:13.285265  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:13.290551  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.277652  3362 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:13.291921  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:13.292995  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:13.294041  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:13.294402  1641 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0193c6e20d1c4a33997d268895b8c083. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:13.295457  1597 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:13.296634  1602 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:13.297186  1744 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:13.297932  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:13.298667  1602 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:13.298748  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.299237  1596 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:13.299367  1744 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.301385  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.304512  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:13.303333  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:13.310041  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.306977  3359 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.312326  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.313117  1743 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.313431  1603 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:13.315637  3293 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.316267  3293 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:13.299445  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:13.319175  3360 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.312857  3362 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.319664  1594 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:13.320192  3362 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:13.322907  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.255950  3299 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.324604  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.325560  3166 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.326424  3166 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.280782  3295 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.331743  3175 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.332374  3175 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.332866  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:13.334630  3175 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.333493  1599 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:13.333038  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:13.336160  1597 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.318656  3293 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:13.337622  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:13.338600  1599 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.351226  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.355022  1600 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:13.357512  2721 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:13.358939  1749 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.364459  1602 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.364882  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:13.366649  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:13.367417  1598 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.368700  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:13.369026  1596 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:13.368721  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.369414  1603 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.371961  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.373312  1600 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:13.373795  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:13.376446  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48953.4us
I20260709 12:58:13.375748  1597 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:13.380565  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.388746  1750 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:13.394841  2721 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:13.401348  1599 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:13.404294  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.381753  1746 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:13.407418  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.411427  1752 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 2
I20260709 12:58:13.411890  1752 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:13.412178  1752 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:13.414935  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.420289  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.421928  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.373417  1743 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:13.423763  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:13.424435  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.424866  1750 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.390105  3338 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:13.426741  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 53444.8us
I20260709 12:58:13.426540  2721 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.428124  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:13.439193  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.442610  1748 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:13.414325  3291 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.447795  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:13.408767  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:13.457737  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.382397  3290 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:58:13.426102  3362 raft_consensus.cc:2764] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:58:13.441123  3084 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:13.419350  1744 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:13.424417  3331 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.424211  3375 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:13.471728  1750 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:13.493047  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 66975us
I20260709 12:58:13.477792  3084 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:13.509536  3375 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.479169  3293 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.480327  3166 raft_consensus.cc:2764] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:13.449435  3338 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:13.561403  3358 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.631558  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.478456  2951 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.460007  1669 raft_consensus.cc:606] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.634742  3109 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.637470  1603 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:13.468899  3353 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:13.648221  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.692767  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:13.652480  3299 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:13.652709  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 228318us
I20260709 12:58:13.693636  1746 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:13.668645  3084 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:13.676349  3380 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.197s	user 0.001s	sys 0.008s
I20260709 12:58:13.689741  2721 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.685133  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:13.705677  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74301.1us
I20260709 12:58:13.710569  1751 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
W20260709 12:58:13.712152  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 284170us
I20260709 12:58:13.682780  3138 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:13.718004  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 69925.8us
I20260709 12:58:13.709282  3293 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.720098  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.723466  1748 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:58:13.728369  3276 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:58:13.720930  2951 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:13.756917  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.689222  3358 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.708585  3109 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.765456  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.715266  3299 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:13.779017  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 84736.2us
I20260709 12:58:13.756148  3331 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:13.784795  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.723629  3138 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.770514  3359 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.773526  3175 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:13.817544  3375 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.780334  3374 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.799185  3331 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:13.856586  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91229.9us
I20260709 12:58:13.857753  1566 leader_election.cc:400] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:13.858091  1566 leader_election.cc:403] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:13.863668  3358 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:13.867934  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 147904us
I20260709 12:58:13.868908  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.876792  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.877764  3175 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:13.878384  3295 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.877843  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:13.879894  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:13.880782  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 89977.6us
I20260709 12:58:13.871229  3299 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.873698  3374 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:13.885687  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.885501  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.891131  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.879309  3109 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.879136  3358 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.893244  3359 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.888813  3395 raft_consensus.cc:2764] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:13.894007  3392 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:58:13.884784  3375 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.905970  3338 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.903754  3138 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:13.886380  3360 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.565s	user 0.019s	sys 0.003s
I20260709 12:58:13.917536  3331 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:13.919097  3360 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.921082  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:13.928393  2951 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:13.932919  3293 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:13.899708  3175 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.896836  3374 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:13.942822  3109 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:13.944942  3109 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:13.945443  3109 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:13.887431  3393 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.947664  3109 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.949255  3109 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:13.899864  1715 leader_election.cc:400] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5.
I20260709 12:58:13.941329  3392 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:13.941644  3264 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:13.950803  3264 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:13.951167  1746 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.952006  3264 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:13.954358  3338 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:13.954733  3264 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.954783  3338 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:13.956037  3338 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.957278  3084 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:13.957732  3338 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.952023  3382 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:13.965232  3353 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:13.966852  3353 raft_consensus.cc:993] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:58:13.967360  3138 raft_consensus.cc:1081] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:58:13.970014  3382 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:58:13.974224  3084 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:13.975353  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81685.5us
I20260709 12:58:13.976603  1715 leader_election.cc:400] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3.
I20260709 12:58:13.977802  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:13.979413  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:13.979760  3392 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:58:13.987915  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:13.988428  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67451.2us
I20260709 12:58:13.986442  3360 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:13.990407  3360 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:13.990808  3360 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:14.000319  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.000375  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:13.985656  3166 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:14.002533  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:14.000161  3397 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:14.005949  3397 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:14.002383  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:13.988324  3295 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:14.011189  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.011905  1677 raft_consensus.cc:2376] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5. Re-sending same reply.
I20260709 12:58:14.017297  1745 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:14.019685  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.020792  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.024482  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.027880  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.016050  3398 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:14.029804  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.029975  3398 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:14.030920  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.031224  3398 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.032614  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.033289  1672 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:14.018625  3396 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:14.028693  1752 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:14.035370  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.036458  1671 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:14.036550  3084 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:14.036990  3084 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:14.004891  3331 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:14.015812  3362 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.000653  3138 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:58:14.038254  3084 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:14.040850  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.041150  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.041834  1676 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:14.042202  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.044000  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.045691  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.045692  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.046559  1675 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:14.046445  3360 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.031925  1669 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:14.050879  1674 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:14.051921  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.053014  3397 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.053308  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.054674  1674 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:14.054047  1675 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:14.052016  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.056334  1669 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:14.002995  3353 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:58:14.063822  3396 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:14.063908  3084 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:14.065056  3396 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.066682  1672 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:14.067353  3331 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:14.068598  3331 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.073601  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.074088  3138 consensus_queue.cc:1243] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:58:14.051819  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62848.2us
I20260709 12:58:14.078548  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:14.087486  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:14.095348  1745 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:14.100207  1595 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:14.100134  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 70633.4us
I20260709 12:58:14.100824  1603 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:14.102535  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.103506  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.103928  1751 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:14.105168  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:14.106040  1596 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:14.109568  1598 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:14.111246  1677 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:14.111708  1677 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:14.102902  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:14.113562  1602 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:14.093179  3166 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:14.117583  1670 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:14.117754  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.120128  1748 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:14.117214  1677 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.124017  1677 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:14.126065  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47615.1us
I20260709 12:58:14.126835  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.128648  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:14.125645  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:14.132094  3399 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:14.132613  3399 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.134760  1596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:58:14.135270  1596 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.135687  1596 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:14.137081  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.132772  3362 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:14.115005  3122 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:14.117317  3175 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:14.140455  1751 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:14.142256  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:14.143239  3122 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.144188  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.144902  1746 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:14.135463  3399 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.144357  3122 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:14.146682  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.147292  1751 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:14.152467  1677 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:14.126441  3336 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:14.157461  1673 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:14.159628  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.118537  3293 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 12:58:14.227927  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.228286  3109 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:58:14.230719  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.228560  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99965us
I20260709 12:58:14.142518  3362 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.240265  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:14.204505  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.229795  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.227211  3392 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:14.230719  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 93680.3us
I20260709 12:58:14.146483  3175 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.143388  3395 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.256839  1746 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:14.233443  1596 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.260509  3290 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:14.261281  1596 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.261157  3290 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:14.263487  3290 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.265928  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.267688  3374 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:14.268443  3374 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:14.274873  3404 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:58:14.278481  3359 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.279157  3359 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.281780  3359 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.243189  1752 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:14.243268  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82028.5us
W20260709 12:58:14.243716  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.283478  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.243265  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.252372  1751 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:14.284837  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.284940  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:14.285933  3295 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:14.286039  3291 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:14.286661  3295 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:14.287228  3295 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:14.290257  3358 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.290962  3109 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:14.290771  3358 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.291440  3109 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:14.254383  3175 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.285044  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:14.308059  1673 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:14.271159  3374 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:14.336474  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51566.5us
I20260709 12:58:14.337404  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.338809  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.241428  3375 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:14.250016  3362 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:14.230130  3382 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 12:58:14.229312  3336 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.292531  3109 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:14.365099  3408 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:58:14.365608  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:14.372411  3291 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:14.379717  3403 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 12:58:14.329427  3360 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.340161  3299 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:14.293552  3353 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:58:14.336081  3398 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:14.355371  3374 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:14.358539  3358 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.328831  3359 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:58:14.398092  3166 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:14.429016  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 135516us
I20260709 12:58:14.428797  3398 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:14.400952  3291 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:14.459383  3359 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:14.481411  3359 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:14.480916  3360 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.482538  3353 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:14.482697  3360 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.478003  3358 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.486929  3358 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.498529  3293 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.485013  3411 ts_tablet_manager.cc:933] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.499325  3293 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.437515  3166 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:14.530383  3409 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.249s	user 0.003s	sys 0.000s
W20260709 12:58:14.533957  3415 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:58:14.538491  3410 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:58:14.558161  3418 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:58:14.563402  3414 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
W20260709 12:58:14.571554  3416 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 12:58:14.616431  3359 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:14.618496  3359 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:14.625509  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 128086us
I20260709 12:58:14.632635  3358 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.634348  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.647856  3398 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:14.648401  1677 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:14.634634  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:14.649066  3166 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.640339  3395 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:14.649609  1673 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:14.634052  2721 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.635299  3293 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.638360  1496 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:14.639153  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 220645us
I20260709 12:58:14.562969  3138 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:14.630862  3175 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.650540  2721 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:14.660468  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 323106us
I20260709 12:58:14.655014  1671 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
W20260709 12:58:14.655208  3399 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.003s
I20260709 12:58:14.656116  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.642670  3122 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:14.658483  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.641604  3291 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.653020  3109 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.630817  3295 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.662962  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.666798  3423 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:58:14.668910  3362 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.675034  2721 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.687258  1746 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:14.700956  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.691087  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.670024  3397 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:14.705494  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.695951  1746 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:14.706919  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
W20260709 12:58:14.710711  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72239.6us
I20260709 12:58:14.710865  1673 raft_consensus.cc:606] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:14.709863  1677 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:14.711782  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.712965  1752 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:14.714516  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:14.676045  3336 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.689656  3338 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:14.723048  3374 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:14.725109  1747 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:14.725536  1747 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:14.728646  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.710336  3397 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.733156  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.734346  1600 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:14.726500  3411 tablet_copy_client.cc:323] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:58:14.712023  3375 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:14.709455  3393 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:14.738232  1747 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.746975  1747 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.746805  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.670603  3399 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.742723  1600 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:14.690132  3109 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.724536  3338 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.726632  3360 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:14.754318  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.761574  1677 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:14.751155  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.757416  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.741096  3397 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:14.762938  1673 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:14.720054  3382 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:58:14.740622  3396 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:14.759701  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.764115  1672 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:14.765255  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:14.767124  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:14.739813  3336 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 12:58:14.773658  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46454.3us
I20260709 12:58:14.782336  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.778021  3421 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:14.778477  3391 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:58:14.779138  3420 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:14.743866  3353 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.763355  3433 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:14.732084  3299 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:58:14.790149  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.823489  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:14.758605  3338 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.736511  3395 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:58:14.800424  3420 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:14.805385  3425 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:14.806540  3435 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:14.807230  3399 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.812484  3422 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.844673  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 0193c6e20d1c4a33997d268895b8c083 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:58:14.845335  3109 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.853170  1747 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:14.857944  2721 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:58:14.821980  3433 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.821878  3423 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.752938  3393 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.799836  3293 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:58:14.836159  3398 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:14.862746  3122 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:14.863376  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 108134us
I20260709 12:58:14.837975  3374 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.839430  3420 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:14.867484  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.867676  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.837591  3084 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:58:14.880116  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53455.3us
I20260709 12:58:14.882961  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:14.883147  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:14.893956  1751 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:14.875257  3353 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.884258  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.900610  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:14.901298  1749 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:14.902475  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:14.903127  1750 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.864017  3295 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.865587  3433 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:14.906097  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:14.904557  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:14.909677  1746 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.909705  1749 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:14.907829  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:14.910662  1744 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:14.908203  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 179) took 2234 ms. Trace:
W20260709 12:58:14.963688  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.911492  1497 rpcz_store.cc:276] 0709 12:58:12.663202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.664513 (+  1311us) service_pool.cc:224] Handling call
0709 12:58:14.897461 (+2232948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:13.292698 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:13.300104 (+  7406us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:13.300142 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:58:13.300167 (+    25us) tablet.cc:662] Decoding operations
0709 12:58:13.301840 (+  1673us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:13.301902 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:13.301941 (+    39us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:58:13.303466 (+  1525us) tablet.cc:701] Row locks acquired
0709 12:58:13.303487 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:58:13.350162 (+ 46675us) write_op.cc:270] Start()
0709 12:58:13.359301 (+  9139us) write_op.cc:276] Timestamp: P: 1783601893335409 usec, L: 0
0709 12:58:13.359332 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:58:13.516208 (+156876us) log.cc:844] Serialized 7967 byte log entry
0709 12:58:14.030017 (+513809us) op_driver.cc:464] REPLICATION: finished
0709 12:58:14.375754 (+345737us) write_op.cc:301] APPLY: starting
0709 12:58:14.375880 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:14.376353 (+   473us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:14.376484 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:14.378543 (+  2059us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:14.378850 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:58:14.378932 (+    82us) write_op.cc:312] APPLY: finished
0709 12:58:14.379497 (+   565us) log.cc:844] Serialized 138 byte log entry
0709 12:58:14.405016 (+ 25519us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:14.426635 (+ 21619us) write_op.cc:454] Released schema lock
0709 12:58:14.435738 (+  9103us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:14.463074 (+ 27336us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:14.468159 (+  5085us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4917,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":319879,"apply.run_cpu_time_us":5623,"apply.run_wall_time_us":102608,"num_ops":20,"prepare.queue_time_us":2252,"prepare.run_cpu_time_us":12907,"prepare.run_wall_time_us":388108,"replication_time_us":654619,"thread_start_us":103559,"threads_started":1}]]}
I20260709 12:58:14.857419  3425 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:14.867395  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 0193c6e20d1c4a33997d268895b8c083 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-0193c6e20d1c4a33997d268895b8c083
I20260709 12:58:14.869580  3422 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:58:14.896590  3398 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:14.852756  3435 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.872035  3423 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:14.921125  3374 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:15.013954  1750 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
W20260709 12:58:15.022284  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 126516us
I20260709 12:58:15.024855  1751 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
W20260709 12:58:15.036018  3440 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:58:14.909029  3353 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.039848  3353 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:14.987787  3122 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.047717  1746 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
W20260709 12:58:15.021572  3403 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:58:15.076283  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52816us
I20260709 12:58:15.019338  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:15.016570  3432 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:14.910715  3362 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.041568  3360 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:14.992890  3397 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.106864  3175 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.107926  3394 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:15.108385  3394 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:15.080474  3122 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:15.095985  2314 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.005s
I20260709 12:58:15.094941  3432 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.096354  3293 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.097314  3360 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:15.117097  2314 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:15.131412  3444 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:15.132077  3444 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:15.134608  3443 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 12:58:15.135934  3451 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.121038  3432 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:15.150872  3438 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:58:15.156533  3425 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:15.140057  3122 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.157815  3394 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.159299  3394 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:15.124082  3293 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.175016  1749 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:15.183322  1599 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:15.185489  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:15.189780  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 306539us
I20260709 12:58:15.190699  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.191686  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.194204  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.196463  1672 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:15.118328  3398 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.199186  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.200136  3437 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:15.200671  3437 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:15.201725  3437 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.202248  3395 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:15.123559  3374 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.207942  1595 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:15.170565  3393 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.136477  3451 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.214797  3435 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.215819  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.165110  3382 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:58:15.172705  3360 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.192914  3291 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.197244  3362 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:15.233975  3447 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:15.234505  3447 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.234884  3447 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:15.246798  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:15.250029  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:15.264683  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.228780  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:15.231846  3362 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:15.276733  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 154708us
I20260709 12:58:15.276793  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.278541  1594 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:58:15.286496  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.263378  3423 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.298921  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:15.232736  3291 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.274919  3362 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:15.293298  3359 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.000s
I20260709 12:58:15.277360  3360 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.311406  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.312566  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.313421  1751 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:15.312594  1595 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:15.316556  1603 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:15.311480  1749 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:15.323320  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.324155  1744 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:15.327862  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.297915  3397 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.300375  1601 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:15.328670  1752 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:15.329854  1601 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:15.323087  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.323074  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.342057  1595 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:15.304979  3444 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.292125  3393 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:58:15.348729  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.349388  1752 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:15.349965  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:15.354230  1745 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:15.351491  3293 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.411347  3359 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:15.409565  3338 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.003s
I20260709 12:58:15.416457  3359 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.426152  3359 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:15.435202  3420 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.000s
I20260709 12:58:15.435942  3420 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:15.439096  3420 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.410754  3451 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:15.467190  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:15.468874  3470 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:58:15.455330  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.476300  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:15.458667  3338 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.477092  3423 raft_consensus.cc:1064] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:58:15.475570  3451 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:58:15.490492  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.492681  3461 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:15.493888  3461 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:15.494324  3461 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:15.484824  3392 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:15.503125  1677 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.482561  1671 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:15.511715  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:15.501770  3291 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.512871  1599 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:15.496316  3423 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:15.544248  3473 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:58:15.536847  3451 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:15.544857  3338 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.544998  3166 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:15.545631  3166 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.555696  3428 raft_consensus.cc:1064] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:58:15.560420  3290 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:15.563520  3469 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:58:15.498819  3447 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.568742  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.567430  3290 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.575373  1752 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:15.572635  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:15.576085  3435 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:15.576488  3447 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.577183  3290 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.577276  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.570181  3384 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:15.566524  3336 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:58:15.579689  3138 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.830s	user 0.014s	sys 0.002s
I20260709 12:58:15.579751  3336 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:15.566118  3293 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:58:15.583755  3293 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:15.584316  3293 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.586596  3293 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.586879  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.495220  3461 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:15.561507  3433 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.005s
W20260709 12:58:15.561285  3476 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:58:15.595209  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.597582  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.601734  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.602327  1596 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:15.600107  1599 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:15.605397  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:15.606720  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:15.606806  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.607610  1676 raft_consensus.cc:2368] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:15.608457  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:15.608570  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:15.609011  1676 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:15.609315  1678 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:15.609598  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.610482  1752 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:15.604043  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.626399  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:15.617679  3466 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:15.619439  3392 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:15.579600  3384 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.627610  3290 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:15.632265  1678 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:15.627758  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.597326  3447 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.628328  3466 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.627368  1677 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:15.635067  3295 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:15.635512  3475 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:58:15.598482  3291 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:15.568295  3451 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:58:15.638415  3437 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:15.643886  3449 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:15.570590  3422 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:58:15.644407  3446 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.642041  3447 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.645314  3166 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.642532  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:15.646059  3384 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.647742  3290 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.618490  3396 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:58:15.603202  3338 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:58:15.628727  3392 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.611589  3444 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:15.649979  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.627637  3420 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:58:15.689313  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.642956  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:15.636276  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:15.653385  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.690447  1750 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:15.655928  1676 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:15.693198  3166 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.693764  3166 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.694483  3290 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.694654  3392 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.685240  3397 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:58:15.699218  3447 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.677582  3446 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:15.701819  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 65636.7us
I20260709 12:58:15.643251  3466 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:15.601622  3435 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:58:15.670212  1745 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:15.671830  1747 raft_consensus.cc:2368] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7.
I20260709 12:58:15.610350  3433 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.655593  3291 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.665369  3295 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:15.653910  3467 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:15.701000  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.703927  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.707227  3446 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:15.671644  3449 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.669782  3437 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.657125  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:15.724032  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.722381  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:15.724684  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67664.6us
I20260709 12:58:15.725270  1745 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:15.725476  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:15.726089  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.699491  3362 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.708837  3122 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:15.716995  3398 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:15.701067  2313 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:15.728592  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:15.728920  1744 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.699820  3447 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.712589  3138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 5) took 3634 ms. Trace:
I20260709 12:58:15.731045  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.701362  3444 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:15.712839  3291 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:15.733196  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.742712  1743 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:15.732317  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.738245  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:15.744174  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.744793  2721 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:15.738924  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:15.745707  1672 raft_consensus.cc:606] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:15.746074  1672 raft_consensus.cc:614] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:15.739720  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.748588  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.740422  1744 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:15.716980  3166 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.752549  2951 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:15.753182  2951 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:15.753763  2951 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.742138  3451 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:58:15.760398  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.761404  1678 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:15.762274  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.762934  1678 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:15.765143  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.762540  3444 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.727324  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:15.764240  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:15.774170  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.730633  3446 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:15.763406  3447 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.768700  3398 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:15.740971  3394 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:15.798094  1747 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:15.781607  1672 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:15.788408  1641 leader_election.cc:400] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7.
I20260709 12:58:15.803107  1641 leader_election.cc:403] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:58:15.792168  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.717460  3467 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:15.804322  1673 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:15.792464  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:15.798403  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:15.816265  1596 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:15.765763  3122 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:15.790125  3432 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.000s
W20260709 12:58:15.789985  3480 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:58:15.823957  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.784276  3421 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.794219  3362 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.789309  3447 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.795186  3433 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.792657  3382 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:15.796644  3398 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:15.850477  3336 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.852386  3336 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:15.818545  3295 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.865952  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.796490  3437 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:15.837821  1602 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:15.822928  3446 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7.
I20260709 12:58:15.870728  1670 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:15.743474  3138 rpcz_store.cc:276] 0709 12:58:12.068282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.068429 (+   147us) service_pool.cc:224] Handling call
0709 12:58:12.075251 (+  6822us) log.cc:844] Serialized 506 byte log entry
0709 12:58:15.702641 (+3627390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2770,"raft.queue_time_us":13067,"raft.run_cpu_time_us":2454,"raft.run_wall_time_us":42981,"spinlock_wait_cycles":1666304,"thread_start_us":40994,"threads_started":1,"wal-append.queue_time_us":142516,"wal-append.run_cpu_time_us":2502,"wal-append.run_wall_time_us":1037959}
W20260709 12:58:15.895489  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 145158us
I20260709 12:58:15.896311  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:15.841692  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:15.893999  1603 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 12:58:15.924155  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 195628us
I20260709 12:58:15.919895  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:15.928341  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:15.938474  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:15.827670  3432 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:15.888296  3382 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:15.948541  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.967454  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.970407  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 74) took 2799 ms. Trace:
I20260709 12:58:15.978477  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:15.970995  1496 rpcz_store.cc:276] 0709 12:58:13.170661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.170838 (+   177us) service_pool.cc:224] Handling call
0709 12:58:15.970298 (+2799460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:14.804946 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:14.805707 (+   761us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:14.805763 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:58:14.805790 (+    27us) tablet.cc:662] Decoding operations
0709 12:58:14.806319 (+   529us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:14.806409 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:14.806451 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:14.806750 (+   299us) tablet.cc:701] Row locks acquired
0709 12:58:14.806770 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:58:14.806984 (+   214us) write_op.cc:270] Start()
0709 12:58:14.807138 (+   154us) write_op.cc:276] Timestamp: P: 1783601894806921 usec, L: 0
0709 12:58:14.807162 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:58:14.813190 (+  6028us) log.cc:844] Serialized 535 byte log entry
0709 12:58:15.352132 (+538942us) op_driver.cc:464] REPLICATION: finished
0709 12:58:15.567895 (+215763us) write_op.cc:301] APPLY: starting
0709 12:58:15.570076 (+  2181us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:15.577130 (+  7054us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:15.577266 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:15.577531 (+   265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:15.577703 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:15.577749 (+    46us) write_op.cc:312] APPLY: finished
0709 12:58:15.577960 (+   211us) log.cc:844] Serialized 22 byte log entry
0709 12:58:15.578162 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:15.578255 (+    93us) write_op.cc:454] Released schema lock
0709 12:58:15.578295 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:15.578695 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:15.578727 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10322,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":161204,"apply.run_cpu_time_us":1927,"apply.run_wall_time_us":30943,"num_ops":1,"prepare.queue_time_us":119700,"prepare.run_cpu_time_us":4084,"prepare.run_wall_time_us":39342,"replication_time_us":503219,"thread_start_us":156082,"threads_started":2}]]}
I20260709 12:58:15.937211  3437 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:15.997306  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68996.4us
W20260709 12:58:15.999790  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 79796.3us
I20260709 12:58:16.002499  1752 raft_consensus.cc:2368] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:16.003295  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:15.995450  3476 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:58:16.014873  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 76509.4us
I20260709 12:58:16.028414  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:15.991910  3360 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:58:16.030459  3447 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:16.005270  3109 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:58:16.053485  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:16.050274  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.026337  3437 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:16.013392  3291 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.030637  3449 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.036849  2313 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:16.047843  3362 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:16.048743  3374 raft_consensus.cc:476] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:58:15.996066  3122 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:16.121949  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 93646.9us
W20260709 12:58:16.123044  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 69668.5us
I20260709 12:58:16.107450  3498 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.849076  3421 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.133742  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:16.136690  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.127245  1566 leader_election.cc:400] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:16.158218  1566 leader_election.cc:403] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:16.159232  3435 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:16.162724  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.163937  3435 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:16.060745  3293 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:58:16.128124  2314 raft_consensus.cc:2368] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:16.172147  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:16.128679  3492 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:58:16.174849  1594 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:16.175652  3295 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:16.126405  3496 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:16.126164  3500 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:16.167903  3498 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.128748  3467 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.181528  3447 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:16.220276  3466 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.000s
I20260709 12:58:16.235940  3507 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:16.238130  3466 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.238652  3507 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.240581  3466 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.037132  3382 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.229292  3506 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:16.242233  3506 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.224157  3422 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:16.246484  3428 raft_consensus.cc:1068] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Unable to promote non-voter 570958eb733a4af7ae16ae020998c8b4: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.247856  1675 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:16.249361  3291 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.250051  3432 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.228245  3496 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:16.225840  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:16.224586  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58951.1us
W20260709 12:58:16.231729  3494 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:58:16.231892  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.214685  3437 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:16.236773  3487 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 12:58:16.235922  3495 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:58:16.269788  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:16.270661  1677 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:16.237023  3491 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:58:16.236716  3421 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.240895  3507 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.254796  1670 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:16.253304  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:16.212949  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 210241us
I20260709 12:58:16.255937  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.257635  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:16.260679  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:16.230324  3447 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:16.251598  3496 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.293176  3447 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.294016  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.294904  1678 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:16.214449  3490 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:16.295948  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.296823  1678 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:16.296530  3490 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.299741  3490 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.284173  1673 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:16.292310  1670 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:58:16.310292  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52738.3us
I20260709 12:58:16.328585  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.319121  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:16.331092  1670 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:16.331363  1752 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:16.338132  3499 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:58:16.341831  3435 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:16.251495  2951 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.301358  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.317093  3396 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.221786  3295 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.315919  3507 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:16.381184  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 43906.2us
W20260709 12:58:16.392663  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56180.7us
I20260709 12:58:16.376885  1670 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:16.411618  1677 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:16.419028  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:16.424918  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.426044  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.427235  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:16.427935  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.428377  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:16.430166  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.431298  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.431432  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.432127  1599 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:58:16.427464  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.434108  1752 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:16.435815  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.447250  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.448792  1601 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.423717  3449 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:16.452368  3449 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.457158  3295 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:16.458326  3506 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.436480  3435 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:16.419387  3507 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.460321  3507 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.448829  2951 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.455257  3449 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.380602  3293 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:58:16.474289  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:16.493597  3505 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:58:16.474436  3447 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:16.495888  3497 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:58:16.497565  3447 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.413570  3396 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.501763  3396 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.477865  3498 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.508759  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:16.509514  1598 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:16.519955  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 471660us
I20260709 12:58:16.525055  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:16.514995  2313 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:58:16.527734  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.524770  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.531807  1596 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:16.531701  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.533849  3382 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.535634  3084 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.536228  3084 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.538435  3084 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.539847  3515 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:16.549959  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.554122  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:16.556878  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:16.558737  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.558800  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.560312  3431 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:16.560735  3396 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:16.561415  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.561564  3513 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:16.562189  3393 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:16.565280  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.566128  3393 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:16.568866  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.572108  1596 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:16.574278  1601 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:16.572175  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:16.559679  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:16.576779  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.571226  3522 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:16.580224  1598 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:16.571444  3493 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 12:58:16.584439  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:16.586354  1566 leader_election.cc:400] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:16.572747  3496 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.586697  1566 leader_election.cc:403] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:16.589432  3512 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.587949  3421 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:16.583020  3444 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:16.597302  3444 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:16.592759  3496 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.597775  3444 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.582299  3293 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:58:16.593727  3353 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.601579  1746 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.603945  3496 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.594941  3461 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.586488  3295 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:58:16.585541  3291 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:16.582612  3435 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:16.609488  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:16.613392  1749 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:16.612037  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:16.612439  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.613476  1745 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:16.610944  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:16.616717  3496 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:16.617695  3496 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:16.617877  1748 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:16.618094  3496 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:16.619009  3496 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.620288  3496 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:16.623790  2951 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:16.624482  2951 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:16.626344  2951 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.637368  1670 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:16.637329  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.593375  3498 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.643370  3424 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.645972  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.647660  1677 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:16.649272  1670 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:16.645357  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:16.644476  1674 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.589884  3507 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.654007  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.660224  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:16.656289  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:16.670081  1641 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9a24b102b5d4949a5dd73c9f7d069ad. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:16.671278  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.682389  3507 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.683215  3359 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.683796  3359 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.686719  3359 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:16.689321  1688 tablet_copy_source_session.cc:215] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:16.669610  3424 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.690714  1688 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:38702 (request call id 148) took 1896 ms. Trace:
I20260709 12:58:16.645407  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.691973  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:16.695075  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:16.695662  1669 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:16.694689  1748 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:16.695663  1749 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:16.623943  3295 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:16.701144  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:16.701565  1751 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:16.701926  1603 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:16.706727  1746 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:16.710573  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:16.711866  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:16.712890  1744 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.693791  3424 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.774804  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:16.775601  1669 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.701089  3295 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:16.737717  3489 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:16.773221  3122 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:16.705569  3435 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:58:16.735308  3507 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:58:16.799057  1744 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.691299  1688 rpcz_store.cc:276] 0709 12:58:14.821751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.844310 (+ 22559us) service_pool.cc:224] Handling call
0709 12:58:16.688899 (+1844589us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400194954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814973f7 00007f948642d036 00007f9486436a3e 00007f947dcfa27b 00007f94864369ba 00007f9486431acc 00007f948642cc7b 00007f94864218d1 00007f94854d54b4 00007f94854d5442
0709 12:58:16.690620 (+  1721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518584576}
I20260709 12:58:16.724663  3398 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:58:16.771718  3293 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:58:16.793251  3489 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.831064  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:16.800693  3122 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.833741  1748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:58:16.834450  1748 raft_consensus.cc:606] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:16.808830  3382 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.839882  3382 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.841578  3411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0193c6e20d1c4a33997d268895b8c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.842249  3382 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:16.801187  3392 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:16.809984  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:16.819579  3396 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:16.848644  1669 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:16.831853  3489 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.844327  3122 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:16.872843  3336 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.949142  1748 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:16.945590  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:16.951946  1750 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:16.914052  3513 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.850162  3295 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.857231  3396 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:16.850907  3392 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:16.951560  2314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36884 (request call id 117) took 1224 ms. Trace:
I20260709 12:58:16.977924  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:16.971203  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:16.942519  3444 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:16.974797  3359 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.992718  2721 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:17.008456  2721 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:17.009027  2721 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:17.002948  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:17.005339  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:16.954288  3336 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:17.019261  3530 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:58:17.024384  3447 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.965754  3513 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.001878  3295 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:17.047509  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.028327  3458 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.032343  3396 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:16.981576  2314 rpcz_store.cc:276] 0709 12:58:15.720776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.722781 (+  2005us) service_pool.cc:224] Handling call
0709 12:58:16.911531 (+1188750us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54006815d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:16.942948 (+ 31417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771921152}
I20260709 12:58:17.076071  2721 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.103869  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.025060  3447 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:17.017663  3359 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.067396  3458 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:17.065670  3084 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:17.107261  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:17.111963  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 389579us
I20260709 12:58:17.070101  3512 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.088150  3421 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:17.130244  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:17.151533  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:17.152195  1673 raft_consensus.cc:606] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
W20260709 12:58:17.144356  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.145215  1750 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:17.131680  1500 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 4, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.145879  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:17.148342  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:17.171072  1745 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:17.156280  2721 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.158185  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.173527  1594 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:17.158586  1598 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:17.164319  1500 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.182525  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:17.141145  3458 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.188732  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.192180  1594 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:17.148407  3336 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.169487  3439 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.204408  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:17.207145  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:17.211370  1744 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:17.212253  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.187582  2314 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:17.193638  3442 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.179150  1500 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:17.208539  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 203253us
I20260709 12:58:17.154829  3084 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:17.160918  3421 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.222754  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:17.225317  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:17.230578  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.232798  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:17.209987  1671 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:17.237324  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.238142  2721 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.208200  3392 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.240976  1748 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:17.241276  2721 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.232426  1500 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.217962  3448 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:17.250397  1598 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:17.257279  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50184.3us
I20260709 12:58:17.259163  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:17.263913  2721 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.265128  1500 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:17.224202  3507 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:17.221230  3398 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:58:17.235381  3444 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:17.276505  2721 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.226066  3435 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:58:17.251353  3450 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:17.285956  2721 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:17.280014  3498 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.003s
I20260709 12:58:17.293154  2721 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.226326  3442 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.260346  3448 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:17.283645  3513 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.288569  3138 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:17.279012  3545 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:17.297057  3543 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 12:58:17.321271  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.291610  3547 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:17.323954  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62649.6us
I20260709 12:58:17.302088  3498 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:17.282187  3336 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:58:17.322224  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 12:58:17.336793  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 72702.1us
I20260709 12:58:17.282071  3507 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.333679  2721 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.292168  3553 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:17.344873  3550 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:17.345239  3084 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:17.336265  3541 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:17.346210  3540 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:17.344928   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:58:17.347451  3548 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:17.314821  3448 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:17.339416  3546 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:58:17.331178  3138 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:17.299007  3353 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:58:17.300227  3560 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:17.379922  1594 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:17.380369  1566 leader_election.cc:400] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:17.383231  3293 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:58:17.382212  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 60072us
I20260709 12:58:17.342932  3447 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.347707  3359 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.347663  3547 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.399210  2721 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.409755  1672 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:17.410358  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.410949  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:17.337574  3552 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:58:17.417848  2317 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:17.352273  3444 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 12:58:17.426172  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 45948.9us
I20260709 12:58:17.736505  1676 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:17.737957  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.737986  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:17.581518  3295 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 12:58:17.428864  3442 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.391600  3331 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.740206  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.741214  1745 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:17.406038  3498 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:17.418740  3338 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:17.520960  3560 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:17.742748  3338 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.735389  3353 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:17.743494  3560 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.744197  3353 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.426249  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:17.745150  1674 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.746315  3338 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.742007  3498 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:17.458047  3122 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
W20260709 12:58:17.785405  1715 connection.cc:256] RPC call timeout handler was delayed by -1.1689929729999449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 12:58:17.475390  1746 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:17.766412  3448 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.790307  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:17.505257  3496 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.884s	user 0.007s	sys 0.008s
I20260709 12:58:17.795346  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:17.786224  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.428632   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:17.669610  3458 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.807204  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.854722  1670 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:17.419452  3555 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.337s
I20260709 12:58:17.411512  3553 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:17.426991  3556 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:58:17.403937  3541 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.426530  3374 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:17.559659  3561 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:17.471613  3489 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.000s
I20260709 12:58:17.805322  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:17.495864  3421 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:17.440429  3549 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:17.489739  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.490074  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.421056  3138 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.498859  3507 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.740222  3331 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.753245  3547 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.844307  3122 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.746341  3353 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.736238  3565 ts_tablet_manager.cc:933] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.437005  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.776887  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:17.881711  1677 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:17.868386  3411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 152) took 3790 ms. Trace:
I20260709 12:58:17.784113  1595 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.821724  2721 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:17.812211  3560 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:17.806126  1745 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:58:17.842106  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0618929729999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:58:17.885686  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:17.863739  3374 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.846201  3448 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.859514  3338 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:17.845912  3498 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.869298  3553 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.864822  3489 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:17.861343  3561 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:17.399634  3542 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.369s
I20260709 12:58:17.895315  3458 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:17.884388  3411 rpcz_store.cc:276] 0709 12:58:14.093112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.097861 (+  4749us) service_pool.cc:224] Handling call
0709 12:58:14.500180 (+402319us) ts_tablet_manager.cc:934] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 12:58:16.839601 (+2339421us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:17.465865 (+626264us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:17.466070 (+   205us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:17.866059 (+399989us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:17.867859 (+  1800us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:17.868239 (+   380us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:17.868305 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":60017,"tablet-copy.queue_time_us":302737,"thread_start_us":316624,"threads_started":2}
I20260709 12:58:17.898734  3411 tablet_copy_client.cc:806] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:17.899503  3411 tablet_copy_client.cc:670] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:17.888069  3447 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.888584  3439 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:17.857862  1674 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:17.890048  2721 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:17.890779  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:17.890936  3547 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:17.887428  3560 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:17.894196  3561 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.897750  3122 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.868685  3541 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:17.891248  3338 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:17.902689  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1231) took 1048 ms. Trace:
I20260709 12:58:17.902621  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:17.855312  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60053.6us
W20260709 12:58:17.887440  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 110640us
I20260709 12:58:17.887120  3359 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.916859  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:17.915867  1749 rpcz_store.cc:276] 0709 12:58:16.854603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.854815 (+   212us) service_pool.cc:224] Handling call
0709 12:58:16.859399 (+  4584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:16.859958 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.860000 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:16.860624 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:58:17.214126 (+353502us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:17.214219 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.214774 (+   555us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:17.902469 (+687695us) raft_consensus.cc:1685] finished
0709 12:58:17.902491 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.902633 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1698,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":8282,"thread_start_us":301298,"threads_started":1,"wal-append.queue_time_us":448699}
I20260709 12:58:17.908614  3397 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.880827  3331 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.917634  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:17.919034  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:17.900416  3138 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.911664  2721 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:17.908448  3498 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:17.921663  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:17.925159  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:17.921751  2721 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:17.908202  3447 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:17.917645  3338 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.924645  3541 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:17.929188  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:17.942806  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:17.933373  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.937062  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:17.943689  1748 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:17.944995  1746 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:17.922168  3458 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.939993  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.946902  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:17.922875  3442 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.949214  1749 raft_consensus.cc:2368] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:17.937940  2721 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:17.949450  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:17.920439  3353 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:58:17.952566  3353 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:17.954016  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:17.955206  3461 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.956116  3461 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.956214  3442 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:17.956521  3461 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.956692  3442 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.957079  1603 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:17.936529  3552 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:17.958041  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:17.938850  2312 raft_consensus.cc:2368] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:17.966867  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:17.968111  1750 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:17.937717  3555 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:17.981252  1602 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:17.986336  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.991489  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.939833  3439 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:17.924456  3397 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:17.998793  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.995887  2721 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:18.000063  1744 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:17.948796  3084 raft_consensus.cc:2764] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:18.001781  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.004742  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.923627  3359 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:17.937916  3448 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:58:17.948158  3122 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:18.008620  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.962788  3541 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:18.012878  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.013674  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:17.920090  3561 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.017855  1594 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:18.012181  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.019429  2721 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:18.021261  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.989286  3552 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.022310  2315 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:18.023221  3489 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.025805  3374 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.047946  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.049017  1597 raft_consensus.cc:2368] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:18.027913  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.052189  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.046427  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:18.055928  1677 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 12:58:18.059294  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.028473  3122 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.067018  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.087100  1749 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:18.011348  3439 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.090334  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.091725  3560 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:18.056916  3552 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.103370  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.103958  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.104295  1600 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.103842  3498 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:18.105139  3552 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:18.110260  3461 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.055730  3447 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:18.111968  3447 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:18.112540  1600 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:18.112969  3447 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.113950  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:18.114445  3447 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.114661  1749 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:18.116036  3541 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.084622  3458 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:18.119591  3458 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:18.120735  3458 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.121208  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:18.126557  3338 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:18.137109  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 190820us
I20260709 12:58:18.131511  1566 leader_election.cc:400] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:18.138037  1566 leader_election.cc:403] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:18.138860  1595 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:18.135947  1749 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:18.165930  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:18.168169  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.169610  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.170331  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:18.153204  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:18.174165  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.175756  1595 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:18.064153  3540 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:58:18.199249  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.086859  3411 tablet_copy_client.cc:538] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:18.177527  3084 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.126609  3498 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:18.269042  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.276162  3424 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.276721  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.276894  3424 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.276237  3565 tablet_copy_client.cc:323] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:58:18.279419  3424 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.140161  3293 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:58:18.285050  3293 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:18.287002  3293 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:18.289012  3293 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.293195  3571 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.293846  3571 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.141772  3448 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:18.179383  3542 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:18.309819  2312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36884 (request call id 118) took 1746 ms (client timeout 2157 ms). Trace:
I20260709 12:58:18.309962  3397 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.310671  2317 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:18.333153  3360 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.333588  1749 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.312633  3338 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.333849  3360 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.313203  3396 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.180830  3442 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:18.316927  3138 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.263234  3084 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:18.295769  3567 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
I20260709 12:58:18.260561  3444 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:18.275157  3498 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:18.179073  3518 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.324371  3552 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.331835  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.342495  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.298803  3293 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.340458  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1231) took 1249 ms. Trace:
I20260709 12:58:18.303309  3553 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:18.368189  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 383579us
I20260709 12:58:18.344693  3574 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.376644  1596 rpcz_store.cc:276] 0709 12:58:17.078503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.079021 (+   518us) service_pool.cc:224] Handling call
0709 12:58:17.480847 (+401826us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:17.481173 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:17.908383 (+427210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:17.917971 (+  9588us) log.cc:844] Serialized 14 byte log entry
0709 12:58:17.951692 (+ 33721us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b1800348c40. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 12:58:18.201842 (+250150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:18.201924 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:18.201983 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.327339 (+125356us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400038c54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:18.327405 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.327649 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9064,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":105,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2681,"spinlock_wait_cycles":989283840,"thread_start_us":207145,"threads_started":1,"wal-append.queue_time_us":447161}
W20260709 12:58:18.326532  2312 rpcz_store.cc:269] 0709 12:58:16.563432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.573890 (+ 10458us) service_pool.cc:224] Handling call
0709 12:58:18.309538 (+1735648us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400520154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:18.309742 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451337600}
I20260709 12:58:18.373289  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.412349  3360 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:18.405227  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:18.420763  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.402064  3518 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.415944  3359 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:18.405503  3552 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.372776  3498 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.375516  3560 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.177160  3547 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 12:58:18.347386  3396 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.375582  3461 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.431052  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:18.340240  3542 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:18.404237  3444 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:18.454632  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 271797us
I20260709 12:58:18.410502  3553 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.456224  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:18.454031  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:18.437808  3576 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:18.461097  3580 raft_consensus.cc:2764] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:58:18.432587  3575 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:58:18.473835  1673 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:18.475473  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.478785  1670 raft_consensus.cc:2368] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
W20260709 12:58:18.481242  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.481422  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.482074  1566 leader_election.cc:400] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:18.482506  1566 leader_election.cc:403] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:18.483996  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.452045  3122 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:18.423823  3574 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.483942  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.436728  3560 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.495229  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.490520  1750 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:18.464618  3555 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:18.463792  3576 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.502597  1669 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.502746  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.467978  3580 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.475507  3431 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:18.471933  3394 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.517396  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:18.501631  3576 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.522790  1602 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:18.499672  3571 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.509177  3448 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.512420  3540 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
W20260709 12:58:18.533829  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:18.534777  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.515933  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.528384  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.534438  1675 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:18.524502  3394 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.563757  3394 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.542133  3084 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:18.571985  3582 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:58:18.572067  3560 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:18.520813  3580 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:18.574951  3580 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:18.580456  3553 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:18.581828  3396 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:18.584008  3579 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:58:18.533425  3448 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.585738  1746 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:18.586529  3542 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.587365  3448 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.583022  3498 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.594590  3597 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:18.596125  3439 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.591322  3498 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:18.610230  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.561123  2315 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 1.
I20260709 12:58:18.524215  3444 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:18.616487  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 101693us
I20260709 12:58:18.571825  3518 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.631439  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.566776  3587 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.608794  3552 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:18.628230  3458 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.624958  3353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 6) took 2144 ms. Trace:
I20260709 12:58:18.627326  3448 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.644476  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:18.643307  1599 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:18.640225  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.648152  1678 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:18.644847  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.636699  3431 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:18.642040  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.645305  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:18.645565  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.644860  1603 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:58:18.651015  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.654018  1670 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:18.645397  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.638399  3553 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:18.665849  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.665935  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.630285  3580 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:58:18.670723  3574 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:18.670555  3552 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:18.677117  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.679242  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.641526  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.644042  3589 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.687436  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.694859  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.698487  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.660430  3496 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.663208  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet a9a24b102b5d4949a5dd73c9f7d069ad from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:58:18.721612  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.724025  1676 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:18.683171  3518 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:18.682837  3447 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.726418  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.728758  1670 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:18.697587  3552 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:18.698601  3555 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:18.718547  3553 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:18.737164  1678 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:18.737427  2721 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.738013  1715 leader_election.cc:400] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:18.738847  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.733758  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet a9a24b102b5d4949a5dd73c9f7d069ad from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-a9a24b102b5d4949a5dd73c9f7d069ad
I20260709 12:58:18.740059  3431 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.743818  3084 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:18.744776  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.745683  2313 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:18.746297  3560 raft_consensus.cc:993] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:58:18.746774  3560 raft_consensus.cc:1081] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:58:18.643126  3353 rpcz_store.cc:276] 0709 12:58:16.374404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.374838 (+   434us) service_pool.cc:224] Handling call
0709 12:58:16.429539 (+ 54701us) log.cc:844] Serialized 506 byte log entry
0709 12:58:18.518842 (+2089303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17154,"raft.queue_time_us":19655,"raft.run_cpu_time_us":1842,"raft.run_wall_time_us":1840,"spinlock_wait_cycles":2000000}
W20260709 12:58:18.726238  3331 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.003s
I20260709 12:58:18.738678  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.661897  3448 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:18.729756  3575 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:18.639722  3587 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.771984  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.722985  3496 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.735880  3444 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.773945  3605 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:18.784081  3447 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:18.784938  3447 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:18.785802  3444 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.786255  3447 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:18.786687  3447 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:18.703752  3589 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.787600  3447 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.795284  3447 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.788116  3444 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.796710  3396 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:18.790051  3589 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.793306  3576 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.799980  3587 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:18.793399  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:18.803900  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:18.732803  3518 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.804303  1688 tablet_copy_source_session.cc:215] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:18.804593  2313 raft_consensus.cc:1813] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Handling vote request from an unknown peer 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.805299  2313 raft_consensus.cc:2410] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:58:18.806176  3518 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.793574  3560 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:58:18.807725  3442 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:18.808717  3575 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:18.809643  3565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a24b102b5d4949a5dd73c9f7d069ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:18.810969  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:18.827520  1597 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:58:18.828022  1597 pending_rounds.cc:85] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
I20260709 12:58:18.828266  1597 pending_rounds.cc:107] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:58:18.828498  1597 raft_consensus.cc:2889] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:18.829416  1678 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:18.830441  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.830780  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.831492  1597 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:18.831683  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.832495  1678 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:18.832890  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.835254  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.835968  1598 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:18.837503  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.845345  1598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54658
I20260709 12:58:18.846843  1598 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:18.847648  1598 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.850329  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.851953  1597 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:18.826838  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:18.862776  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:18.864362  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.853964  2721 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:18.865610  1678 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:58:18.865639  2721 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.866479  2721 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:18.867929  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.868846  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:18.870337  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:18.867703  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.873016  1678 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:18.760010  3331 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.820852  3587 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.890007  2721 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.824556  3542 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:18.862128  3553 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:18.901718  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 75005.5us
I20260709 12:58:18.935751  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.941838  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.946267  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.963313  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.871956  3359 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:18.871840  3575 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.983635  1673 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:58:18.983835  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:18.984885  2721 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:18.942072  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:18.874202  3581 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:18.996320  1599 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.891804  3574 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:18.999836   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:19.004364  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.943612  1602 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:18.994594  3138 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:19.031639  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:19.020758  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.029028  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:19.015484  1598 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.046780  1601 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:18.875958  3580 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:58:19.076969  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:18.874387  3360 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 12:58:18.992434  3338 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.079990  1599 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:19.082633  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:19.083078  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:19.018895  1675 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:19.006385  3574 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:19.090560  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.056047  3571 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.894274  3587 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:18.990680  3542 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:18.991360  3553 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.097525  1598 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.090603  1600 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:18.868986  3555 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.090178  3624 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.110196  3624 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.109630  3411 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:58:19.089349  3295 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:19.054100  3138 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.098143  3574 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:19.187788  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 174691us
I20260709 12:58:19.109498  3587 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:19.192363  1566 leader_election.cc:400] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
W20260709 12:58:19.194257  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 323928us
I20260709 12:58:19.121544  3295 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:19.198709  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.197398  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:19.158960  3448 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.102789  3571 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:19.222517  3622 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:58:19.223613  3585 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.684s	user 0.004s	sys 0.011s
I20260709 12:58:19.222638  3138 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.221118  3624 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.231967  2316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36884 (request call id 121) took 1120 ms. Trace:
I20260709 12:58:19.205210  3615 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:58:19.233841  3628 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:19.208870  3547 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.210111  3360 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:19.246568  3360 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.247185  3360 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:19.248309  3619 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:58:19.245100  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:19.248345  3447 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:19.250649  3630 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:19.251618  3295 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.252661  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:19.255867  3447 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:19.259806  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:19.262985  3447 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:19.263639  3331 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:19.236263  3576 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:19.265753  3360 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:58:19.267606  3618 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:19.238890  2316 rpcz_store.cc:276] 0709 12:58:18.111645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.111808 (+   163us) service_pool.cc:224] Handling call
0709 12:58:18.112137 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:18.112509 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.112534 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:18.113035 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.424104 (+311069us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:18.424149 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.424227 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:19.111968 (+687741us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:19.224814 (+112846us) raft_consensus.cc:1685] finished
0709 12:58:19.224844 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:19.231856 (+  7012us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":688,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":163,"spinlock_wait_cycles":31281920,"thread_start_us":310590,"threads_started":1,"wal-append.queue_time_us":381095}
I20260709 12:58:19.274237  3542 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.275208  3630 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:19.276305  3553 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:19.232671  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:19.234835  3571 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.292727  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:19.293982  1676 raft_consensus.cc:2368] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:19.300837  3360 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:19.288303  2313 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.287580  3447 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:19.305900  3447 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:19.292524  3084 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:19.321503  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 94554.6us
I20260709 12:58:19.323269  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.326795  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:19.347119  3631 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:58:19.328146  3444 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:19.378504  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.378228  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.379756  1746 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:19.380494  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.381171  1743 raft_consensus.cc:1813] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Handling vote request from an unknown peer 693257b3078444e0bd26d3e82159d452
I20260709 12:58:19.381269  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.381927  1752 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:19.324090  3396 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.000s
I20260709 12:58:19.383947  1752 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:19.384478  1743 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:19.384408  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.389505  1746 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 2: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:19.346328  3575 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:19.393541  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:19.395484  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68829.7us
I20260709 12:58:19.396545  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.397289  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:19.335755  3458 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.004s
I20260709 12:58:19.398820  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.402936  1751 raft_consensus.cc:2368] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:19.400676  3444 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.324717  3447 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.405151  3447 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.403137  3575 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.413241  3636 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.413851  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.360097  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:19.338850  3496 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.419708  1744 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:58:19.423125  1744 pending_rounds.cc:85] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 2
I20260709 12:58:19.350329  3295 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.423518  1744 pending_rounds.cc:107] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:19.423961  1744 raft_consensus.cc:2889] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:19.426447  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:19.394953  3503 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.414268  3444 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.435623  3444 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.436270  3444 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:19.436642  3444 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.437811  3444 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:19.439776  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:19.439800  3636 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:19.440976  3636 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:19.441319  3636 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:19.442212  3636 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.447598  3636 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.448604  3575 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:19.402100  3374 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:19.453661  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.456015  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:19.459105  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:19.460057  3498 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:19.460464  3498 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:19.460970  3498 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:19.406515  3360 consensus_queue.cc:1175] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "570958eb733a4af7ae16ae020998c8b4" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 4 } }
I20260709 12:58:19.469595  2313 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
I20260709 12:58:19.472539  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:19.478555  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:19.399528  3576 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:58:19.484066  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.484788  1752 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:19.482239  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.428673  3628 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.484382  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:19.491057  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.495218  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.490279  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.496345  1752 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:19.497205  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.498646  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.465971  3374 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.499075  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.499451  1743 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:19.499379  3374 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:19.465075  3503 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.502137  3503 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.502812  3607 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:19.503268  3607 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.503453  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.490245  3580 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:19.504951  3580 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:19.508939  3580 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.505131  3496 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.510138  3374 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.512140  3615 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:19.512862  3615 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.513402  3374 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.515230  3615 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.504858  1566 leader_election.cc:400] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:19.519381  3359 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:19.495354  3637 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:19.503690  3607 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.523756  3496 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.523557  3574 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.522096  1566 leader_election.cc:403] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:19.525156  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:19.526911  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.535804  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1249) took 1200 ms. Trace:
I20260709 12:58:19.537474  3084 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:19.538061  3084 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.538827  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.544395  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.536304  1750 rpcz_store.cc:276] 0709 12:58:18.328576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.331583 (+  3007us) service_pool.cc:224] Handling call
0709 12:58:19.529121 (+1197538us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000b59d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:19.529302 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270427008}
I20260709 12:58:19.554152  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:19.524951  3359 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:19.554430  3396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46970 (request call id 67) took 4106 ms. Trace:
W20260709 12:58:19.558430  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.560369  1749 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:19.557832  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.525672  3637 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.557188  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:19.556149  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.566509  1602 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.565519  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:19.563212  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.530891  3628 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:19.568140  1598 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.568634  3359 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.569646  3359 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.570469  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:19.571616  3637 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.578001  1596 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:19.578204  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:19.545490  3138 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:19.560992  3338 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:19.588042  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.587618  3338 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.589399  1743 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:19.590386  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.584997  3138 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.592767  3574 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:19.592703  3138 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:19.595595  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.598604  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:19.605207  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.606482  1744 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:19.608250  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.611510  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:19.618544  1752 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:19.587919  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:19.629833  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:19.630158  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.597031  3338 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.646464  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:19.640336  1670 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.641479  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:19.648764  1673 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:19.595813  3644 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.644194  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:19.665409  1746 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:19.623631  3360 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:19.656985  1595 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:19.675365  1747 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:19.646552  3580 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:19.664999  1671 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:19.662631  3638 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.633565  3122 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:58:19.683985  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:19.691058  1602 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:19.627996  3498 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.681588  3552 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.674986  3496 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.705855  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:19.709671  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.686699  3628 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.650761  3645 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:58:19.711925  3496 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.695921  3394 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:19.715945  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:19.700690  3498 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:19.708261  3605 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:19.716964  3632 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.517s	user 0.005s	sys 0.000s
W20260709 12:58:19.721760  3634 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.409s	user 0.002s	sys 0.000s
I20260709 12:58:19.721568  3637 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:19.557898  3396 rpcz_store.cc:276] 0709 12:58:15.465276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.468710 (+  3434us) service_pool.cc:224] Handling call
0709 12:58:15.574381 (+105671us) log.cc:844] Serialized 501 byte log entry
0709 12:58:19.528885 (+3954504us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":2051,"raft.queue_time_us":216,"raft.run_cpu_time_us":1176,"raft.run_wall_time_us":1175,"thread_start_us":49243,"threads_started":1,"wal-append.queue_time_us":57405,"wal-append.run_cpu_time_us":2089,"wal-append.run_wall_time_us":1065578}
I20260709 12:58:19.727707  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:19.683081  3360 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.689841  3374 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.696435  3646 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.748239  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:19.773535  1747 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:19.712947  3580 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:19.748257  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.781069  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:19.761171  1750 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:19.735127  3138 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.755080  3607 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.745792  3518 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.792392  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:19.794165  1747 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:58:19.798256  1747 pending_rounds.cc:85] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 5
I20260709 12:58:19.798689  1747 pending_rounds.cc:107] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:58:19.799100  1747 raft_consensus.cc:2889] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:19.797851  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:19.749696  3656 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.803144  3580 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:19.701440  3638 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.806957  3635 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:19.735889  3444 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.785598  3424 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.806257  2313 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:19.810317  3656 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.842511  3444 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.770360  3295 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.844238  1594 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:58:19.844733  3295 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.847391  3295 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.824388  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:19.826618  1748 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
W20260709 12:58:19.832530  3648 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:58:19.770283  3603 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.773710  3605 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:19.833590  3458 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.785772  3374 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:19.838960  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.786032  3646 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.844043  3656 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:19.850169  3496 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:19.785403  3512 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.833032  3084 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:19.854383  3503 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:58:20.153301  3411 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:19.762254  3394 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:19.814142  3571 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:19.856210  3555 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:20.056545  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 218754us
I20260709 12:58:19.796422  3122 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:19.749641  3628 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:19.892992  3632 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:58:19.850903  3603 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.152065  3599 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.003582  3580 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:20.166160  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:20.177269  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 319219us
W20260709 12:58:20.178890  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.167419  3338 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:20.155918  3574 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.156327  3424 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.172216  3635 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:20.195906  3665 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.198314  3084 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:20.199211  3565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 163) took 2894 ms. Trace:
I20260709 12:58:20.200415  1671 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:20.200875  3661 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:20.206033  3599 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.206506  3360 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.173640  3540 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:58:20.164584  3458 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.180398  3571 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:20.207417  3338 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:20.257141  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91092.2us
I20260709 12:58:20.224354  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.319957  1677 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:20.267369  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:20.333366  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66089.2us
I20260709 12:58:20.223659  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:20.222731  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.225085  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.341670  3668 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.342218  3295 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:20.189548  3555 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.192651  3122 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.262514  3411 tablet_bootstrap.cc:492] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:58:20.343755  3295 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:20.258044  3661 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.343272  3668 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.212057  3574 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.214900  3424 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.514438  1669 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:20.262672  3293 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:20.650646  1674 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:20.263116  3571 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.621467  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:20.621352  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:20.621408  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.657837  1678 raft_consensus.cc:2368] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:20.263003  3542 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.666491  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:20.323769  3541 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:20.663051  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:20.574571  3411 ts_tablet_manager.cc:1403] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.465s	user 0.045s	sys 0.035s
I20260709 12:58:20.667894  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.263209  3338 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:20.492189  3444 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:20.668326  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.680851  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:20.681988  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.517987  3587 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.490852  3617 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:20.613984  3664 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:20.622115  3374 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:20.713007  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50038.8us
I20260709 12:58:20.716533  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.717236  2315 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:20.681417  3496 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.219992  3665 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.721915  3496 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:20.703507  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.662173  3458 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.220400  3605 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.661404  3293 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.725414  1678 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:20.581507  3635 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.680155  3498 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.684801  3636 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.725154  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:20.705389  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:20.713095  3444 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.724781  3646 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:20.680891  3542 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.767634  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.213670  3565 rpcz_store.cc:276] 0709 12:58:17.304718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.315217 (+ 10499us) service_pool.cc:224] Handling call
0709 12:58:17.884186 (+568969us) ts_tablet_manager.cc:934] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 12:58:18.808216 (+924030us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:19.651377 (+843161us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:19.675530 (+ 24153us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:20.167813 (+492283us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:20.182547 (+ 14734us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:20.199055 (+ 16508us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:20.199138 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":11260,"tablet-copy.queue_time_us":393744,"thread_start_us":731679,"threads_started":2}
I20260709 12:58:20.797176  2721 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.755664  3374 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:20.814522  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89454.1us
I20260709 12:58:20.870394  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:20.819828  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:20.871826  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:20.821352  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:20.824888  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:20.873349  1602 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:20.714252  3587 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.865300  2721 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.803383  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:20.763993  3293 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:20.786074  3662 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.878913  1596 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:20.777298  3670 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.759861  3394 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:20.796303  3657 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.800189  3599 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.800539  3665 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.863706  2313 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:20.826169  3084 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.766736  3669 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:20.904140  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:20.882416  3666 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.793612  3671 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.685626  3541 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.941995  1598 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:20.826871  3603 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:20.947635  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:20.863801  3573 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.805469  3552 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.986462  2721 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:20.826275  3498 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.760133  3664 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:20.797259  3628 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:20.998652  3673 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.935272  3565 tablet_copy_client.cc:806] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
W20260709 12:58:21.023088  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 119090us
I20260709 12:58:20.942843  3646 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.884925  3512 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:20.828634  3672 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.024808  1601 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:58:20.829105  3295 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.042785  3603 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:20.944109  3662 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.062803  2721 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.109754  2721 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.068060  3507 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.946434  3122 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.120411  2721 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.985076  3555 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.999106  3665 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.075476  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:20.830624  3636 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:20.729103  3617 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.018287  3580 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:21.003155  3447 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:21.107105  3679 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.984619  3657 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.101245  3565 tablet_copy_client.cc:670] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:21.073307  3674 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:20.886927  3374 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:21.131904  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56532.6us
I20260709 12:58:21.176604  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:21.177896  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:21.105687  3630 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:21.068678  3552 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.068815  3666 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.131299  3665 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.114099  3603 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.118386  3444 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:21.104125  3512 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.138859  3659 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:21.158233  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:20.881343  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.546s (SENT) [suppressed 15 similar messages]
I20260709 12:58:21.118706  3668 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:20.953249  3670 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.019757  3669 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.129443  3661 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:21.118995  3672 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.186044  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:21.122601  3507 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.134562  3646 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:21.068529  3573 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.127882  3338 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.163233  3555 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:21.237720  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:21.243628  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55413.3us
I20260709 12:58:21.160177  3561 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:21.149248  3580 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:21.254941  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83353.2us
I20260709 12:58:21.088390  3673 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.259883  3668 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:21.239823  3084 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:21.190192  3122 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.185370  3664 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.160318  3447 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.240423  3587 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.275002  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:21.312168  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:21.274470  3659 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.283607  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:21.252477  3645 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.185914  3679 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.300377  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:21.272100  3561 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:21.289762  3621 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.571s	user 0.004s	sys 0.000s
I20260709 12:58:21.325523  1749 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:21.190405  3630 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.320977  3673 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:21.188136  3635 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:21.326682  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:21.296125  3498 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.337349  1749 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:21.339944  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:21.341087  1749 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:21.333684  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 452535us
I20260709 12:58:21.276647  3555 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.182271  3674 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.369413  1752 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:21.312358  3668 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.311365  3541 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:21.310642  3675 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.378118  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:21.322968  3687 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.382601  3636 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.387046  3657 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.387889  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:21.389101  3665 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:21.390244  3681 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:58:21.396531  3447 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.361914  3411 raft_consensus.cc:359] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:21.398129  3411 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:58:21.398964  3411 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:21.387920  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:21.402973  1747 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:21.416805  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:21.367763  3673 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:21.383679  3678 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
W20260709 12:58:21.375782  3680 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 12:58:21.322053  3122 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:21.456110  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:21.456750  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.372107  3498 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.448462  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:21.457412  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:21.371654  3683 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:21.459414  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 176827us
I20260709 12:58:21.384721  3662 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.450685  3599 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:21.381152  3668 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.452700  3597 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:58:21.464563  3293 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.007s
I20260709 12:58:21.334528  3645 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.493825  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:21.469786  3657 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:21.476536  3668 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.495282  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:21.510001  3670 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.510639  3670 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:21.514940  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:21.455210  3673 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.481581  3597 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.412395  3687 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.484025  3552 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.540961  1752 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:21.466778  3498 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.448025  3675 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.508941  3636 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:21.511144  3670 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.508618  3374 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.509093  3657 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.530371  3338 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.490345  3293 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:21.466060  3683 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:21.544881  3580 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:21.529277  3661 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:21.537984  3597 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:21.723907  3630 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.188265  3661 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:21.764591  3573 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.022437  3670 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.189126  3661 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.078193  3659 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.081467  3666 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.190531  3683 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.786906  3672 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:22.134001  3658 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.616s	user 0.001s	sys 0.008s
W20260709 12:58:22.028571  3571 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.347s	user 0.017s	sys 0.000s
I20260709 12:58:21.904507  3561 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.193362  3571 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.194305  3561 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:22.195711  3571 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.887085  3697 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.200214  3697 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.201706  3661 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.202771  3697 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.203380  3597 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.205111  3661 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.141660  3617 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.095006  3679 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.206507  3597 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.015726  3673 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.084935  3574 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.139343  3607 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.086721  3638 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:21.848206  3699 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 12:58:21.868530  3696 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:58:21.867208  3674 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.847916  3695 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.211020  3695 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:21.725576  3603 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:22.028913  3700 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.204s	user 0.000s	sys 0.002s
I20260709 12:58:22.029304  3675 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:21.842371  3645 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.214490  3695 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:21.820693  3555 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.022576  3637 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.525370  3587 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:22.216037  3587 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:22.216714  3587 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:21.887802  3690 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.702s
I20260709 12:58:21.823267  3669 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:21.867774  3698 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:58:21.554414  3636 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:22.224776  3636 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:21.865993  3694 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:22.114645  3687 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.187577  3657 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:22.381526  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 1.11085e+06us
I20260709 12:58:21.726635  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1393) took 1491 ms. Trace:
I20260709 12:58:21.928323  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.393502  1747 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 1.
I20260709 12:58:22.394008  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1437) took 2851 ms. Trace:
I20260709 12:58:22.394739  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1464) took 1022 ms. Trace:
I20260709 12:58:22.082535  3496 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:21.871804  3411 ts_tablet_manager.cc:1434] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 1.179s	user 0.014s	sys 0.000s
I20260709 12:58:21.536223  3507 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:22.403599  3411 ts_tablet_manager.cc:1467] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Tablet startup took 1720ms
I20260709 12:58:21.901175  3138 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.404294  3571 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:22.407016  3691 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:22.395509  1747 rpcz_store.cc:276] 0709 12:58:21.372129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.927927 (+555798us) service_pool.cc:224] Handling call
0709 12:58:22.394585 (+466658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.408475  3691 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:21.930449  1750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1436) took 2388 ms (client timeout 1585 ms). Trace:
I20260709 12:58:22.000053  3498 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.418002  3518 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:58:22.417810  1750 rpcz_store.cc:269] 0709 12:58:19.542211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.562862 (+ 20651us) service_pool.cc:224] Handling call
0709 12:58:21.930194 (+2367332us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540040a6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:21.930341 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388272896}
I20260709 12:58:22.419028  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1460) took 1104 ms. Trace:
W20260709 12:58:21.927075  1746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1281) took 2388 ms (client timeout 2136 ms). Trace:
I20260709 12:58:22.406188  3138 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:22.424916  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1395) took 2138 ms. Trace:
W20260709 12:58:22.421430  1746 rpcz_store.cc:269] 0709 12:58:19.538323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.538536 (+   213us) service_pool.cc:224] Handling call
0709 12:58:21.926658 (+2388122us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540029e854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:21.926932 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288637312}
I20260709 12:58:22.384829  1669 rpcz_store.cc:276] 0709 12:58:20.258175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.670658 (+412483us) service_pool.cc:224] Handling call
0709 12:58:20.670964 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.813231 (+142267us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:21.024337 (+211106us) log.cc:844] Serialized 14 byte log entry
0709 12:58:21.195042 (+170705us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.195623 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.195768 (+   145us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:21.195962 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 12:58:21.235951 (+ 39989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.236045 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:21.725997 (+489952us) raft_consensus.cc:1685] finished
0709 12:58:21.726044 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:21.726537 (+   493us) inbound_call.cc:177] Queueing success response
0709 12:58:22.081114 (+354577us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18002d1060. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f948536158f 00007f947e3a0571 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd
0709 12:58:22.090474 (+  9360us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b18002d1060. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
Metrics: {"mutex_wait_us":91877,"prepare.queue_time_us":1329541,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":178368,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":21371,"spinlock_wait_cycles":49170432,"thread_start_us":348349,"threads_started":3,"wal-append.queue_time_us":310383}
I20260709 12:58:22.394588  1743 rpcz_store.cc:276] 0709 12:58:19.542516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.601632 (+ 59116us) service_pool.cc:224] Handling call
0709 12:58:19.601976 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.602249 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:19.626011 (+ 23762us) log.cc:844] Serialized 14 byte log entry
0709 12:58:21.931654 (+2305643us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b18002c13a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 12:58:21.950872 (+ 19218us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.076981 (+126109us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b18002c13a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:22.392925 (+315944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.393064 (+   139us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:22.393233 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.393381 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.393684 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2277227,"prepare.queue_time_us":2388054,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":117,"raft.queue_time_us":2054,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9322,"spinlock_wait_cycles":34446336,"thread_start_us":441103,"threads_started":1,"wal-append.queue_time_us":138312}
I20260709 12:58:22.432190  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.432472  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 886) took 2863 ms. Trace:
I20260709 12:58:22.138747  3542 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.433532  1743 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:21.787745  3512 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.419638  1749 rpcz_store.cc:276] 0709 12:58:21.314763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.363950 (+ 49187us) service_pool.cc:224] Handling call
0709 12:58:21.364348 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:21.450912 (+ 86564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.450946 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.454154 (+  3208us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.506311 (+ 52157us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:21.506355 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.506427 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.418271 (+911844us) raft_consensus.cc:1685] finished
0709 12:58:22.418319 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.418710 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86138,"raft.queue_time_us":95043,"raft.run_cpu_time_us":945,"raft.run_wall_time_us":20349,"thread_start_us":33972,"threads_started":1,"wal-append.queue_time_us":619773}
I20260709 12:58:22.421999  3138 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.443392  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.445127  1746 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
W20260709 12:58:22.447218  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.433840  1676 rpcz_store.cc:276] 0709 12:58:19.564724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.565725 (+  1001us) service_pool.cc:224] Handling call
0709 12:58:19.566067 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:19.595912 (+ 29845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:19.595947 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:19.596609 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 12:58:20.153973 (+557364us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:20.154013 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.154087 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.133159 (+1979072us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:22.391024 (+257865us) raft_consensus.cc:1685] finished
0709 12:58:22.391115 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.428171 (+ 37056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65046,"raft.queue_time_us":36386,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":26153,"spinlock_wait_cycles":32522496,"thread_start_us":378408,"threads_started":1,"wal-append.queue_time_us":619220}
I20260709 12:58:22.449414  3586 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.450517  3659 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.451603  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 897) took 1753 ms. Trace:
I20260709 12:58:22.452271  1676 rpcz_store.cc:276] 0709 12:58:20.697755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.450038 (+1752283us) service_pool.cc:224] Handling call
0709 12:58:22.450637 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.450979 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.451029 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.451108 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:22.451151 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.451206 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.451457 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.454536  3293 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.445879  3518 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.412261  3571 consensus_queue.cc:1243] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:22.427038  1672 rpcz_store.cc:276] 0709 12:58:20.258832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.669241 (+410409us) service_pool.cc:224] Handling call
0709 12:58:20.669613 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.679872 (+ 10259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.679908 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:20.699045 (+ 19137us) log.cc:844] Serialized 26 byte log entry
0709 12:58:20.817107 (+118062us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:21.269323 (+452216us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.396565 (+1127242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.396807 (+   242us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.396943 (+   136us) raft_consensus.cc:1685] finished
0709 12:58:22.396965 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.397235 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1188394,"prepare.queue_time_us":496522,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":25101,"raft.queue_time_us":37222,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":10247,"thread_start_us":423497,"threads_started":2,"wal-append.queue_time_us":293009}
I20260709 12:58:22.462425  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 185) took 1632 ms. Trace:
W20260709 12:58:22.470696  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.470981  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 846) took 2918 ms. Trace:
I20260709 12:58:22.473891  2315 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:22.474479  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 114) took 1651 ms. Trace:
I20260709 12:58:22.474561  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.473863  3518 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.450615  3586 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.476941  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 118) took 1652 ms. Trace:
I20260709 12:58:22.479048  3586 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.492982  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:22.494122  1597 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:22.498752  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:22.504829  3599 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.505800  3599 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.476819  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.525647  1746 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:22.526280  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1472) took 1051 ms. Trace:
I20260709 12:58:22.526738  1746 rpcz_store.cc:276] 0709 12:58:21.474657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.476341 (+1001684us) service_pool.cc:224] Handling call
0709 12:58:22.526157 (+ 49816us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:22.527304  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 947724us
I20260709 12:58:22.531710  3396 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:22.533885  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1404) took 2043 ms. Trace:
I20260709 12:58:22.534569  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1406) took 2016 ms. Trace:
I20260709 12:58:22.535053  1677 rpcz_store.cc:276] 0709 12:58:20.518090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.257040 (+738950us) service_pool.cc:224] Handling call
0709 12:58:21.257841 (+   801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.381555 (+123714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.381588 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.381630 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:21.381665 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.534095 (+1152430us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003232d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.534174 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.534380 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283944192}
I20260709 12:58:22.474913  1598 rpcz_store.cc:276] 0709 12:58:20.822444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.822565 (+   121us) service_pool.cc:224] Handling call
0709 12:58:20.822850 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.018286 (+195436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.473843 (+1455557us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540023dcd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.474214 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272658688}
I20260709 12:58:22.485155  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1401) took 2201 ms. Trace:
I20260709 12:58:22.487239  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 183) took 2727 ms. Trace:
I20260709 12:58:22.488986  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:22.490077  3573 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:22.475617  1747 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:22.491109  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:22.404305  3411 ts_tablet_manager.cc:1469] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Trace:
0709 12:58:14.093112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.097861 (+  4749us) service_pool.cc:224] Handling call
0709 12:58:14.500180 (+402319us) ts_tablet_manager.cc:934] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 12:58:16.839601 (+2339421us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:17.465865 (+626264us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:17.466070 (+   205us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:17.866059 (+399989us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:17.867859 (+  1800us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:17.868239 (+   380us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:17.868305 (+    66us) inbound_call.cc:177] Queueing success response
0709 12:58:19.109088 (+1240783us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:58:20.701593 (+1592505us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:58:20.796111 (+ 94518us) tablet_replica.cc:261] Starting instrumentation
0709 12:58:21.016767 (+220656us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":60017,"raft.queue_time_us":6334,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":4501,"tablet-copy.queue_time_us":302737,"tablet-download-pool.queue_time_us":131,"tablet-download-pool.run_cpu_time_us":1652,"tablet-download-pool.run_wall_time_us":166481,"thread_start_us":316624,"threads_started":2}
I20260709 12:58:20.768648   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:22.540813  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1465) took 1077 ms. Trace:
I20260709 12:58:22.539746  1673 rpcz_store.cc:276] 0709 12:58:19.760182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.760357 (+   175us) service_pool.cc:224] Handling call
0709 12:58:19.760783 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.205041 (+444258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.205076 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.205118 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:20.205148 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.486654 (+2281506us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540036fbd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.486736 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.487021 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020981504}
I20260709 12:58:22.542084  1747 rpcz_store.cc:276] 0709 12:58:21.463209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.458497 (+995288us) service_pool.cc:224] Handling call
0709 12:58:22.540744 (+ 82247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.542791  3637 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.543807  3637 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.544039  3573 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:22.498235  1752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1459) took 1197 ms (client timeout 1515 ms). Trace:
I20260709 12:58:22.471421  1594 rpcz_store.cc:276] 0709 12:58:19.552706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.552830 (+   124us) service_pool.cc:224] Handling call
0709 12:58:19.553181 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:19.844750 (+291569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.470133 (+2625383us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001b4754. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.470671 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668566912}
I20260709 12:58:22.457055  3659 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.467515  1672 rpcz_store.cc:276] 0709 12:58:20.830544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.460737 (+1630193us) service_pool.cc:224] Handling call
0709 12:58:22.461434 (+   697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.461910 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.461945 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.462035 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:22.462079 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.462173 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.462335 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.477448  1599 rpcz_store.cc:276] 0709 12:58:20.824461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.824580 (+   119us) service_pool.cc:224] Handling call
0709 12:58:20.824866 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.885029 (+ 60163us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:21.268684 (+383655us) log.cc:844] Serialized 14 byte log entry
0709 12:58:21.404866 (+136182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.404923 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:21.404969 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.103375 (+698406us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18003c21a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:22.476374 (+372999us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54003b3654. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.476448 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.476726 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74397,"prepare.queue_time_us":498658,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":7800,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5706,"spinlock_wait_cycles":146603264,"thread_start_us":391447,"threads_started":2,"wal-append.queue_time_us":289123}
I20260709 12:58:22.552287  1595 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:22.551654  3573 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.558763  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:22.563433  1669 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:22.563988  1669 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:22.565212  2315 raft_consensus.cc:1217] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:58:22.568091  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22373089b38b498393c2161e53b5f016 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:22.539584  1671 rpcz_store.cc:276] 0709 12:58:20.284182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.003652 (+719470us) service_pool.cc:224] Handling call
0709 12:58:21.016171 (+ 12519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.017694 (+  1523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.017726 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.017776 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:21.017821 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.484435 (+1466614us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b54002fba54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.484504 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.484957 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951552}
I20260709 12:58:22.569366  1602 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:58:22.546446  1752 rpcz_store.cc:269] 0709 12:58:21.301157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.311849 (+ 10692us) service_pool.cc:224] Handling call
0709 12:58:22.497750 (+1185901us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54001c2fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:22.498006 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129919872}
I20260709 12:58:22.570250  3657 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.572295  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.573202  1752 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:22.570328  1669 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.574471  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.575367  3599 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.576756  2314 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:22.578706  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1438) took 3035 ms. Trace:
I20260709 12:58:22.550073  3448 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.584494  3448 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.586185  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1450) took 1313 ms. Trace:
I20260709 12:58:22.587100  3448 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.534567  1674 rpcz_store.cc:276] 0709 12:58:20.490334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.146625 (+656291us) service_pool.cc:224] Handling call
0709 12:58:21.156682 (+ 10057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.156925 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:21.303366 (+146441us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.530520 (+1227154us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b18003d08a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a
0709 12:58:22.530968 (+   448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.531077 (+   109us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:22.531193 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.533392 (+  2199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.533629 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221511,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":2013,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":172,"spinlock_wait_cycles":5562752,"thread_start_us":207718,"threads_started":2,"wal-append.queue_time_us":163685}
I20260709 12:58:22.590157  1675 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:22.612747  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1389) took 2389 ms. Trace:
I20260709 12:58:22.613252  1675 rpcz_store.cc:276] 0709 12:58:20.222943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.257106 (+ 34163us) service_pool.cc:224] Handling call
0709 12:58:22.588822 (+2331716us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:22.589306 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.612266 (+ 22960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.612657 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3606400}
I20260709 12:58:22.554409  3637 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.614598  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:22.615689  1598 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.616106  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.616979  1743 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:22.618259  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.619092  1743 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:22.592308  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 184) took 1762 ms. Trace:
I20260709 12:58:22.619781  1676 rpcz_store.cc:276] 0709 12:58:20.829905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.453920 (+1624015us) service_pool.cc:224] Handling call
0709 12:58:22.454601 (+   681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.491433 (+ 36832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.491471 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.491609 (+   138us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:22.491651 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.591825 (+100174us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b540006cf54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.591890 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.592137 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83662208}
I20260709 12:58:22.586661  1748 rpcz_store.cc:276] 0709 12:58:21.273166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.273319 (+   153us) service_pool.cc:224] Handling call
0709 12:58:21.273730 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:21.550223 (+276493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.550274 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.550899 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.801828 (+250929us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:21.801897 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.585478 (+783581us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000d2d54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.585548 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.585644 (+    96us) raft_consensus.cc:1685] finished
0709 12:58:22.585676 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.585993 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25090,"raft.queue_time_us":5532,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":49196,"spinlock_wait_cycles":622153984,"thread_start_us":250415,"threads_started":1,"wal-append.queue_time_us":633818}
I20260709 12:58:22.579185  1744 rpcz_store.cc:276] 0709 12:58:19.542966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.662177 (+119211us) service_pool.cc:224] Handling call
0709 12:58:19.662600 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.662850 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:21.949582 (+2286732us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.453090 (+503508us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.577617 (+124527us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b1800265480. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 12:58:22.577928 (+   311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.578009 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:22.578136 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.578259 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.578477 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2290376,"prepare.queue_time_us":2291086,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":150,"raft.queue_time_us":179311,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":363,"spinlock_wait_cycles":4692608,"thread_start_us":489999,"threads_started":2,"wal-append.queue_time_us":132434}
I20260709 12:58:22.597090  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.606185  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 115) took 1782 ms. Trace:
I20260709 12:58:22.608130  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.624971  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.608680  3122 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.608994  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.620769  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1445) took 3017 ms. Trace:
I20260709 12:58:22.608820  1752 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:22.575817  1669 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:22.597059  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:22.630121  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1473) took 1054 ms. Trace:
I20260709 12:58:22.630568  1752 rpcz_store.cc:276] 0709 12:58:21.572658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.573949 (+1001291us) service_pool.cc:224] Handling call
0709 12:58:22.626792 (+ 52843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.625379  1600 rpcz_store.cc:276] 0709 12:58:20.823273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.823830 (+   557us) service_pool.cc:224] Handling call
0709 12:58:20.824275 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.077455 (+253180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.077489 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.077537 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:21.077567 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.605640 (+1528073us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000799d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.605715 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.605973 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581643520}
I20260709 12:58:22.600499  3636 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.635061  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:22.633035  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:22.576244  3657 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.641533  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.643409  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.639082  1752 raft_consensus.cc:2376] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4. Re-sending same reply.
I20260709 12:58:22.645761  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.647017  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:22.626169  1745 rpcz_store.cc:276] 0709 12:58:19.602960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.708666 (+105706us) service_pool.cc:224] Handling call
0709 12:58:19.710450 (+  1784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.813756 (+103306us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:22.396489 (+2582733us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.458709 (+ 62220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.531688 (+ 72979us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:22.531825 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.620235 (+ 88410us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.620291 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.620535 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2278981,"prepare.queue_time_us":2182393,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":20114,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":2731,"spinlock_wait_cycles":236795648,"thread_start_us":447123,"threads_started":2,"wal-append.queue_time_us":140126}
I20260709 12:58:22.647301  1747 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:22.648787  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1468) took 1183 ms. Trace:
I20260709 12:58:22.648998  1747 rpcz_store.cc:276] 0709 12:58:21.465114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.596595 (+1131481us) service_pool.cc:224] Handling call
0709 12:58:22.648738 (+ 52143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.595412  3587 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.649708  1750 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:22.652382  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.653385  1746 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:22.654277  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1466) took 1190 ms. Trace:
I20260709 12:58:22.654328  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.654757  1746 rpcz_store.cc:276] 0709 12:58:21.463511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.607665 (+1144154us) service_pool.cc:224] Handling call
0709 12:58:22.654215 (+ 46550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.657855  1752 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.656279  1749 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:22.702391  3138 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.702713  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 852) took 1884 ms. Trace:
I20260709 12:58:22.702204  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:22.707595  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.703244  1603 rpcz_store.cc:276] 0709 12:58:20.817712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.819698 (+  1986us) service_pool.cc:224] Handling call
0709 12:58:20.819987 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.165010 (+345023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.165071 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.165123 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:21.165158 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.702055 (+1536897us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54000253d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.702156 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.702457 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792838400}
I20260709 12:58:22.714532  1748 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:22.715893  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.716723  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.715962  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:22.717379  3561 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.010s
I20260709 12:58:22.717907  1748 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.720140  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 172) took 1342 ms. Trace:
I20260709 12:58:22.720706  1743 rpcz_store.cc:276] 0709 12:58:21.377813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.708117 (+1330304us) service_pool.cc:224] Handling call
0709 12:58:22.719203 (+ 11086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.719647 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.719684 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.719764 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:22.719799 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.719879 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.720033 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.727732  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.728449  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.730752  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 174) took 1311 ms. Trace:
I20260709 12:58:22.731791  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.733457  3587 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.734026  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.735471  3636 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.731350  1746 rpcz_store.cc:276] 0709 12:58:21.419475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.729011 (+1309536us) service_pool.cc:224] Handling call
0709 12:58:22.729845 (+   834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.730277 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.730310 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.730410 (+   100us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:22.730452 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.730523 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.730653 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.737237  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.741281  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.739359  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1469) took 1273 ms. Trace:
I20260709 12:58:22.743582  1747 rpcz_store.cc:276] 0709 12:58:21.465578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.653296 (+1187718us) service_pool.cc:224] Handling call
0709 12:58:22.739306 (+ 86010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.746671  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.752741  2315 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:22.747650  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.741679  3599 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:22.765158  1748 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:22.768944  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1463) took 1405 ms. Trace:
I20260709 12:58:22.754143  3691 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.769714  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:22.770386  1749 rpcz_store.cc:276] 0709 12:58:21.358074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.664346 (+1306272us) service_pool.cc:224] Handling call
0709 12:58:22.742819 (+ 78473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.759930 (+ 17111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.759964 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.763149 (+  3185us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:22.763198 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.763270 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.763395 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.772600  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1461) took 1450 ms. Trace:
I20260709 12:58:22.777401  1744 rpcz_store.cc:276] 0709 12:58:21.322464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.708416 (+1385952us) service_pool.cc:224] Handling call
0709 12:58:22.754552 (+ 46136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.772128 (+ 17576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.772162 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.772256 (+    94us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:22.772300 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.772381 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.772527 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.784024  1669 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:22.784870  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 175) took 1321 ms. Trace:
I20260709 12:58:22.785522  1745 rpcz_store.cc:276] 0709 12:58:21.455711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.740481 (+1284770us) service_pool.cc:224] Handling call
0709 12:58:22.752473 (+ 11992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.763268 (+ 10795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.763307 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.769192 (+  5885us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:22.776640 (+  7448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.776717 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.776853 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:22.792243  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.796994  1744 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:22.783084  3636 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:22.800020  3625 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:58:22.800204  3636 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.760002  3587 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:58:22.802800  3587 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:22.790443  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 896) took 2087 ms. Trace:
I20260709 12:58:22.806562  1669 rpcz_store.cc:276] 0709 12:58:20.697349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.431443 (+1734094us) service_pool.cc:224] Handling call
0709 12:58:22.432272 (+   829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.563301 (+131029us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b540035e420. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481404dc0 00007f948148f1c0 00007f9481490231 00007f948148cd8f 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c
0709 12:58:22.784624 (+221323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.784868 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56777088}
I20260709 12:58:22.813617  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:22.805740  3636 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.803522  3587 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:22.827450  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 75) took 6387 ms. Trace:
I20260709 12:58:22.828001  1496 rpcz_store.cc:276] 0709 12:58:16.433203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.444765 (+ 11562us) service_pool.cc:224] Handling call
0709 12:58:22.820219 (+6375454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1254579,"reported_tablets":3}
I20260709 12:58:22.826493  2316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36884 (request call id 127) took 2083 ms. Trace:
I20260709 12:58:22.787786  3659 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:22.857013  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.857221  3587 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.850135  1598 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:22.850987  1745 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:22.808390  3599 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:22.859187  3587 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:22.865545  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.863699  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1397) took 2498 ms. Trace:
I20260709 12:58:22.864859  1752 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:22.866624  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.869567  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 173) took 1478 ms. Trace:
I20260709 12:58:22.870417  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1471) took 1394 ms. Trace:
I20260709 12:58:22.870683  1743 rpcz_store.cc:276] 0709 12:58:21.385869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.721862 (+1335993us) service_pool.cc:224] Handling call
0709 12:58:22.722546 (+   684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:22.774459 (+ 51913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.774502 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:22.775321 (+   819us) log.cc:844] Serialized 26 byte log entry
0709 12:58:22.843975 (+ 68654us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:22.844020 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.844100 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.856214 (+ 12114us) raft_consensus.cc:1685] finished
0709 12:58:22.856236 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.856404 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38762,"raft.queue_time_us":52865,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":14536,"thread_start_us":68090,"threads_started":1,"wal-append.queue_time_us":78652}
I20260709 12:58:22.878129  2721 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:22.868795  1670 rpcz_store.cc:276] 0709 12:58:20.259348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.935343 (+675995us) service_pool.cc:224] Handling call
0709 12:58:20.955952 (+ 20609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.103681 (+147729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.103729 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.103804 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:21.103849 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.739606 (+1635757us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002576d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.741868 (+  2262us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.757361 (+ 15493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339005696}
I20260709 12:58:22.882222  3691 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:22.882164  2721 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.882975  3599 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:22.884723  2721 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.885125  3424 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.838222  2316 rpcz_store.cc:276] 0709 12:58:20.661758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.662007 (+   249us) service_pool.cc:224] Handling call
0709 12:58:20.662351 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.112359 (+450008us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:21.290124 (+177765us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.501982 (+1211858us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b18002d43c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 12:58:22.508979 (+  6997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.512264 (+  3285us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:22.540606 (+ 28342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.714176 (+173570us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54004a1fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:22.714248 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.744575 (+ 30327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":924,"prepare.queue_time_us":299732,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1043066,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":283,"spinlock_wait_cycles":1050641536,"thread_start_us":336337,"threads_started":2,"wal-append.queue_time_us":451784}
I20260709 12:58:22.883033  3691 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:22.896595  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:22.897787  3657 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:22.898253  3657 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:22.898746  3657 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.898938  3691 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:22.904542  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:22.906267  3122 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:22.906724  3122 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:22.907200  3122 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:22.908916  1748 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:22.877302  1746 rpcz_store.cc:276] 0709 12:58:21.474335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.740396 (+1266061us) service_pool.cc:224] Handling call
0709 12:58:22.764049 (+ 23653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.772626 (+  8577us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:22.773041 (+   415us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.868370 (+ 95329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.868435 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:22.868487 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.868561 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.868692 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757,"prepare.queue_time_us":3634,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":16538,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7463,"thread_start_us":78344,"threads_started":1}
I20260709 12:58:22.914098  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.924496  1669 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:22.927832  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.929219  2316 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:22.932348  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.933699  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.933943  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.934950  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.935791  1676 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:22.938017  1672 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:22.945998  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.946518  1603 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:22.948117  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.950901  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:22.943719  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.954376  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.953344  1669 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:22.954378  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:22.959261  1600 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:22.958271  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:22.968466  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:22.972015  1595 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:22.974227  1603 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:22.980629  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.982806  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:22.969974  3668 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:22.987905  1670 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:22.989240  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:22.988596  1670 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:22.993072  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.997378  1602 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:22.999235  1676 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:22.999780  1603 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:23.001457  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-0193c6e20d1c4a33997d268895b8c083 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:58:23.002202  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-0193c6e20d1c4a33997d268895b8c083 on tablet 0193c6e20d1c4a33997d268895b8c083 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:22.998900  1670 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:23.003819  1670 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.996429  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.007661  3659 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.008297  1675 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:23.008886  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69379.3us
I20260709 12:58:23.009274  3668 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.010299  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.008198  3659 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:58:23.012490  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.022545  1670 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:23.015275  3587 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.016227  3659 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.026240  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.027587  1676 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:58:23.029675  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1441) took 3417 ms. Trace:
I20260709 12:58:23.024129  3587 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.047773  3587 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.048947  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.049909  1675 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:23.041688  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:23.042155  3719 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:58:23.046615  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.031512  1751 rpcz_store.cc:276] 0709 12:58:19.544559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.694766 (+150207us) service_pool.cc:224] Handling call
0709 12:58:19.695254 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.695476 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:22.843496 (+3148020us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800168760. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf
0709 12:58:22.852478 (+  8982us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.939521 (+ 87043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.944185 (+  4664us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:22.951268 (+  7083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.956972 (+  5704us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.961924 (+  4952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2254486,"prepare.queue_time_us":2299073,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":6576,"raft.queue_time_us":13489,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":155,"spinlock_wait_cycles":24844672,"thread_start_us":93856,"threads_started":2,"wal-append.queue_time_us":92037}
I20260709 12:58:23.062958  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.066697  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.076280  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.093370  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.091645  3637 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.121999  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 12:58:23.133077  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:23.133925  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.110118  3637 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:23.141225  3396 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.166579  3715 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:23.166975  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.149628  3637 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.169543  3715 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.169934  1751 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:23.171846  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:23.180394  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 79673.3us
I20260709 12:58:23.182548  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.170835  3565 tablet_copy_client.cc:538] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:23.189229  3636 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:23.190102  3636 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:23.174580  3396 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.193377  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.195760  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.197451  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.197692  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:23.195144  3636 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.204444  1674 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:23.206254  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.207186  1675 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:23.201948  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.202929  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.209792  1676 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:23.213902  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.194213  3396 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.220539  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.228107  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.231769  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.176059  3715 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.232437  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.234963  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.237509  1750 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:23.240557  1746 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:23.183102  3657 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.242787  1748 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:23.251694  1595 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:23.262668  3691 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.263391  3691 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.274343  3691 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.275731  3659 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.278223  3659 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:23.279129  3659 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.283208  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 191) took 10545 ms. Trace:
I20260709 12:58:23.291004  1748 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:23.298452  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.304314  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.298834  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.307933  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:23.309048  1743 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:23.307878  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:23.289453  1500 rpcz_store.cc:276] 0709 12:58:12.738169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.767750 (+ 29581us) service_pool.cc:224] Handling call
0709 12:58:12.822318 (+ 54568us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:58:23.282913 (+10460595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:17.522868 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:17.523465 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:17.523500 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:58:17.523517 (+    17us) tablet.cc:662] Decoding operations
0709 12:58:17.555939 (+ 32422us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:17.556048 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:17.556095 (+    47us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:17.559283 (+  3188us) tablet.cc:701] Row locks acquired
0709 12:58:17.559308 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:58:17.559523 (+   215us) write_op.cc:270] Start()
0709 12:58:17.559689 (+   166us) write_op.cc:276] Timestamp: P: 1783601897559446 usec, L: 0
0709 12:58:17.559716 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:58:17.560740 (+  1024us) log.cc:844] Serialized 2093 byte log entry
0709 12:58:18.739397 (+1178657us) op_driver.cc:464] REPLICATION: finished
0709 12:58:18.989571 (+250174us) write_op.cc:301] APPLY: starting
0709 12:58:18.995342 (+  5771us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:19.082465 (+ 87123us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:19.100332 (+ 17867us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:19.199193 (+ 98861us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:19.199433 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:19.199480 (+    47us) write_op.cc:312] APPLY: finished
0709 12:58:19.199785 (+   305us) log.cc:844] Serialized 46 byte log entry
0709 12:58:19.200011 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:19.200132 (+   121us) write_op.cc:454] Released schema lock
0709 12:58:19.200185 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:19.200556 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:19.200597 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1938404,"reported_tablets":40,"spinlock_wait_cycles":8874368,"child_traces":[["op",{"apply.queue_time_us":140197,"apply.run_cpu_time_us":4040,"apply.run_wall_time_us":307365,"num_ops":5,"prepare.queue_time_us":143663,"prepare.run_cpu_time_us":14140,"prepare.run_wall_time_us":306338,"raft.queue_time_us":249891,"raft.run_cpu_time_us":21384,"raft.run_wall_time_us":132401,"replication_time_us":1162224,"thread_start_us":557463,"threads_started":4,"wal-append.queue_time_us":297746,"wal-append.run_cpu_time_us":11101,"wal-append.run_wall_time_us":2341363}]]}
I20260709 12:58:23.307478  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:23.279533  3659 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:23.321826  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:23.322449  1599 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:23.328810  3668 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.358018  1672 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:23.292480  3587 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.361194  3122 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.367304  1597 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:23.378000  1594 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:23.381665  3396 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.382321  3396 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.384694  3396 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.385216  3396 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.385728  3396 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.389025  1743 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:23.391099  1598 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:23.283968  1497 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.323803  1603 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:23.363466  3122 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:23.409780  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 214118us
I20260709 12:58:23.394273  3657 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.329475  3659 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:23.420622  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.315412  3637 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:23.428547  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 266301us
W20260709 12:58:23.438584  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.442893  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.432344  1497 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index -1 to 3, term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to <none>, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:23.448318  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:23.432381  3396 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.455329  1497 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.465580  2316 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Advancing to term 4
W20260709 12:58:23.475373  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51418.8us
W20260709 12:58:23.480581  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.502385  1497 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.508286  1497 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 2 to 4, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.514763  1602 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:23.518940  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.474874  3587 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.495414  3636 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.520378  3637 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:23.537492  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89242.7us
I20260709 12:58:23.511169  1497 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index -1 to 3, term changed from 1 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to <none>, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:23.523799  3396 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.474489  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:23.535810  2316 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:23.537200  3636 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:23.579412  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.581604  3716 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:23.552114  3731 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:58:23.583997  3734 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.557747  3122 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.584702  3734 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:23.566305  3636 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.551455  3396 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.600574  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.565704  2313 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:23.607600  3587 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.608210  3587 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.608677  3587 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.612334  1497 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.613418  3396 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.615357  1497 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.617478  1497 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.619743  3727 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.620361  3727 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.625118  3734 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.590574  3122 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:23.627924  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50222.7us
I20260709 12:58:23.630008  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.619315  1497 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.649590  3715 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.654215  3715 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.632858  3122 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.638227  3637 raft_consensus.cc:2764] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:58:23.655369  3565 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 12:58:23.660794  3731 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:23.663516  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.664384  1743 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:23.664855  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.665454  1669 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.661118  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.669443  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.669654  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:23.670864  3668 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.671185  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:23.671434  3668 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.671252  3731 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:23.672006  3668 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.672420  3731 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.672851  3731 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.674068  3691 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.674532  3691 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:23.674399  2721 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.674943  3691 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.676455  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:23.678013  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.679100  3448 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.679512  3448 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:23.679944  3448 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.681751  1669 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:23.682767  3659 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.683421  3691 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.685449  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.686033  3637 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.686283  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.731029  1676 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:23.687044  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:23.731729  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46417.5us
I20260709 12:58:23.732300  1672 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:23.689280  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.690187  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.632452  3727 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.691684  2313 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:58:23.737649  1675 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:23.693640  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.733634  3587 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.741614  1671 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:23.741309  1497 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.694644  2721 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.698661  3668 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.743088  2721 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:58:23.707944  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.709146  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.735612  1674 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:23.739115  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.745265  2721 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.747334  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:23.731238  3637 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.699962  3122 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:23.754731  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52254.5us
I20260709 12:58:23.702699  3636 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.746384  3659 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.751084  3745 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.743464  1497 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.744953  3691 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.744614  3668 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:23.754714  3637 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.764179  3730 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:23.764835  3730 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:23.765858  3730 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.769408  3745 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.769078  3448 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.769846  3745 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.769131  3122 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.761494  3729 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.749619  3657 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:23.759846  1641 connection.cc:256] RPC call timeout handler was delayed by -1.5576263390000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 12:58:23.783565  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.779999  1497 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.775249  3657 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:23.775503  3729 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:23.789948  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.792682  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.794883  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.782853  3448 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:23.796694  3659 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:23.808288  3659 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:23.809326  3659 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.790933  3587 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.792701  3657 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.792800  3729 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.817180  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.810925  3637 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.818898  1497 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.796878  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.821245  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.828516  1497 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.830487  1497 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:23.833678  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.835070  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.836205  3448 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.836512  3723 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:23.836606  3448 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.837234  3448 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.832312  3657 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.844157  3657 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.845111  3636 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.835310  1497 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.849597  2721 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:23.849273  1497 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 5, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.850030  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:23.851580  3637 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.851716  1497 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.853415  1497 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.855880  3448 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.856271  3731 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.857771  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.858517  3448 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.855101  1497 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 2 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.859620  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.861245  2721 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:23.861763  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.862466  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.864444  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.865149  1672 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:23.866472  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.867386  2721 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:23.867774  2721 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.867878  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.868140  2721 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.869175  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.870455  3691 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.871011  3691 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.871457  3691 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.876004  3748 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.876614  3748 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.876981  3748 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.877792  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.878142  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.878712  1672 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
W20260709 12:58:23.879024  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.883829  3448 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:23.885290  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.886137  1672 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:23.887141  2721 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.887511  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.887878  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.888696  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.900426  1748 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:23.901600  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.902017  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.890259  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.890347  3748 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:23.891582  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.901942  2721 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.908149  1676 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:23.909320  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.910511  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.911139  1676 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:23.911764  1672 raft_consensus.cc:2368] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:23.902932  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.912566  1675 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:23.912241  3729 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.912786  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.913512  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.914144  1675 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:23.914179  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.914364  3729 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:23.914789  3748 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:23.915149  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.892256  3668 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:23.918417  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:23.892729  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.893131  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.920307  1670 raft_consensus.cc:1813] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Handling vote request from an unknown peer 693257b3078444e0bd26d3e82159d452
I20260709 12:58:23.920748  1670 raft_consensus.cc:2368] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 2. Current term is 3.
I20260709 12:58:23.921543  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.922230  1748 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:23.922544  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.893525  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.893949  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.894248  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.895224  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.924417  1677 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:23.896142  3731 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.889900  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.903360  1671 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:23.915310  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.918094  3715 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:23.891366  3691 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.928929  2721 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:23.933658  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.929102  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.934842  3691 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.935837  3668 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.936184  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:23.936295  3668 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.932823  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.941406  3668 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.937038  2721 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:23.941587  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:23.942037  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:23.941989  2721 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:23.942672  2721 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.945837  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.944494  3723 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:23.948276  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.949301  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.949743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.949952  1677 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:23.950407  1678 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:23.950587  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.951424  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.952405  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:23.952765  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.951627  3723 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:23.953688  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.954058  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.953500  2721 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:23.956828  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.957011  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.957387  2721 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:23.937433  3691 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.958179  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.958576  3691 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:23.958813  1673 raft_consensus.cc:1813] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Handling vote request from an unknown peer 693257b3078444e0bd26d3e82159d452
I20260709 12:58:23.959020  3691 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.959316  1673 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:23.961455  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:23.964306  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.968808  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.968808  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:23.970455  1672 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.973590  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.974613  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.974795  1674 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:23.977859  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.979404  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.980435  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.981043  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:23.984839  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:23.988443  1744 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:23.999652  1743 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.000926  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:24.001811  1750 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.002255  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:24.004902  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.005705  1677 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:24.006124  1677 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:24.006270  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.007048  1677 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.007520  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.007884  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:24.008060  1677 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.008164  1670 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.008625  1748 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.010421  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.011132  1675 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:24.012948  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 75490.3us
I20260709 12:58:24.015165  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.014302  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.014496  1602 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.016568  1673 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.016166  1750 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:24.017402  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:24.017951  1744 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.019191  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.020371  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.021445  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.022534  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.026942  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.027671  1674 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.030499  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.034844  3745 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:24.036384  2313 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:24.047767  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:24.048491  3745 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:24.053123  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68183.5us
I20260709 12:58:24.055615  1670 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:24.055584  1674 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:58:24.059340  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.059811  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.060266  1746 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.061407  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:24.061679  3668 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.062237  1751 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:24.063759  1673 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:24.065665  1677 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:24.065914  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.067497  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.071060  1675 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:24.077044  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.089743  1748 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:24.093766  3668 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.094017  1744 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:24.096576  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.106276  1743 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:24.110460  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.111469  1602 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.102843  3668 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:24.113847  3668 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.114499  3668 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.126003  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:24.128684  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.128993  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.129882  1602 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:24.129998  1743 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:24.132544  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.133088  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.137972  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.138392  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.138734  1602 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:24.139308  1743 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:24.144902  3691 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.146874  1747 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:24.147645  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51353.4us
I20260709 12:58:24.155314  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.157163  3749 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.157713  3749 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.158123  3749 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.160041  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.161597  3731 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.162230  3731 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.162750  3731 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.161053  1603 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:24.169132  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:24.174906  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.177515  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.179183  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.179401  1603 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:24.170593  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.182252  2721 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:24.182708  2721 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.183019  2721 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.189038  1672 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:24.199724  1598 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
W20260709 12:58:24.203996  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.205613  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:24.210570  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.210738  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.224475  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.226136  2721 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.231981  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:24.232995  2313 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:24.233057  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:24.234725  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.235917  3729 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.236351  3729 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:24.236712  3729 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.237241  1598 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:24.238610  1595 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.239936  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.241783  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.236712  1747 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.248338  1602 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:24.251657  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:24.252672  1673 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:24.249650  2721 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.264117  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.265067  1675 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:24.266096  1673 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:58:24.269902  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.270605  1675 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.273531  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.274261  1673 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.283694  3668 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.292547  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.288825  1674 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:58:24.299019  1600 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.300772  1673 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:24.302161  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.303035  1674 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.270221  3448 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:24.304170  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.304653  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.304973  1601 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.304899  3448 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:24.305874  3448 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:24.305963  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.306643  3668 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.307320  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.306886  3448 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:24.307996  1599 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:24.308452  3448 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:24.308561  3758 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.217s	user 0.000s	sys 0.004s
I20260709 12:58:24.310231  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.319940  3691 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.352514  1675 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:24.357722  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.358641  1675 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.285885  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:24.370379  1670 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:24.365984  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.378139  1602 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:58:24.379357  1595 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:24.382539  1674 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:24.384238  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115927us
I20260709 12:58:24.401254  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:24.403676  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.391759  2313 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.410287  1675 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:24.414379  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 146928us
W20260709 12:58:24.416307  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.416711  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.418221  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49634.6us
I20260709 12:58:24.404456  3659 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:24.427886  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.433071  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.435019  1602 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.436396  3762 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.437093  3762 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.453320  3749 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.460822  3731 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.474936  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.475937  1594 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.479720  3760 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:24.480741  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.481010  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.481021  3760 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:24.481716  3760 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.481946  1595 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.482051  3749 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.483318  1598 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:24.484473  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.484910  1599 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.485329  1597 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.479991  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:24.486603  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.492552  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.492861  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.493359  1673 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.492552  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.496009  1603 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.496834  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.497920  1602 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:24.499529  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77212.2us
I20260709 12:58:24.502668  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.503530  1669 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.482678  3760 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.463431  3729 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:24.518999  3729 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:24.514958  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.520723  1601 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.525131  3731 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.516248  3760 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.519558  1600 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:24.507607  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.483768  3668 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:58:24.499496  3762 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:24.531584  1603 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:24.534888  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.536419  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.537770  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.527977  1673 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:24.538595  1602 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:24.539901  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.540766  1599 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.542059  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.539405  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.544641  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.546032  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.547173  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.547824  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.548583  1594 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:24.549396  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.549943  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.551041  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.550940  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.544708  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.552731  1670 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.549971  1594 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:24.554814  1601 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.557646  1599 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:24.563410  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.572494  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.553802  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.578447  1669 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:24.578866  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.586486  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.592888  1747 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:24.593619  1747 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:24.599457  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45722.6us
I20260709 12:58:24.600096  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.615278  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.616011  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.616698  1602 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.594872  1747 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:24.558317  3773 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:58:24.623873  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.626374  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.629912  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.628113  1603 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.631307  1670 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:24.615286  3668 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:24.632269  2721 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:24.638437  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.670079  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.636302  3668 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.702839  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.636633  3691 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:58:24.703992  1603 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.701659  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.705004  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.706923  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.679239  2313 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:58:24.708052  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.709708  1598 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:24.711966  2721 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:24.712494  2721 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.702806  3668 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:24.703032  3748 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:24.701124  3777 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:24.717295  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 87464.4us
I20260709 12:58:24.719434  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.719939  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.721591  1598 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.722812  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.725884  1602 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 12:58:24.728142  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.729718  1747 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:24.735638  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.737620  1496 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 3 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.740401  3691 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:24.741096  3691 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.742136  3691 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.727806  2721 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.748838  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.749904  1597 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.750231  2721 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.759500  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.760524  1597 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
W20260709 12:58:24.761008  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.766017  1496 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 3, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:58:24.769287  1496 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.769692  3668 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:24.774534  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.775725  1598 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.776908  3730 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:24.778287  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.778801  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.780495  1602 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.780746  3668 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.774547  1599 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:24.792248  3748 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.770182  3565 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:24.772409  3731 raft_consensus.cc:1064] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:58:24.772226  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:24.772583  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:24.794579  3731 raft_consensus.cc:1068] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Unable to promote non-voter 570958eb733a4af7ae16ae020998c8b4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:24.794870  1596 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:24.793638  3748 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.796726  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:24.797048  3778 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.797662  1599 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.804505  3777 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.795219  3565 tablet_bootstrap.cc:492] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:58:24.806178  3565 ts_tablet_manager.cc:1403] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.151s	user 0.070s	sys 0.068s
I20260709 12:58:24.812938  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:24.813833  1675 raft_consensus.cc:606] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:24.814244  1675 raft_consensus.cc:614] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:24.819758  3565 raft_consensus.cc:359] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:24.811488  3779 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.831905  3779 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.834406  3779 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:24.811275  3448 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:24.821100  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:24.822575  3762 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:24.836419  3448 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:24.837190  3762 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:24.837518  3565 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:58:24.805883  3777 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:24.845789  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 127375us
I20260709 12:58:24.848404  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.850576  3691 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:24.851279  3691 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.852510  3691 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.830894  1599 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:24.837662  3762 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:24.825208  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:24.858752  1747 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:58:24.859212  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:24.836422  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:24.863692  3771 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.864120  3771 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:24.864473  3771 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.856956  3762 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:24.868525  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.859212  1747 pending_rounds.cc:85] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 4
I20260709 12:58:24.869395  3762 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:24.869580  1747 pending_rounds.cc:107] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:58:24.869949  1747 raft_consensus.cc:2889] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:24.879091  3749 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:58:24.870899  3779 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:24.872529  3786 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:24.884133  3786 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.884871  3773 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:24.885188  3786 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.873332  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.877249  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:24.888628  3448 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:24.889461  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:24.890102  1747 raft_consensus.cc:2955] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:24.891479  3448 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:24.892278  1566 leader_election.cc:400] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:24.892616  1566 leader_election.cc:403] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:58:24.893860  3448 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:24.896392  3749 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:24.897011  3749 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.904239  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:24.904114  3749 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.900290  1500 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 4 to 3, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.909737  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 76) took 1811 ms. Trace:
I20260709 12:58:24.912213  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.910135  1496 rpcz_store.cc:276] 0709 12:58:23.159778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.166638 (+  6860us) service_pool.cc:224] Handling call
0709 12:58:24.907877 (+1741239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:24.812110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:24.812777 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:24.812827 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:58:24.812859 (+    32us) tablet.cc:662] Decoding operations
0709 12:58:24.813550 (+   691us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:24.813645 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:24.813680 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:24.814050 (+   370us) tablet.cc:701] Row locks acquired
0709 12:58:24.814067 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:58:24.814234 (+   167us) write_op.cc:270] Start()
0709 12:58:24.814359 (+   125us) write_op.cc:276] Timestamp: P: 1783601904814178 usec, L: 0
0709 12:58:24.814382 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:58:24.815170 (+   788us) log.cc:844] Serialized 1364 byte log entry
0709 12:58:24.817690 (+  2520us) op_driver.cc:464] REPLICATION: finished
0709 12:58:24.818212 (+   522us) write_op.cc:301] APPLY: starting
0709 12:58:24.818302 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:24.818469 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:24.818592 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:24.819114 (+   522us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:24.819281 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:24.819329 (+    48us) write_op.cc:312] APPLY: finished
0709 12:58:24.819584 (+   255us) log.cc:844] Serialized 34 byte log entry
0709 12:58:24.819770 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:24.819880 (+   110us) write_op.cc:454] Released schema lock
0709 12:58:24.819935 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:24.821607 (+  1672us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:24.821638 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":125569,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":287,"apply.run_cpu_time_us":2161,"apply.run_wall_time_us":3333,"num_ops":3,"prepare.queue_time_us":32598,"prepare.run_cpu_time_us":3448,"prepare.run_wall_time_us":6402,"replication_time_us":3162,"thread_start_us":39193,"threads_started":1}]]}
I20260709 12:58:24.912916  1675 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.915747  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 161) took 3523 ms. Trace:
I20260709 12:58:24.918345  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.919140  1677 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:24.919836  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.918479  2721 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.920858  3784 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.920805  2721 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.921470  3784 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.922956  2721 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.923269  3760 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:24.924429  3760 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.925781  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:24.925510  3760 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:24.926468  1670 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:24.916181  1497 rpcz_store.cc:276] 0709 12:58:21.392109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.392293 (+   184us) service_pool.cc:224] Handling call
0709 12:58:24.915648 (+3523355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:23.989637 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:23.990279 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:23.990333 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:58:23.990352 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:23.994437 (+  4085us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:23.994554 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:23.994584 (+    30us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:58:24.069298 (+ 74714us) tablet.cc:701] Row locks acquired
0709 12:58:24.069346 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:58:24.069528 (+   182us) write_op.cc:270] Start()
0709 12:58:24.069686 (+   158us) write_op.cc:276] Timestamp: P: 1783601904069464 usec, L: 0
0709 12:58:24.069725 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:58:24.070494 (+   769us) log.cc:844] Serialized 8336 byte log entry
0709 12:58:24.308418 (+237924us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2000129778. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f948103bb91 00007f948105da19 00007f94810288c3 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169 00007f9481031131 00007f948103042d 000000000038f354
0709 12:58:24.390835 (+ 82417us) op_driver.cc:464] REPLICATION: finished
0709 12:58:24.521756 (+130921us) write_op.cc:301] APPLY: starting
0709 12:58:24.530505 (+  8749us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:24.540033 (+  9528us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:24.540076 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:24.546336 (+  6260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:24.546719 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:58:24.546767 (+    48us) write_op.cc:312] APPLY: finished
0709 12:58:24.547257 (+   490us) log.cc:844] Serialized 144 byte log entry
0709 12:58:24.597385 (+ 50128us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:24.607822 (+ 10437us) write_op.cc:454] Released schema lock
0709 12:58:24.607910 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:24.608339 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:24.608370 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":810913,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":111541,"apply.run_cpu_time_us":5769,"apply.run_wall_time_us":86595,"num_ops":21,"prepare.queue_time_us":101933,"prepare.run_cpu_time_us":12649,"prepare.run_wall_time_us":102301,"raft.queue_time_us":78811,"raft.run_cpu_time_us":13417,"raft.run_wall_time_us":53973,"replication_time_us":320596,"spinlock_wait_cycles":3089664,"thread_start_us":164177,"threads_started":4,"wal-append.queue_time_us":21043}]]}
I20260709 12:58:24.924453  3784 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.931200  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:24.931977  1669 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:24.933681  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.934504  3668 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.934901  3668 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.935284  3668 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.938396  1675 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:24.942917  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.948731  2721 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.949487  2721 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:24.949849  2721 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.954582  1677 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:24.955578  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.958817  3748 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:24.959455  3748 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:24.960592  3748 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.961979  2721 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:24.963781  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.909245  3448 raft_consensus.cc:2764] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:24.909042  3723 raft_consensus.cc:2764] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:58:24.967971  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63803.5us
I20260709 12:58:24.969733  2721 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:24.971151  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.854952  3565 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:24.976495  3771 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:24.980724  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:24.989538  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:24.990592  1675 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:24.985266  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92117.6us
I20260709 12:58:24.986972  3785 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:24.997267  1566 leader_election.cc:400] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 2. Current term is 3.
I20260709 12:58:24.993745  3785 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:25.006124  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.007416  3795 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:25.008124  3795 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.009008  3795 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.009670  3785 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:25.017210  1675 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:25.018285  2721 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.018882  2721 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.019845  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:24.994024  3723 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:25.022858  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.037809  2721 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.046245  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.045526  3793 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:58:25.048290  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53869.5us
I20260709 12:58:25.048513  3779 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:25.049037  3779 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.049243  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:25.049968  3779 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.036361  3691 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:25.051324  3779 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.020439  3668 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.056047  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:25.060652  3565 ts_tablet_manager.cc:1434] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.248s	user 0.010s	sys 0.000s
I20260709 12:58:25.061982  3762 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:25.063082  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-a9a24b102b5d4949a5dd73c9f7d069ad received from {username='slave'} at 127.0.0.1:38702
I20260709 12:58:25.063396  3762 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.063750  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-a9a24b102b5d4949a5dd73c9f7d069ad on tablet a9a24b102b5d4949a5dd73c9f7d069ad with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:25.063906  3762 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.064975  3762 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.055274  3448 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:25.070240  3771 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:25.066644  3691 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:25.073035  3668 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.073241  3691 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.074275  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.075028  1677 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.075649  3793 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:25.076110  3793 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:25.076478  3762 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.076517  3793 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:25.080438  3771 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:25.088876  1675 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.091496  3731 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:25.092695  3731 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:25.092955  1677 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:25.093062  3731 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:25.093334  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.094520  3448 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.087875  1501 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.095062  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.096010  3448 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:25.095515  3731 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.098037  3731 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.094453  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.099164  3809 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:25.100093  3668 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:25.100822  3668 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:25.100859  1501 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.101960  3668 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:25.105930  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.106772  3771 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:25.118203  3771 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.119315  3771 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:25.116431  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.121496  3448 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:25.110097  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.121979  3448 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.122373  3448 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.123224  1501 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.121693  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.126710  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:25.125211  1501 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.132944  3723 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:25.134104  3751 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:25.134174  3723 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.135179  3723 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:25.146499  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.149444  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:25.148168  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 50751.6us
I20260709 12:58:25.126870  3793 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:25.159181  3771 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.157241  3751 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.168952  1566 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:25.180824  3751 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:25.180987  3778 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:25.182261  3778 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.182653  3778 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.184892  1677 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:25.187466  1744 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:25.183640  3778 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.188742  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.191100  1747 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:25.189330  3778 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.193383  3730 consensus_queue.cc:1059] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:25.200620  3730 raft_consensus.cc:3055] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:25.201020  3730 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:25.201969  3730 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:25.194626  1743 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.188776  3793 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:25.191597  3808 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.196151  1744 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.197824  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.198362  3745 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:25.203312  3730 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:25.205766  3751 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:25.217141  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.220458  3809 raft_consensus.cc:2764] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:58:25.205943  3723 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.222605  3723 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:25.148749  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195), now has a pending config: VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:25.208190  3793 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:25.223919  3809 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:25.208987  3810 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:25.225544  3809 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.211769  3773 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.180487  3448 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.223033  3785 raft_consensus.cc:1064] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:58:25.226109  3809 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.225584  3810 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.212951  3774 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:25.226589  3810 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.227006  3774 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:25.227627  3810 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.228010  3774 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:25.229055  3810 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.228967  3785 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:25.229794  3774 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:25.204720  3808 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.232692  3809 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.234480  3809 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.233276  3448 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:25.236835  3808 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:25.239053  2313 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:25.239672  3808 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.251269  1744 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:25.252277  1677 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:25.255740  3668 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.258659  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.259881  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.258512  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:25.260257  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.262923  2313 raft_consensus.cc:2368] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:25.264211  3771 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:25.264686  3771 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:25.265105  3771 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.266829  3795 raft_consensus.cc:2764] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:58:25.241501  3731 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:25.270869  1744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:58:25.271708  1744 raft_consensus.cc:606] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:58:25.274221  3793 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:25.275614  3762 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.275844  1675 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:25.276044  3762 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.278810  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.284597  1744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:58:25.285456  1744 raft_consensus.cc:606] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:58:25.285717  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:25.286180  3795 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:25.277067  3762 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.287442  3795 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.287981  3795 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.288133  3762 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.277689  1500 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196), VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted, no longer has a pending config: VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:25.296947  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.294804  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:25.297958  1566 connection.cc:256] RPC call timeout handler was delayed by -1.27722884100001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:58:25.299386  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.300837  2313 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEARNER]: Advancing to term 4
I20260709 12:58:25.304695  3785 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.305054  3771 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.303501  3808 raft_consensus.cc:2764] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:25.309556  3808 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:25.310711  3808 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:25.311079  3808 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.312208  3808 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.313714  3808 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:25.323623  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.325016  3810 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.326808  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.307354  3771 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:25.329492  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.330799  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.330965  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.329401  3810 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:25.334630  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.337839  3793 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.338286  1590 tablet_service.cc:1558] Processing DeleteTablet for tablet 22373089b38b498393c2161e53b5f016 with delete_type TABLET_DATA_TOMBSTONED (TS 693257b3078444e0bd26d3e82159d452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54650
I20260709 12:58:25.332505  3691 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.342783  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.350862  2313 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:25.353399  3777 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:25.355396  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.331804  3731 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.358171  3795 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.359278  3723 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.368541  3785 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.361299  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.362032  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.363029  1744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:58:25.370452  1744 raft_consensus.cc:606] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:58:25.373188  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.372072  3809 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.374048  3723 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:25.375452  3795 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:25.373716  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.380194  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.380878  3785 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.382041  3731 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.382217  3723 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:25.386044  1549 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:58:25.386636  1549 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0193c6e20d1c4a33997d268895b8c083 already in progress
W20260709 12:58:25.386994  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0193c6e20d1c4a33997d268895b8c083 already in progress
I20260709 12:58:25.382822  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.392299  3723 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.391068  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.392700  3731 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.393620  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.394584  3723 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.394693  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.395399  3810 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.395622  3785 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.397940  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:25.398252  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.395056  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.398808  3785 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.399375  3723 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.399500  3815 tablet_replica.cc:333] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 12:58:25.398038  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.401505  3810 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.400792  3815 raft_consensus.cc:2243] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:25.404381  3815 raft_consensus.cc:2272] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:25.405730  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.406694  3723 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.409982  3785 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:25.411851  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:25.413163  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.413197  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.416149  3723 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:25.414878  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.417124  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.418273  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.416612  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.413522  3815 ts_tablet_manager.cc:1916] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:25.419811  3691 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.419855  3723 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.414176  3731 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:25.420197  3795 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:25.421904  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.421162  3810 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:25.421515  3778 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:25.424997  3762 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:25.425693  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.426072  3762 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.425619  3723 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.429553  3762 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:25.430702  3762 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.432044  3762 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.421096  3731 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:25.434612  3731 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.436021  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:25.438818  3778 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.439116  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.440073  3729 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:25.440250  3691 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.442373  3751 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:25.442983  3751 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.446080  3778 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.447944  3748 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:25.448531  3748 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:25.448948  3748 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:25.451110  3691 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.453310  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.456378  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.456493  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.455276  3810 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:25.457581  3729 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.458729  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.458545  3808 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.455657  3795 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.448036  3751 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.464665  3668 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.461959  3729 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.466480  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.472738  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:25.473636  3668 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.478822  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.477221  3785 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:25.482997  3795 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.483186  3785 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:25.484751  3785 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.520255  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.521245  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:25.515266  3691 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.530081  1677 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:25.533849  1677 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:25.537240  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.542363  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.543697  1675 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:25.544917  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:25.547260  1675 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:25.547350  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.548990  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:25.551064  1675 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:25.553673  1675 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:58:25.557770  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 118754us
I20260709 12:58:25.558593  1677 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:25.559680  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.489876  3748 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.565261  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.569216  1597 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:25.565804  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.566977  2316 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:25.570672  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.572305  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.574056  1744 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.512455  3731 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.581321  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.582965  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.587777  2315 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:25.530632  3785 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:58:25.592231  1743 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:25.586773  1677 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:25.601430  2721 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:25.598434  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.602955  1603 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.603233  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.601943  2721 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.607848  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.608865  1596 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.609313  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.612008  1751 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.614483  1675 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:25.607944  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.615887  1602 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:25.616397  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.617061  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.617601  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.618942  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.620133  1600 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 2: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.621640  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.622356  1670 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:25.624684  1595 raft_consensus.cc:2368] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8.
I20260709 12:58:25.617033  1598 raft_consensus.cc:2376] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2. Re-sending same reply.
I20260709 12:58:25.629616  2721 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.630913  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.568239  3751 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:58:25.568239  3448 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:58:25.634667  1601 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.634104  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.637835  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.641428  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.642341  1603 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.642488  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.646867  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.648216  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.649020  1602 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.583935  3778 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:58:25.660384  1600 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:25.667961  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.597549  3723 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:58:25.675207  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.679280  1675 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:25.682443  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.688249  1743 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:25.689425  1597 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:25.690205  1599 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:25.690704  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.695835  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.696496  3723 consensus_queue.cc:1243] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:25.696931  1746 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:25.697074  3751 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.698133  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:25.720103  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.720993  1603 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.698935  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:25.691690  3792 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:58:25.723007  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.723469  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.724452  1673 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:25.699774  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.725453  1672 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:25.719399  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.726533  1670 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:25.699275  1748 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:25.727691  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.633692  3729 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:58:25.736392  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.737416  1597 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.737964  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.715247  1747 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:25.740711  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:25.723580  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 87601.3us
I20260709 12:58:25.673909  3448 consensus_queue.cc:1243] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:25.745044  3748 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.706251  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.742691  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.719084  3749 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:25.744340  1598 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:25.747413  1675 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:25.752262  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.748325  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.749076  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:25.736274  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.753695  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.754504  1602 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.749287  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.745383  3448 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:25.751760  3777 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.765703  3777 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.759364  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.773339  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.774727  1596 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:25.758786  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.768138  2721 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:25.755924  1601 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:25.775877  1675 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:25.776638  1601 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:25.776628  2721 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:25.777180  1601 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.777987  1601 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.778074  2721 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:25.778993  1601 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.769272  1600 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:25.779685  2721 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:25.775192  1596 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.780856  1672 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:25.718840  3751 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.740367  1501 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.781635  1596 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.792676  1596 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:25.779994  1600 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.786829  1598 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:25.764745  3816 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:58:25.760458  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:25.801625  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.790844  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.797106  1600 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:25.806394  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.757156  3448 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:25.782356  3748 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:25.818468  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49324.6us
I20260709 12:58:25.822333  1672 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:25.823182  1600 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.819167  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:25.830861  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57592.3us
I20260709 12:58:25.831473  1675 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:25.832370  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:25.834563  1501 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.786669  3786 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:58:25.757033  3749 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.851004  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:25.852377  1603 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:25.856865  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.857810  1672 raft_consensus.cc:2368] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:25.861316  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.862429  2721 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:25.863004  2721 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:25.863428  2721 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:25.856240  3785 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:58:25.868151  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.869171  3785 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:25.871978  1672 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:25.825307  3777 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.878579  2721 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:25.895093  1673 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:25.901775  1673 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.900843  2721 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.904393  1677 raft_consensus.cc:1217] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 5.3->[]
W20260709 12:58:25.904604  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.905269  1677 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:58:25.854919  3729 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.848376  3817 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:25.912153  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:25.931269  1677 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:25.854158  3731 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:25.924003  1603 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.920306  1673 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.934180  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.934355  1603 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.937739  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.939266  1678 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:25.941684  1671 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:25.936599  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.907063  3785 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.911906  3668 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.940773  1677 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:25.944591  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:25.944658  2721 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:25.951944  2721 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:25.952075  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:25.952457  3825 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:58:25.953557  2721 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:25.949656  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 117371us
I20260709 12:58:25.950376  1603 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.954102  2721 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.952210  3835 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:25.943122  1673 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:26.075851  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 119220us
I20260709 12:58:25.954716  3785 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.110028  1744 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:26.043641  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:26.112916  3838 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:26.148497  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:26.150478  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:26.161506  3838 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:26.162212  3838 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:26.164799  1669 raft_consensus.cc:2410] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:25.937747  3777 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:58:26.116896  1743 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:26.173638  1596 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:25.959929  3835 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:26.079092  1748 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.907574  3448 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.182350  3448 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.997068  3834 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.895418  3751 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.060261  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:26.044483  1671 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:26.004371  3813 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:58:25.841058  3824 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:26.112484  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:26.120105  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76611us
I20260709 12:58:26.191394  1671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22373089b38b498393c2161e53b5f016"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:25.952828  3823 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:58:26.113739  1601 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:26.117175  1751 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:26.130580  1673 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:26.178722  1600 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:26.195953  1677 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:26.120487  3832 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.192858  1671 raft_consensus.cc:606] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:26.206705  1671 raft_consensus.cc:614] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:26.180912  2721 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:26.187458  3818 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:58:26.116945  3749 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:26.121348  3785 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:26.005210  3831 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:26.199043  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 138866us
I20260709 12:58:26.211884  3834 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:26.216180  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:26.199771  3826 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:26.212023  3691 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.005s
I20260709 12:58:26.203091  3762 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:26.204111  1678 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:26.205049  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:26.180343  3778 consensus_queue.cc:1243] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:26.163177  3838 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.218346  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:26.202544  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 90114us
I20260709 12:58:26.231763  2721 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:26.232820  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.228451  3691 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:26.243628  3760 raft_consensus.cc:993] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: : Instructing follower 570958eb733a4af7ae16ae020998c8b4 to start an election
I20260709 12:58:26.236457  3778 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:26.258064  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:26.262552  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.263630  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.245621  3774 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.213657  3832 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.248500  3748 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:26.231426  3829 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:58:26.292068  1597 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:58:26.295212  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.251688  3795 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:58:26.289433  3760 raft_consensus.cc:1081] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Signalling peer 570958eb733a4af7ae16ae020998c8b4 to start an election
W20260709 12:58:26.304934  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 73472.4us
W20260709 12:58:26.297356  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.305801  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:26.295562  3778 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:26.232954  3835 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.313879  1595 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:26.313177  3810 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:26.322281  3833 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:26.322928  3833 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:26.323367  3833 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:26.325419  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.355211  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:26.363693  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89225.8us
W20260709 12:58:26.370234  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.373783  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55041.5us
I20260709 12:58:26.374871  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:26.376699  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:26.330775  3795 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:58:26.319379  3809 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:58:26.353628  3810 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:26.334407  3762 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:58:26.395680  1566 leader_election.cc:400] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:26.396136  1566 leader_election.cc:403] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:58:26.379586  3774 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:26.384608  3847 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:26.386364  3778 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:58:26.400238  3834 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:26.431026  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 65228.8us
W20260709 12:58:26.425933  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49339.9us
I20260709 12:58:26.434283  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:26.398041  3829 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:58:26.452183  3842 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:58:26.453653  3852 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:26.455819  1598 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:26.400677  3843 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:58:26.436029  3832 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:26.468434  3866 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:26.455076  3859 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:26.495209  1748 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:26.425500  3844 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:58:26.516022  3774 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:26.510010  3845 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:58:26.485556  3849 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:58:26.512403  3832 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.497396  3818 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:26.479517  3851 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:58:26.480541  3848 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:58:26.567274  3832 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.585438  3832 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:26.580272  3854 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:58:26.607883  1674 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.557720  3866 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:26.477994  3810 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.613149  3815 ts_tablet_manager.cc:1929] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:26.567171  3818 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.662303  3745 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:26.663122  3745 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:26.664531  3745 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:26.666666  3745 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.674983  3723 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:26.675858  3723 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:26.677122  3723 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.679216  3723 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.694031  3818 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:26.650175  3815 log.cc:1199] T 22373089b38b498393c2161e53b5f016 P 693257b3078444e0bd26d3e82159d452: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/wals/22373089b38b498393c2161e53b5f016
W20260709 12:58:26.710497  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.711884  3861 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:26.712597  3861 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:26.713840  3861 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:26.722782  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.739046  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:26.740125  1677 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.754240  2721 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.754876  2721 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.710294  3808 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:26.759956  3829 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.767270  2721 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:26.783809  2721 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:26.798825  2721 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:26.803776  2721 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:26.807446  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.792456  3818 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:26.810312  3818 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.792884  2313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
 from {username='slave'} at 127.0.0.1:36870
I20260709 12:58:26.812085  2313 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.812682  2313 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.812602  3818 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:26.767877  3829 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:26.855815  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.862118  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.830044  2279 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.997s (SENT)
I20260709 12:58:26.878394  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:26.765864  3861 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.888267  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:26.764015  3808 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:26.892194  2721 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:26.917644  2721 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:26.823203  3829 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:26.912231  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.880s (SENT) [suppressed 56 similar messages]
I20260709 12:58:26.911372  1748 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:26.914991  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:26.919988  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 485666us
I20260709 12:58:26.928653  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:26.924469  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:26.938656  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:26.941116  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:26.916514  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.950933  3815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54650 (request call id 67) took 1613 ms. Trace:
I20260709 12:58:26.951484  3815 rpcz_store.cc:276] 0709 12:58:25.337596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.337878 (+   282us) service_pool.cc:224] Handling call
0709 12:58:25.383811 (+ 45933us) ts_tablet_manager.cc:1151] Deleting tablet 22373089b38b498393c2161e53b5f016
0709 12:58:25.399134 (+ 15323us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:58:26.148418 (+749284us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:26.581430 (+433012us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:26.950816 (+369386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":44624,"thread_start_us":38173,"threads_started":1}
I20260709 12:58:26.953492  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:26.954445  1674 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:26.929534  1677 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:26.930804  1678 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.824342  3859 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:26.955466  3846 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260709 12:58:26.938198  3857 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:26.956187  3843 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:26.999981  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.009s
W20260709 12:58:27.003010  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.010s	sys 0.009s
W20260709 12:58:26.989423  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 159414us
W20260709 12:58:27.006282  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 593363us
I20260709 12:58:26.978366  3448 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.014904  1566 leader_election.cc:400] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
W20260709 12:58:27.023206  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.979480  3795 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:58:27.002061  3839 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.627s	user 0.005s	sys 0.002s
I20260709 12:58:26.794982  3866 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:27.045823  3758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.193s	sys 0.319s
W20260709 12:58:27.051564  3758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.193s	sys 0.319s
I20260709 12:58:27.048869  2721 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.053419  2721 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.055851  3864 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.056376  2721 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.056505  3864 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:27.059038  3864 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.002331  3868 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:27.078500  3833 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.755s	user 0.001s	sys 0.014s
I20260709 12:58:27.071026  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 990) took 1177 ms. Trace:
I20260709 12:58:27.082459  1676 rpcz_store.cc:276] 0709 12:58:25.893848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.894867 (+  1019us) service_pool.cc:224] Handling call
0709 12:58:25.916400 (+ 21533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.916976 (+   576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.917003 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:26.168340 (+251337us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b2c0013c2c8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 12:58:26.186177 (+ 17837us) log.cc:844] Serialized 564 byte log entry
0709 12:58:26.303110 (+116933us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:26.303174 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.304775 (+  1601us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:27.067521 (+762746us) raft_consensus.cc:1685] finished
0709 12:58:27.067595 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.070925 (+  3330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8044800,"thread_start_us":116506,"threads_started":1,"wal-append.queue_time_us":213611}
I20260709 12:58:26.983289  3859 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.066695  3864 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.105777  3864 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.108487  3864 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.014437  3843 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.043154  3818 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:58:27.132196  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1482) took 1239 ms. Trace:
I20260709 12:58:27.134001  1671 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:27.134266  1670 rpcz_store.cc:276] 0709 12:58:25.892523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.893476 (+   953us) service_pool.cc:224] Handling call
0709 12:58:25.893805 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.894184 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.894212 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.920200 (+ 25988us) log.cc:844] Serialized 26 byte log entry
0709 12:58:26.281040 (+360840us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:26.387566 (+106526us) log.cc:844] Serialized 14 byte log entry
0709 12:58:26.709352 (+321786us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180031ac20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:27.131493 (+422141us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b180031ac20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287
0709 12:58:27.131708 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.131817 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:27.131879 (+    62us) raft_consensus.cc:1685] finished
0709 12:58:27.131896 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.132096 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14132,"prepare.queue_time_us":154549,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":86951,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":13299,"spinlock_wait_cycles":41439360,"thread_start_us":486866,"threads_started":3,"wal-append.queue_time_us":437910}
I20260709 12:58:27.042599  3448 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.130470  3838 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:27.160190  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.132738  3864 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.130565  3762 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.047345  3808 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.169077  3867 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.166970  3838 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.171010  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:27.196421  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 284203us
I20260709 12:58:27.118111  3833 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.207705  2721 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.208907  1748 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:27.208866  2721 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.207767  1744 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:27.210266  1743 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:27.209252  1715 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.934s (SENT)
W20260709 12:58:27.213768  1715 leader_election.cc:336] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.945s (SENT)
I20260709 12:58:27.216068  3786 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.216928  3786 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:27.218592  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.984s (SENT)
I20260709 12:58:27.219794  3873 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.220081  3828 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.220887  1746 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:27.220676  3828 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.222558  1750 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:27.199445  3867 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.224483  3871 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.225081  3871 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.225770  3830 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.226518  3830 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:27.227646  3872 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:58:27.229324  3830 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.230005  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:27.230904  1672 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:27.219120  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:27.232583  1715 leader_election.cc:336] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.043s (SENT)
I20260709 12:58:27.232970  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.233023  3818 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.235181  3818 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.237035  3448 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.237818  3448 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:27.237900  3818 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.238528  3448 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.241511  3832 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.233049  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:27.248252  1746 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:27.250367  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.251441  1744 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:27.254871  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:27.204429  3834 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.002s
I20260709 12:58:27.270891  2721 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.273921  1750 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:27.201742  3854 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:27.195130  3809 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:58:27.193796  3762 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:27.284363  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51805.5us
W20260709 12:58:27.284504  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 336964us
W20260709 12:58:27.288426  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.171053  3864 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:27.292398  1715 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.051s (SENT)
I20260709 12:58:27.220592  3873 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.260257  3786 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.280288  3854 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:27.314453  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67266.2us
I20260709 12:58:27.282670  3834 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:27.279469  3861 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.284866  3668 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:27.284152  3868 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:27.372891  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 80528.3us
W20260709 12:58:27.389814  1715 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.120s (SENT)
I20260709 12:58:27.390403  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:27.386601  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 88436.8us
W20260709 12:58:27.392831  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.394951  3828 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.394966  3867 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:27.396420  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.396519  3871 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:27.399194  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.399677  3871 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.402019  3871 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.397500  3859 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.403417  3859 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.403844  3859 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:27.414872  1672 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:58:27.413354  1715 leader_election.cc:336] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.139s (SENT)
I20260709 12:58:27.429755  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:27.302677  3795 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 12:58:27.371101  3854 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.441152  2721 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:27.441530  1715 leader_election.cc:336] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.142s (SENT)
I20260709 12:58:27.416009  3868 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.453368  3902 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.406028  3786 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.445902  3691 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.454144  3902 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.465886  3884 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.466004  3691 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.466856  3884 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:27.438890  3826 consensus_meta.cc:287] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 1.213s	user 0.014s	sys 0.005s
I20260709 12:58:27.471118  3909 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:27.404927  3859 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.474185  3852 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.478782  3808 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:27.482908  3870 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.439s	user 0.001s	sys 0.001s
I20260709 12:58:27.430509  3834 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:27.507684  3859 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.508111  3834 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:58:27.509954  3877 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:58:27.510614  3834 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.486502  2721 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.500672  3852 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:27.511890  3751 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.511941  2721 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.512516  3852 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.507752  3762 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.513834  3852 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.435005  3867 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:27.516155  3833 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.516592  3867 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.518903  3867 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.416751  3871 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.525738  3871 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.526891  3448 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.511261  3834 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.527963  3834 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.530197  3834 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.492303  3668 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.493599  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 80) took 1248 ms. Trace:
I20260709 12:58:27.534106  1497 rpcz_store.cc:276] 0709 12:58:26.244856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.245037 (+   181us) service_pool.cc:224] Handling call
0709 12:58:26.444367 (+199330us) spinlock_profiling.cc:243] Waited 977 us on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:58:27.493489 (+1049122us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":2942080}
I20260709 12:58:26.953316  1485 catalog_manager.cc:5028] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): tablet 22373089b38b498393c2161e53b5f016 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
W20260709 12:58:27.535964  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 582575us
W20260709 12:58:27.499033  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57521.7us
I20260709 12:58:27.490089  3909 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:27.547982  3723 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.868s	user 0.015s	sys 0.000s
I20260709 12:58:27.547657  3909 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:27.548506  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.549296  3909 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.549913  3864 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.505434  3818 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.550621  3808 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:27.550843  3818 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.551357  3808 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.553157  3818 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.497848  3826 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:27.553766  3808 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.554557  3880 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:27.555227  3880 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.555790  3723 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:27.556547  3835 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.556512  3723 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.501919  3889 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.557946  3889 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:27.538987  1715 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.209s (SENT)
I20260709 12:58:27.388473  3861 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.559895  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:27.561014  3818 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:27.563494  2313 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.006s
I20260709 12:58:27.532670  3668 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.564229  3723 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:27.559320  3882 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
I20260709 12:58:27.574641  1744 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:27.575011  1746 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:27.576459  1748 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:27.577616  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.578962  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:27.579623  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 204148us
I20260709 12:58:27.580957  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.591871  1752 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:27.560089  3745 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.893s	user 0.010s	sys 0.007s
W20260709 12:58:27.588277  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.593231  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:27.591373  1747 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:27.599221  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.594460  3901 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.604763  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:27.605463  1677 raft_consensus.cc:2376] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4. Re-sending same reply.
I20260709 12:58:27.594657  2313 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.606302  1669 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:27.604547  3901 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.596076  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.608060  1673 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:27.608276  1745 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:27.608507  3901 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.608757  1598 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:27.599007  3864 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.609596  3864 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.607378  3760 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:27.596771  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:27.611989  3691 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.612612  1671 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:27.601384  2721 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.603423  3809 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:27.614622  3809 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.617205  3809 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.603750  3884 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.601330  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.605489  3859 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.618909  3859 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.619570  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.620286  1752 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:27.621548  3859 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.594434  3808 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.622777  3808 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.600986  1749 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:27.625168  3808 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.626718  3873 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:27.628238  1594 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:27.611994  3864 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.589879  3818 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.642313  3867 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.642396  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:27.642737  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 949) took 2020 ms. Trace:
I20260709 12:58:27.642874  3867 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.643386  2315 raft_consensus.cc:2410] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:27.643143  1594 rpcz_store.cc:276] 0709 12:58:25.622510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.781885 (+159375us) service_pool.cc:224] Handling call
0709 12:58:25.805086 (+ 23201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.641356 (+1836270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.642452 (+  1096us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54003b3154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:27.642647 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4191395584}
I20260709 12:58:27.628886  3902 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.623751  3868 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.633344  3838 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.635634  3830 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.588726  3865 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:58:27.594403  3908 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:58:27.637867  1671 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:58:27.682384  1671 pending_rounds.cc:85] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 2
I20260709 12:58:27.682750  1671 pending_rounds.cc:107] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:58:27.683115  1671 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.638741  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:27.640539  1677 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:27.632100  3861 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:27.656042  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 117144us
I20260709 12:58:27.659374  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:27.664541  1600 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:27.672187  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:27.664873  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.627297  3843 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.667249  1599 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:27.704708  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:27.668041  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.672971  1602 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:27.675305  1596 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:27.707039  1602 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:27.670516  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:27.676724  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.678470  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:27.677139  1595 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:27.708576  1598 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:27.703240  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:27.709534  1600 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:27.632133  3748 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.603121  3880 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.703509  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:27.666556  1601 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:27.732056  1601 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:27.733537  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63093.3us
I20260709 12:58:27.735312  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.736501  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:27.736972  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.740688  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:27.706456  1594 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:58:27.743604  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.744356  1594 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:27.745411  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:27.746687  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.749408  1599 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:27.737841  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:27.712014  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:27.728266  1597 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:27.730710  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:27.750869  1678 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.732110  1602 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:27.751744  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.753441  1597 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:27.753855  1598 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:27.754719  1597 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:27.754923  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.755878  1601 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.756561  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.752445  1602 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:27.753211  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49807.6us
I20260709 12:58:27.759750  3844 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.763912  3838 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.764379  3892 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:27.765027  3723 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.765611  3901 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:27.766453  3901 consensus_queue.cc:1243] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:27.766785  3910 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.767009  3901 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.767501  3911 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:27.770876  3901 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.764954  3892 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.768261  3448 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:27.772149  3448 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:27.772480  3448 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:27.702167  3810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.027s	sys 0.028s
W20260709 12:58:27.773335  3810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.027s	sys 0.028s
I20260709 12:58:27.774762  3867 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.775233  3892 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.771284  3901 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:27.769045  1601 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.776921  3901 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.729431  3843 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.773307  3448 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.780037  3843 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.780813  3448 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:27.782379  3843 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.783946  3901 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.787123  1600 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:27.787986  3884 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.788491  3884 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.789568  3859 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:27.790059  3859 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:27.791471  3884 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:27.802508  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.803287  3899 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.803471  1747 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:27.803912  3899 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:27.802629  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:27.806228  2316 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:27.807027  3889 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.807631  3889 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:27.808092  3889 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.808390  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:27.666554  3871 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:58:27.810776  1601 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:27.703027  3751 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.811702  1603 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.813510  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:27.813871  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:27.809002  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:27.834379  1497 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 2, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.815640  1602 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:27.841297  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.681275  3830 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.790956  3859 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:27.674575  3897 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 12:58:27.740015  3748 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.192317  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.199533  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.201876  2316 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
W20260709 12:58:27.845161  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.203449  1747 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
W20260709 12:58:27.887995  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.181368  1745 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:27.948102  3902 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.206139  3902 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.206652  3902 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:27.751502  3880 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:27.956885  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.212394  1595 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:27.923123  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 185359us
I20260709 12:58:28.216132  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:27.844727  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.210376  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.899677  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.844091  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:27.973719  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.190261  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.171663  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 430988us
I20260709 12:58:27.940639  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:27.753793  3823 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:27.753541  3873 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:28.209986  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.218438  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.224212  2316 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:28.218919  1597 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.220928  1594 raft_consensus.cc:2410] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:28.217401  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.233975  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:28.117352  3818 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:27.946249  3909 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:27.827198  3864 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:28.161640  3913 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 12:58:28.157840  3906 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:58:28.222816  3887 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.899870  3901 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.826617  3809 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:27.806278  3899 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.273217  3809 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.245920  3890 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.900336  3884 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.276222  3890 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.276935  3884 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.277865  3818 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.278620  3890 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.278468  3818 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.130725  3668 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:28.280587  3818 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.210664  1497 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:28.239441  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.238409  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.243043  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:28.284003  1747 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:28.189298  3889 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.285189  3889 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:28.285780  3889 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:28.286993  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:28.287254  3915 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:58:28.211900  3880 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.247835  1746 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:28.245368  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.326362  3880 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:27.945930  3861 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.328018  3861 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.330333  3861 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:28.250965  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.252190  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:28.217180  3904 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 12:58:28.254994  3786 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.343850  3830 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:28.346539  3835 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.789s	user 0.002s	sys 0.012s
I20260709 12:58:28.347275  1752 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:28.367134  3852 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.853s	user 0.007s	sys 0.008s
I20260709 12:58:28.373749  3795 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.374642  3795 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.377692  3795 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:28.378785  3908 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.379287  3908 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:28.379820  3908 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.380761  3904 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.381206  3904 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.381563  3904 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:28.383968  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 127420us
I20260709 12:58:28.384075  3927 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.384711  3927 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.387176  3927 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:28.383910  3854 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.919s	user 0.014s	sys 0.000s
I20260709 12:58:28.388157  3859 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.256757  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:28.389587  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 132932us
I20260709 12:58:28.390630  3830 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.391512  3668 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:28.248680  3864 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.392508  3864 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.392416  3835 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:28.268510  2313 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.393649  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36870 (request call id 218) took 1659 ms. Trace:
I20260709 12:58:28.394049  2313 rpcz_store.cc:276] 0709 12:58:26.733991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.759775 (+ 25784us) service_pool.cc:224] Handling call
0709 12:58:28.268312 (+1508537us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b4c00169280. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f76b13f 00007f947f72f2ab 00007f947f75cf3c 00007f947f75d3fe 00007f947f9ea88b 00007f94813e9495 00007f948143a30f 00007f9481484a55 00007f9486454cd0
0709 12:58:28.393479 (+125167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90929408}
I20260709 12:58:28.244436  3914 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.395421  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.395531  3914 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.396865  3823 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:28.286836  3889 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.398150  3914 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.398718  3902 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.399053  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.399806  1601 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:28.150717  3843 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.400831  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.401041  3843 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.401484  1601 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.402407  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.287710  1594 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.403631  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.404245  1596 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:28.405719  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.406375  1595 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:28.271860  3901 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.407246  3873 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:28.291039  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.290995  3448 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.408444  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.408931  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:28.291437  3916 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:58:28.292275  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:28.294588  3922 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:58:28.417796  1595 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:28.300140  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.301610  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.303102  3818 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.245982  3909 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:28.253949  3866 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.312196  3809 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.313110  3884 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.315296  1603 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:28.315904  3887 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:28.319126  1678 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.002s
I20260709 12:58:27.852560  3751 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.388079  3854 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.391623  3830 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:28.397023  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.434605  3835 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:28.289184  3920 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:58:28.245401  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.257268  3748 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:28.414423  1594 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:28.446297  2315 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:28.416653  1602 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.419049  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.447183  1595 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.419275  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:28.445470  1598 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.422868  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.421250  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.417796  3903 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.430474  1678 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:28.419015  3927 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.436964  3884 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.415964  3448 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.432546  3866 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.436209  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.288375  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:28.475637  1597 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:28.403277  3843 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:28.451994  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.430863  2312 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:28.453217  1600 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:28.419963  3777 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:58:28.458238  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 227878us
W20260709 12:58:28.483371  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 74533us
I20260709 12:58:28.483223  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:28.465167  1601 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:28.484483  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:28.425406  3818 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.472359  1745 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:28.425415  3668 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:58:28.429433  3873 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:58:28.478317  3809 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.481205  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59799.6us
I20260709 12:58:28.506801  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:28.455518  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:28.508904  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 53477.3us
I20260709 12:58:28.459012  3852 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.453536  3901 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.469455  3884 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.498979  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:28.504786  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.511926  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:28.508168  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:28.470994  3909 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.472889  3903 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.481068  3904 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.472813  3927 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.652020  1752 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:28.609427  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1334) took 1008 ms. Trace:
W20260709 12:58:28.653128  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 143571us
I20260709 12:58:28.610241  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.657280  1750 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:28.516582  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:28.654695  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:28.659019  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 146496us
I20260709 12:58:28.661187  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:28.609427  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.661984  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:28.656199  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.512877  3914 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.664789  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:58:28.666162  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 158042us
I20260709 12:58:28.670830  1744 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:28.662436  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 163543us
I20260709 12:58:28.507460  3905 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:28.515834  3830 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:28.518965  3843 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:28.684146  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.545428  3786 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:28.529704  3852 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.511389  3826 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.163s
I20260709 12:58:28.666960  3871 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:28.662859  3859 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.681058  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.667209  3925 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:28.695415  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:28.703490  3866 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.696938  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.666844  3889 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:28.658301  3884 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.671936  3810 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:28.665956  3901 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:28.704262  1744 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:28.516177  3809 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.710911  3859 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.747151  3859 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.748171  3940 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:28.719715  3925 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:28.685282  3748 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:28.716571  3889 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.695650  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:28.711964  1752 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:28.675407  3914 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:28.686019  3843 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.684347  3830 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.686178  3905 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.708196  3668 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:58:28.744694  3901 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.690172  3902 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.698685  3777 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.719787  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.771960  3914 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.777571  3908 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.777597  3777 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.780759  3777 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:28.773872  3864 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.697896  3857 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.706583  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.783715  3903 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.704888  3751 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.692533  3865 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:58:28.784207  1749 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:28.757762  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 80788.2us
I20260709 12:58:28.713932  3828 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:28.653209  1751 rpcz_store.cc:276] 0709 12:58:27.571812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.571951 (+   139us) service_pool.cc:224] Handling call
0709 12:58:27.572405 (+   454us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:27.587148 (+ 14743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.587195 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:27.597448 (+ 10253us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2c0013d8c8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 12:58:27.630557 (+ 33109us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:58:27.678385 (+ 47828us) log.cc:844] Serialized 52 byte log entry
0709 12:58:28.088837 (+410452us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:28.236893 (+148056us) log.cc:844] Serialized 14 byte log entry
0709 12:58:28.237219 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:28.237302 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:28.288564 (+ 51262us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:28.580218 (+291654us) raft_consensus.cc:1685] finished
0709 12:58:28.580252 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:28.580472 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121775,"prepare.queue_time_us":160850,"prepare.run_cpu_time_us":191,"prepare.run_wall_time_us":192,"raft.queue_time_us":16669,"raft.run_cpu_time_us":977,"raft.run_wall_time_us":42546,"spinlock_wait_cycles":34879360,"thread_start_us":357291,"threads_started":2,"wal-append.queue_time_us":469701}
I20260709 12:58:28.714104  3861 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:28.769722  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74178.4us
I20260709 12:58:28.719940  3810 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.701548  3852 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.663654  3880 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.704295  3931 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:58:28.777968  1745 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:28.702375  3871 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.771489  3889 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.745982  3818 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.790782  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.792348  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.789510  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:28.759639  3748 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.760562  3854 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.798815  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.801657  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:28.822257  1751 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:28.776475  3448 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.824237  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:28.825302  1675 raft_consensus.cc:606] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:28.825757  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.826916  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.777601  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.808996  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.828807  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.829010  1752 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:28.829582  1671 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:28.765784  3887 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.783074  3864 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.814044  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.814095  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.838063  1749 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:28.775133  3843 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:28.774616  3866 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.818799  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:28.845932  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 181197us
I20260709 12:58:28.803699  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.774302  3905 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:28.787714  3901 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:28.774811  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.822116  3751 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:28.821636  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.853873  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.783778  3857 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.793490  3828 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.793923  3902 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.838645  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49238.6us
I20260709 12:58:28.805521  3810 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:28.839417  1750 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:28.828217  2317 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.839890  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.846400  1744 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.816607  1748 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:28.847091  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:28.849076  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.850227  1676 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:28.815743  3871 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:28.884078  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:28.884879  1745 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.885334  3880 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.852365  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.852394  1752 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:28.864173  3777 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:28.888273  3777 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.888932  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:28.889629  1752 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:28.889950  1752 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:28.890601  3777 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:28.890743  3859 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.866150  2313 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:58:28.858559  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.865985  3751 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:28.890866  1752 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.787164  3830 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.821771  3748 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.825788  1675 raft_consensus.cc:614] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:28.905635  3909 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:28.905972  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.821148  3933 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.906961  3933 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:28.908221  3928 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 12:58:28.909466  3933 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:28.830615  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.836526  3868 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:28.868685  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:28.805297  3861 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.864601  3934 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:28.832178  3826 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.817804  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:28.879752  1669 raft_consensus.cc:2410] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:58:28.857249  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.893236  3859 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.863031  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:28.893718  3751 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.894320  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:28.896366  1752 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.864189  3930 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:28.897184  3929 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:28.898006  3932 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:58:28.959934  3880 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:28.898641  3943 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:28.960494  3880 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:28.962020  3930 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.962725  3880 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.963644  3826 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.964525  3930 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:28.965615  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.966434  1669 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:28.966799  3826 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.954411  3934 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.968113  3934 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.870302  3925 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.972923  3857 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.878618  3902 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:28.977592  3902 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:28.977593  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83363.2us
I20260709 12:58:28.979061  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:28.981112  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:28.867432  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.910920  1670 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:28.812013  3890 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:58:28.982849  3938 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:28.983731  3887 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.984313  3887 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:28.913348  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.985028  3938 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.985631  1676 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:28.986594  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:28.916424  3861 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.921818  3927 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:28.899518  3924 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.382s	user 0.008s	sys 0.000s
I20260709 12:58:28.934585  1745 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:58:28.912508  3868 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.989049  3868 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.967429  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.991248  1669 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:28.993047  3668 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.993920  3668 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:28.936626  3937 raft_consensus.cc:1064] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:58:28.913316  3908 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.939312  3904 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.003810  3909 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:28.940613  1675 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 3.
I20260709 12:58:28.943869  3852 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.948367  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.009881  1674 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:28.870139  3828 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.012679  3868 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.008374  3937 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:28.950824  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.016129  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.953039  1673 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:28.959051  3751 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.959239  2314 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 1.
I20260709 12:58:28.959762  3929 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.020066  3929 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.901695  3809 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.981913  3939 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:29.027930  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.028893  1669 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:28.986786  3887 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:28.983029  1671 raft_consensus.cc:2410] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:29.038874  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.039710  1671 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 1.
I20260709 12:58:28.933594  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:28.987082  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.041289  1676 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:29.042349  1677 raft_consensus.cc:2368] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:29.042506  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:28.996731  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 133795us
I20260709 12:58:29.043272  1676 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:28.900249  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:29.045248  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:29.045437  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 145229us
I20260709 12:58:29.047075  3887 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:29.047590  3887 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:29.047989  3887 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:29.048309  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.048511  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:29.048962  1596 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.050064  3897 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:29.050441  3897 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:29.050783  3897 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:29.050693  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:29.051975  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.052768  1602 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:29.054379  3937 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:28.967463  1752 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:28.920181  3871 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:28.911852  3777 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:58:29.019474  3868 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:28.979372  3935 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:29.073899  3748 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.060671  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.076723  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.060429  1596 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:29.057827  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:29.135677  1744 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:29.136040  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 78478.6us
I20260709 12:58:29.073944  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.136435  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.062291  3939 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:29.137013  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:29.062252  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.088043  3930 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:29.081904  3828 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.089031  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.089250  3905 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.091141  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.073542  3914 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:29.058605  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57874.4us
I20260709 12:58:29.092490  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.093645  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.095100  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.096499  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.096845  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.068923  3929 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.098116  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.102084  3809 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:29.102329  3904 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.103708  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.104111  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.103487  3908 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.103557  3852 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.105320  3909 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:29.105690  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.145650  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.106984  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.218704  1603 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:29.108481  3897 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.109560  3889 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.220582  3809 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.236207  3889 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:29.237515  3809 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:29.112674  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.070945  3830 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.241073  3830 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:29.082566  3843 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.242543  1603 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:58:29.243682  3843 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:29.105960  3810 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.113701  3857 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:29.114305  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63969.4us
I20260709 12:58:29.133028  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 162) took 3476 ms. Trace:
I20260709 12:58:29.062784  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.250985  1602 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.137089  1596 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.137051  1600 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:29.141026  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:29.252595  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:29.252876  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 111961us
I20260709 12:58:29.142495  1597 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.254900  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.255307  2316 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:29.143985  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.257330  3748 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:29.250650  1501 rpcz_store.cc:276] 0709 12:58:25.656153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.657006 (+   853us) service_pool.cc:224] Handling call
0709 12:58:29.132878 (+3475872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:26.200888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:26.201653 (+   765us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:26.201711 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:58:26.201726 (+    15us) tablet.cc:662] Decoding operations
0709 12:58:26.202483 (+   757us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:26.202546 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:26.202587 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:58:26.203018 (+   431us) tablet.cc:701] Row locks acquired
0709 12:58:26.203032 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:58:26.203228 (+   196us) write_op.cc:270] Start()
0709 12:58:26.203360 (+   132us) write_op.cc:276] Timestamp: P: 1783601906203170 usec, L: 0
0709 12:58:26.203379 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:58:26.244204 (+ 40825us) log.cc:844] Serialized 1763 byte log entry
0709 12:58:26.610557 (+366353us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481488e28 00007f9484ec3581 00007f9484ec2d58 00007f9484ec79f1 00007f9484ec79a9 00007f9484ec7939 00007f9484ec7901 00007f9484ec6b2d 000000000038f354 000000000038f199
0709 12:58:27.279728 (+669171us) op_driver.cc:464] REPLICATION: finished
0709 12:58:28.006861 (+727133us) write_op.cc:301] APPLY: starting
0709 12:58:28.030572 (+ 23711us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:28.093728 (+ 63156us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:28.093772 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:28.158103 (+ 64331us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:28.195845 (+ 37742us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:58:28.209052 (+ 13207us) write_op.cc:312] APPLY: finished
0709 12:58:28.221893 (+ 12841us) log.cc:844] Serialized 40 byte log entry
0709 12:58:28.435690 (+213797us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:28.437418 (+  1728us) write_op.cc:454] Released schema lock
0709 12:58:28.441440 (+  4022us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:28.898916 (+457476us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:28.904295 (+  5379us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b1800048880. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:28.904463 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:28.904496 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":664333,"apply.run_cpu_time_us":101849,"apply.run_wall_time_us":504367,"num_ops":4,"prepare.queue_time_us":358898,"prepare.run_cpu_time_us":9686,"prepare.run_wall_time_us":409926,"raft.queue_time_us":108543,"raft.run_cpu_time_us":821,"raft.run_wall_time_us":39940,"replication_time_us":998131,"spinlock_wait_cycles":103281408,"thread_start_us":971905,"threads_started":4,"wal-append.queue_time_us":259284}]]}
I20260709 12:58:29.211129  1678 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:58:29.212913  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:58:29.262816  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50003.7us
I20260709 12:58:29.263718  3823 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:29.264087  3857 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:29.264503  3823 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:29.265224  3857 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.213757  1748 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.265723  3823 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.214843  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.215791  1752 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:29.257383  1601 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:29.216636  1594 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:58:29.211094  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.217374  1751 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.270577  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 81) took 1595 ms. Trace:
I20260709 12:58:29.217900  1746 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:29.221040  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 114176us
I20260709 12:58:29.223879  1750 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:29.031354  3884 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.254947  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:29.272809  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.233695  3929 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.246842  1672 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:29.138235  3751 raft_consensus.cc:2764] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:58:29.216172  1595 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:29.271003  1497 rpcz_store.cc:276] 0709 12:58:27.675106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.675383 (+   277us) service_pool.cc:224] Handling call
0709 12:58:29.270511 (+1595128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:28.670010 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:28.814994 (+144984us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:28.818732 (+  3738us) write_op.cc:435] Acquired schema lock
0709 12:58:28.826205 (+  7473us) tablet.cc:662] Decoding operations
0709 12:58:28.893394 (+ 67189us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:28.893459 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:28.893490 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:28.893823 (+   333us) tablet.cc:701] Row locks acquired
0709 12:58:28.893848 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:58:28.894026 (+   178us) write_op.cc:270] Start()
0709 12:58:28.894151 (+   125us) write_op.cc:276] Timestamp: P: 1783601908893971 usec, L: 0
0709 12:58:28.894168 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:58:28.895033 (+   865us) log.cc:844] Serialized 1232 byte log entry
0709 12:58:29.099033 (+204000us) op_driver.cc:464] REPLICATION: finished
0709 12:58:29.142968 (+ 43935us) write_op.cc:301] APPLY: starting
0709 12:58:29.145821 (+  2853us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:29.247211 (+101390us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:29.259671 (+ 12460us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:29.260144 (+   473us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:29.260334 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:29.260389 (+    55us) write_op.cc:312] APPLY: finished
0709 12:58:29.260622 (+   233us) log.cc:844] Serialized 28 byte log entry
0709 12:58:29.260858 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:29.260961 (+   103us) write_op.cc:454] Released schema lock
0709 12:58:29.261010 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:29.261470 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:29.261506 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":35430,"apply.run_cpu_time_us":2345,"apply.run_wall_time_us":122927,"num_ops":2,"prepare.queue_time_us":301654,"prepare.run_cpu_time_us":4730,"prepare.run_wall_time_us":235431,"replication_time_us":204636,"thread_start_us":274778,"threads_started":1}]]}
I20260709 12:58:29.213089  3937 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:29.292593  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.293967  1749 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:29.286845  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.298300  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:29.284718  1500 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 2 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.302237  1500 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 7, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.305265  1500 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 4 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.307968  1500 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.309120  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:29.291244  1602 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:29.099462  3901 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.293042  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.144976  3938 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:58:29.247697  3868 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:29.314550  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:29.254987  3843 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.258807  3939 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.368379  3843 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.310503  1500 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 5, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.325256  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.212663  3930 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.335309  1744 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:29.325318  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:29.324028  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.378894  1603 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:29.324564  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:29.347724  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.279793  3943 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:29.279472  3889 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:29.362221  2317 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:29.363109  3905 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:29.142797  3934 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.300007  3826 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 12:58:29.339532  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.370882  1500 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 4, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.374101  1748 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:29.403429  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.275622  3810 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:29.380329  1752 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.222447  3908 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.292163  3937 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:29.381733  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 115533us
I20260709 12:58:29.222662  3852 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.394156  3943 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.360013  3902 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:58:29.384853  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.435035  1745 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:29.436049  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.436636  1745 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.389051  1596 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:29.390792  1597 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:29.319727  3861 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:29.248224  3909 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.397325  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.221011  3904 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.348227  3795 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:29.311846  3880 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:29.405535  1500 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 4 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.404346  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.499923  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.501530  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.409224  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.503371  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.504895  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.404345  1747 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:29.505625  1745 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:29.411893  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.363137  3828 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.299762  3833 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:29.394662  3889 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.304543  3809 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.513504  1500 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 4, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.426934  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:58:29.518092  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91549.3us
W20260709 12:58:29.429466  3944 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:58:29.430323  3946 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:58:29.472502  3861 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.431661  3943 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.431818  3871 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:29.433377  3901 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:29.405102  3868 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.414109  3818 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:29.473783  1746 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:29.494257  1752 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:29.593096  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:29.596854  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 271628us
I20260709 12:58:29.602473  1752 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:58:29.603031  1752 pending_rounds.cc:85] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 4
I20260709 12:58:29.603299  1752 pending_rounds.cc:107] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:29.577613  3861 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.509491  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.620999  1748 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:29.622923  1748 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:29.510754  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.624452  1749 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:29.511586  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:29.498903  3795 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.518309  1500 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 2 to 3, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.627054  1747 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:29.516872  3889 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.640830  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.521793  3833 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:29.528280  3897 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.529280  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.423234  3937 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.561661  3904 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:29.566089  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47251.2us
I20260709 12:58:29.570298  1751 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:29.476184  3786 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:29.664783  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1562) took 1087 ms. Trace:
I20260709 12:58:29.665428  1743 rpcz_store.cc:276] 0709 12:58:28.577749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.580786 (+  3037us) service_pool.cc:224] Handling call
0709 12:58:28.581082 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:28.793242 (+212160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:28.793283 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:28.803525 (+ 10242us) log.cc:844] Serialized 26 byte log entry
0709 12:58:29.092027 (+288502us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:29.092074 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.092151 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:29.664486 (+572335us) raft_consensus.cc:1685] finished
0709 12:58:29.664518 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:29.664698 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106052,"raft.queue_time_us":130611,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":28959,"thread_start_us":359573,"threads_started":2,"wal-append.queue_time_us":447135}
I20260709 12:58:29.514221  3914 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.590400  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:29.604477  1752 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:29.617144  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:29.676548  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.580929  3830 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:29.685525  1671 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:29.507104  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:29.633720  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.630060  1500 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:29.691278  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.691458  1745 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:29.642937  3956 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.601023  3901 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.619658  3818 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:29.639305  3795 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.625599  3843 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.679419  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.639714  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:29.692790  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.696247  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:29.694393  1500 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 4 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.700706  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:29.708199  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 384230us
I20260709 12:58:29.729805  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.729828  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:29.732533  2315 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:29.738152  1672 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:29.739527  1678 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:29.685132  3884 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:29.683637  3909 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.688324  3830 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:29.765092  1747 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:29.771494  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 144199us
I20260709 12:58:29.764621  1677 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:29.818847  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.684949  3786 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.729018  3901 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:29.771842  3843 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:58:29.704435  3956 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.516914  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:30.467846  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 738039us
I20260709 12:58:30.520778  1673 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:58:30.225042  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.001s	sys 0.009s
W20260709 12:58:30.521703  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.001s	sys 0.009s
I20260709 12:58:30.521375  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:30.522794  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:30.468061  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 635272us
I20260709 12:58:29.777740  3859 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:29.867365  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.200139  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.532718  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.498453  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:30.523662  1673 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 2.
W20260709 12:58:30.522032  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 922616us
I20260709 12:58:30.525314  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:29.832401  3830 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:30.539258  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:29.905524  3960 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.268s	user 0.000s	sys 0.007s
I20260709 12:58:29.905423  2312 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:29.904527  3852 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:30.568989  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:29.914805  3828 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:29.862965  3908 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:29.908061  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:30.463111  3887 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.415s	user 0.008s	sys 0.006s
I20260709 12:58:30.549153  1677 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:30.563257  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:30.224781  3950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.003s	sys 0.007s
W20260709 12:58:30.461947  3809 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.939s	user 0.007s	sys 0.006s
I20260709 12:58:30.504696  3930 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:30.111970  3871 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.574119  1669 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:30.400554  3955 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:30.541671  1715 connection.cc:256] RPC call timeout handler was delayed by -2.2666934240000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 12:58:29.912637  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:29.862421  3833 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:29.836037  3884 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.738s
I20260709 12:58:30.581091  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:30.364989  3909 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:30.191327  3927 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.194094  3933 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:30.587234  1674 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:30.580494  3828 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:30.600164  2310 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:30.600731  3908 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:30.739681  3828 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:30.740362  3908 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:30.741339  3828 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.596017  1744 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:30.598850  1670 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:58:30.674086  3973 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:58:30.599978  3809 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:30.602635  2314 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:30.558661  3969 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:30.376951  3777 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:30.531184  3859 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:29.861855  3818 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:30.745752  2282 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.027s	sys 0.024s
W20260709 12:58:30.815585  2282 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.028s	sys 0.024s
I20260709 12:58:30.594249  1745 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:58:30.753966  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 232628us
I20260709 12:58:30.853222  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:30.591429  3950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.004s	sys 0.007s
I20260709 12:58:30.858455  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:30.855266  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:30.660390  3852 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.752031  3964 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:30.903499  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 378223us
I20260709 12:58:30.885862  1669 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:30.926985  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:30.885663  1674 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 12:58:30.932473  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.923969  1716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.003s	sys 0.020s
W20260709 12:58:30.942559  1716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.003s	sys 0.020s
I20260709 12:58:30.847353  3859 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:30.710758  3843 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 12:58:30.956104  1669 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:58:30.598280  3887 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.851960  3823 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:30.852173  3751 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.933328  2313 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:30.847229  3930 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.789049  3933 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.776014  3871 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.789654  3955 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.741575  3908 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:31.002259  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.811568  3927 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.789516  3909 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:30.989158  3751 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:31.009987  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 151594us
I20260709 12:58:31.031672  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:30.847281  3969 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:30.965720  3786 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:30.964308  3978 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:30.847587  3777 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:30.860349  3959 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.168s
W20260709 12:58:31.035485  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 112803us
I20260709 12:58:31.033582  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36884 (request call id 151) took 1648 ms. Trace:
I20260709 12:58:30.945166  3964 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:30.992861  3884 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:31.053918  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 198701us
W20260709 12:58:31.039784  3971 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.268s	user 0.001s	sys 0.001s
I20260709 12:58:30.945609  3852 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:30.999679  3823 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:31.000623  3930 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:31.073201  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 142955us
I20260709 12:58:31.082010  3965 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:31.053704  3901 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.085495  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:31.100813  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.084561  3843 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:31.121338  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.076013  3668 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:31.078179  3956 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:31.097601  3963 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 12:58:31.053282  3978 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:31.116132  3929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.001s	sys 0.021s
I20260709 12:58:31.098587  3980 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:31.131062  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:31.139515  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1581) took 1839 ms. Trace:
I20260709 12:58:31.054980  2313 rpcz_store.cc:276] 0709 12:58:29.363818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.377768 (+ 13950us) service_pool.cc:224] Handling call
0709 12:58:29.912437 (+534669us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b58001f0598. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:58:31.001652 (+1089215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19214720}
I20260709 12:58:31.142086  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:31.142362  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.141738  1746 rpcz_store.cc:276] 0709 12:58:29.300017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.598614 (+298597us) service_pool.cc:224] Handling call
0709 12:58:29.599012 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:29.599385 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:29.599412 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:29.600016 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:58:29.943430 (+343414us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:29.943499 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.943631 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.139283 (+1195652us) raft_consensus.cc:1685] finished
0709 12:58:31.139306 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.139451 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37443,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"thread_start_us":296406,"threads_started":1,"wal-append.queue_time_us":976786}
W20260709 12:58:31.135106  3861 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.491s	user 0.011s	sys 0.007s
W20260709 12:58:31.137032  3929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.001s	sys 0.022s
W20260709 12:58:31.143841  3889 consensus_meta.cc:287] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.490s	user 0.015s	sys 0.005s
W20260709 12:58:31.131665  3835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.004s	sys 0.038s
I20260709 12:58:31.144973  3989 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.163983  3966 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 12:58:31.143589  3980 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.164455  3861 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.127290  3668 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:31.130527  3901 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:31.137368  3956 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:31.173022  3980 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:31.177146  3993 consensus_queue.cc:1059] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:58:31.208817  3935 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:31.177455  3981 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:31.172204  3835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.004s	sys 0.039s
I20260709 12:58:31.213315  3871 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.214511  3969 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:31.215992  3988 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:31.218093  3748 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.218786  3852 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:31.171574  3889 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.220579  3823 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:31.151626  3830 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 12:58:31.193795  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.156211  3843 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:31.151482  3959 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.281116  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.182040  3955 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:31.212648  3795 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.454s	user 0.011s	sys 0.004s
W20260709 12:58:31.167505  3943 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.576s	user 0.011s	sys 0.003s
W20260709 12:58:31.220619  3974 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
W20260709 12:58:31.339336  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:31.288836  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 226272us
I20260709 12:58:31.186165  2314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36884 (request call id 149) took 1882 ms. Trace:
I20260709 12:58:31.373338  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:31.250696  3786 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.181352  3751 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.175668  3861 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.278486  3933 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:31.285677  3975 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 12:58:31.159639  3965 consensus_queue.cc:1059] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.189s
W20260709 12:58:31.365787  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 172115us
W20260709 12:58:31.366541  1500 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.006s	sys 0.008s
W20260709 12:58:31.363297  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 331695us
W20260709 12:58:31.385488  1500 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.007s	sys 0.008s
I20260709 12:58:31.187194  3859 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.221674  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:31.375133  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:31.376209  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 95249.7us
I20260709 12:58:31.355695  3909 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.286101  3957 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:58:31.362083  3835 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:31.390578  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.363258  3987 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:31.371876  3823 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:31.373437  3981 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:31.399526  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:31.399737  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:31.172089  3989 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.403954  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:31.382686  3828 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.641s	user 0.015s	sys 0.000s
I20260709 12:58:31.393078  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:31.420361  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.409365  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:31.377668  3786 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.368420  3830 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.186976  3668 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.413553  1677 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:31.434762  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59754.8us
I20260709 12:58:31.366962  3748 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:31.378504  3795 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.426311  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:31.430567  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.421437  1669 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:31.411952  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:31.438072  1744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 1576) took 2147 ms (client timeout 2816 ms). Trace:
W20260709 12:58:31.479431  1744 rpcz_store.cc:269] 0709 12:58:29.290665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.504578 (+213913us) service_pool.cc:224] Handling call
0709 12:58:31.437855 (+1933277us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000d4654. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:31.438002 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507335552}
I20260709 12:58:31.441954  3927 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.444543  3871 raft_consensus.cc:3055] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:31.445909  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.481622  3871 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:31.448601  3777 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:31.451608  3887 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.452589  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:31.457999  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:31.435693  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:31.424762  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:31.483619  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48056us
I20260709 12:58:31.476938  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1584) took 2113 ms. Trace:
I20260709 12:58:31.484388  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:31.484186  1749 rpcz_store.cc:276] 0709 12:58:29.363686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.625363 (+261677us) service_pool.cc:224] Handling call
0709 12:58:29.625806 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:29.626158 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:29.626190 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:29.643858 (+ 17668us) log.cc:844] Serialized 26 byte log entry
0709 12:58:30.475774 (+831916us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:30.475838 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:30.476111 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.476627 (+1000516us) raft_consensus.cc:1685] finished
0709 12:58:31.476657 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.476862 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10937,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"thread_start_us":287688,"threads_started":1,"wal-append.queue_time_us":932826}
I20260709 12:58:31.485374  3995 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.379020  3943 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:31.485492  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:31.482576  3871 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:31.486160  3909 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:31.486891  3861 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:31.487057  3871 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:31.487617  3909 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:31.488232  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:31.487457  3861 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:31.488641  3909 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.489554  3861 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.491276  3943 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:31.486135  3995 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.492153  3995 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:31.492290  1595 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:31.491519  3908 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:31.495529  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.507895  3995 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.510798  3995 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.510568  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.523413  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.523433  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:31.524490  1598 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:31.525949  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:31.526662  2316 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.529001  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:31.529652  1597 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.362732  3988 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:31.414067  3993 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:31.478037  1673 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:31.432152  3786 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:31.572880  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 162007us
I20260709 12:58:31.572110  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:31.378829  3959 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.408838  3835 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.635910  2315 raft_consensus.cc:2410] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:31.633984  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.469367  3843 raft_consensus.cc:2764] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:58:31.580372  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 149879us
I20260709 12:58:31.374302  2314 rpcz_store.cc:276] 0709 12:58:29.304040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.312187 (+  8147us) service_pool.cc:224] Handling call
0709 12:58:30.133291 (+821104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.792770 (+659479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.185858 (+393088us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b540074c050. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:31.186055 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591780608}
I20260709 12:58:31.475276  3965 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:31.467821  3751 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:31.643513  2316 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:58:31.705029  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.705865  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.705894  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.706990  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.704741  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.696620  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.564596  3668 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:31.698196  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:31.788172  3964 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:31.692842  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56790.2us
I20260709 12:58:31.646944  3908 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:31.704337  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:31.702112  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.709370  1597 raft_consensus.cc:2410] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:31.645391  3777 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:31.776417  1603 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:31.572113  3991 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:31.780740  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.816169  1750 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:31.780928  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:31.419209  3823 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:31.816985  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:31.788949  1746 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:31.702867  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.790463  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:31.822499  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.822672  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:31.824343  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:31.792662  1594 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:31.826326  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.827718  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.828420  1594 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:31.792977  1602 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:31.801523  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 104967us
I20260709 12:58:31.830116  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:31.832219  1566 leader_election.cc:400] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:31.832494  1566 leader_election.cc:403] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:31.792930  1601 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:31.775839  1743 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:31.797827  1745 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:31.806380  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:31.808152  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:31.711819  3965 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.773823  3751 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.646924  3927 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:31.776054  3937 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 2.100s	user 0.013s	sys 0.002s
W20260709 12:58:31.814956  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.785938  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1040) took 1188 ms. Trace:
I20260709 12:58:31.840590  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:31.818404  3991 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.857251  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:31.798018  3909 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.847664  1670 rpcz_store.cc:276] 0709 12:58:30.597958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.598113 (+   155us) service_pool.cc:224] Handling call
0709 12:58:30.598452 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.598713 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:30.783652 (+184939us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.548929 (+765277us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.784389 (+235460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.784602 (+   213us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.784732 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.785166 (+   434us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.785715 (+   549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20357,"prepare.queue_time_us":81264,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":328498,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":17788,"thread_start_us":978530,"threads_started":4,"wal-append.queue_time_us":581204}
I20260709 12:58:31.810606  3843 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.839126  3965 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.784459  4013 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:31.842690  3950 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:31.838667  3981 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:31.810662  3952 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:31.573045  3993 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.863951  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:31.843204  3751 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:31.863324  1600 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:31.868283  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.873394  1750 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:31.864512  4012 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.859395  3937 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.854408  1596 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:31.846912  3861 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:31.862830  3843 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.842535  3983 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.444s
I20260709 12:58:31.859896  3991 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:31.866070  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:31.820362  3777 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.865327  4013 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.889925  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 238) took 1320 ms. Trace:
I20260709 12:58:31.868543  3938 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:31.875372  3986 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.473s	user 0.000s	sys 0.001s
I20260709 12:58:31.892640  3997 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.893149  3992 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.483s	user 0.001s	sys 0.001s
W20260709 12:58:31.893509  3996 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:58:31.894208  4008 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:31.894495  3988 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:32.008641  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:31.895509  3994 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:58:31.896239  4015 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.897251  4002 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:58:31.899611  4011 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:58:31.913152  1602 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:31.869861  3889 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.871747  3959 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.916013  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:31.918126  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 85997.3us
I20260709 12:58:31.880661  3939 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:32.026597  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.922676  1747 rpcz_store.cc:276] 0709 12:58:30.569355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.570320 (+   965us) service_pool.cc:224] Handling call
0709 12:58:30.576413 (+  6093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.055711 (+479298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.055752 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.055807 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.055849 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.889583 (+833734us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540029cf54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:31.889658 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.889841 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101534976}
I20260709 12:58:31.938962  1599 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:31.892004  3843 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:31.944636  4016 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.945510  4014 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.945856  3993 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:31.927639  3938 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.946208  3748 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:31.951042  1748 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:58:32.008342  3859 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:31.955798  3950 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.960088  3909 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:31.962813  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:31.964066  1595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 143) took 2644 ms (client timeout 1608 ms). Trace:
W20260709 12:58:32.132315  1595 rpcz_store.cc:269] 0709 12:58:29.319918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.324230 (+  4312us) service_pool.cc:224] Handling call
0709 12:58:31.963792 (+2639562us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54001b3d54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:31.963950 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4856830208}
I20260709 12:58:31.966054  3969 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:31.885200  3908 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.973694  3934 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:31.975634  4008 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.890841  3861 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.978412  4009 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.979650  3823 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:31.979772  4000 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:31.950233  3997 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.921676  3830 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:31.979679  3999 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:31.695047  2313 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:31.985105  3991 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:31.989357  3777 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:31.927520  3981 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:31.992971  3989 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.000280  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1039) took 1409 ms. Trace:
I20260709 12:58:32.001201  3751 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.003144  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:31.928131  4013 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:32.004472  4021 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.005970  3937 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:32.007211  4003 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:58:32.007843  3835 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.017441  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:32.056154  1750 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
W20260709 12:58:31.890197  3972 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.468s	user 0.000s	sys 0.001s
W20260709 12:58:32.038484  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 160507us
W20260709 12:58:32.082794  2279 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.228s (SENT) [suppressed 6 similar messages]
I20260709 12:58:31.925139  3987 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:32.106350  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:32.008242  3871 consensus_meta.cc:287] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.003s
W20260709 12:58:32.115757  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58332.2us
I20260709 12:58:32.115367  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:31.951813  3795 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.118724  2311 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:32.017616  3933 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.887964  4012 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.145174  1751 raft_consensus.cc:2410] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:32.188771  1671 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:32.189577  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.119890  3938 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:32.215337  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:32.119585  4014 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.119335  4016 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.108413  4015 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:32.557013  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:32.267084  1599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 1374) took 3176 ms (client timeout 1983 ms). Trace:
I20260709 12:58:32.634205  3930 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.242988  1748 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:32.794605  3786 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.161s	user 0.013s	sys 0.000s
W20260709 12:58:32.812408  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.907279  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:32.819146  3939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.008s	sys 0.018s
I20260709 12:58:32.908984  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.854240  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.910962  1669 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:32.912266  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.912879  1669 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:32.913785  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:32.388065  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.839035  1677 rpcz_store.cc:276] 0709 12:58:30.591468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.592782 (+  1314us) service_pool.cc:224] Handling call
0709 12:58:30.705424 (+112642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.434860 (+729436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.999971 (+565111us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54001842d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:32.000186 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627854080}
I20260709 12:58:32.839677  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:32.199149  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.916777  1673 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 2.
I20260709 12:58:32.195149  3934 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:32.923763  1676 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:32.325450  1749 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.014s	sys 0.034s
I20260709 12:58:31.959517  3978 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.811914  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.135505  3909 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:32.812796  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1383) took 1103 ms. Trace:
I20260709 12:58:32.121158  3993 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:32.313212  1744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.006s
W20260709 12:58:32.923166  3939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.008s	sys 0.023s
W20260709 12:58:32.945950  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 868496us
I20260709 12:58:32.874109  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1382) took 1168 ms. Trace:
W20260709 12:58:32.892220  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 676864us
I20260709 12:58:32.946810  1751 rpcz_store.cc:276] 0709 12:58:31.708733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.962521 (+253788us) service_pool.cc:224] Handling call
0709 12:58:32.873806 (+911285us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:32.874023 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28968192}
W20260709 12:58:32.590018  4005 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
W20260709 12:58:32.798614  4018 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 12:58:32.588704  4023 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
W20260709 12:58:32.461735  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.953565  4015 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:32.900141  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:32.954021  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:32.954538  2316 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:32.895879  1599 rpcz_store.cc:269] 0709 12:58:29.090687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.090844 (+   157us) service_pool.cc:224] Handling call
0709 12:58:32.266736 (+3175892us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b5400038254. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:32.266966 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6393977216}
I20260709 12:58:32.955490  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:32.590250  3965 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
W20260709 12:58:32.648553  3980 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.364s	user 0.011s	sys 0.004s
I20260709 12:58:32.956547  3980 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:32.957597  3843 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.000s
I20260709 12:58:32.957516  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.958266  1678 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:32.958086  3843 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.958951  3980 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.130719  3950 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:32.892500  3933 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.961447  3933 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.859350  4021 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.837926  4006 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.963959  4021 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.963706  4006 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:32.964869  1671 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:32.966107  4006 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:32.192556  3859 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.967164  4012 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:32.697039  1717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.008s	sys 0.034s
W20260709 12:58:32.967887  1717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.008s	sys 0.039s
I20260709 12:58:32.924916  3786 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:32.950803  3993 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.970747  3786 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:32.970834  3993 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.858639  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.971843  1675 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:32.973234  1675 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:58:32.924695  1749 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.402s	user 0.022s	sys 0.044s
W20260709 12:58:32.881819  3935 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.468s	user 0.010s	sys 0.005s
W20260709 12:58:32.976006  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 136461us
I20260709 12:58:32.924615  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:32.975054  3950 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.977133  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:32.977746  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:32.979808  3930 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:32.980288  3930 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:32.980672  3930 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:32.980965  3835 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:32.981892  3835 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:32.982234  3835 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:32.940985  3991 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.906409  3937 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:58:32.985319  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:32.987663  3751 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.988915  3950 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.989188  1743 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:32.991189  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:32.992381  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:32.993011  1743 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:32.993840  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:32.994498  1743 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:32.983073  3835 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.997301  4016 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.925992  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:32.856597  3668 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.997844  4014 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.998275  3668 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.002256  3668 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:32.647667  3964 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.856500  3999 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:32.784322  3861 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:32.929311  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:33.003059  3964 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:32.312515  3852 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.933228  2311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 224) took 3239 ms. Trace:
I20260709 12:58:32.987663  3937 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:32.935900  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:32.930063  3934 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:32.940961  3997 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:32.942232  1744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.013s	sys 0.018s
I20260709 12:58:32.136229  3969 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:32.895622  3988 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:32.892392  3989 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:32.895529  3981 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.895126  4026 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.199468  4009 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.950874  3939 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:32.956449  3965 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:32.966868  3859 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:32.186568  4008 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:32.250479  4000 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:32.933116  3987 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.017536  3999 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.068729  4000 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.069730  3859 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.076190  3965 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.076949  3964 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:33.075162  3934 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:33.081049  3939 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.084157  3969 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:33.085985  3969 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:33.055353  4026 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.055660  3981 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.052772  3989 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:33.073463  4032 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260709 12:58:32.967923  1597 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:33.186761  1597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 1397) took 1372 ms (client timeout 1531 ms). Trace:
W20260709 12:58:33.187637  1597 rpcz_store.cc:269] 0709 12:58:31.814316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.816694 (+  2378us) service_pool.cc:224] Handling call
0709 12:58:33.185938 (+1369244us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000794d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:33.186373 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2622384896}
I20260709 12:58:32.949340  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:33.194533  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 245023us
I20260709 12:58:33.009174  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:32.890034  1674 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:33.216856  1671 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:32.918109  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:32.944492  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1043) took 1557 ms. Trace:
I20260709 12:58:32.959095  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:32.941169  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:33.014073  1746 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:32.925066  1748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1385) took 1215 ms (client timeout 1531 ms). Trace:
I20260709 12:58:32.995236  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:33.028788  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:32.929507  1750 rpcz_store.cc:276] 0709 12:58:31.709053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.879378 (+170325us) service_pool.cc:224] Handling call
0709 12:58:32.812706 (+933328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:33.026927  2311 rpcz_store.cc:276] 0709 12:58:29.699824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.907500 (+207676us) service_pool.cc:224] Handling call
0709 12:58:29.908030 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.873348 (+2965318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.932878 (+ 59530us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540069e6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:32.933122 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5075820800}
I20260709 12:58:33.038517  2312 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:33.324958  2314 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:33.297946  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:33.342474  1743 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:33.344730  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:33.345207  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:32.989248  3843 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.374560  3751 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:33.375937  3751 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:33.378348  1748 rpcz_store.cc:269] 0709 12:58:31.709623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.806074 (+ 96451us) service_pool.cc:224] Handling call
0709 12:58:32.924873 (+1118799us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540017d4d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:32.925000 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269691776}
I20260709 12:58:33.040110  3937 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.391640  3937 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.346052  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:33.346226  1678 raft_consensus.cc:606] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:33.393832  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50078 (request call id 13) took 1178 ms. Trace:
I20260709 12:58:33.394032  3965 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:33.394528  1678 rpcz_store.cc:276] 0709 12:58:32.214971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.958933 (+743962us) service_pool.cc:224] Handling call
0709 12:58:33.393584 (+434651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:33.395259  3965 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:33.032516  3852 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.397404  3965 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.406862  1678 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:58:33.271322  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.608s (SENT)
I20260709 12:58:33.347500  1673 raft_consensus.cc:2410] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:58:33.346890  1676 rpcz_store.cc:276] 0709 12:58:31.387441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.387693 (+   252us) service_pool.cc:224] Handling call
0709 12:58:31.408608 (+ 20915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.927163 (+1518555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.944202 (+ 17039us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54002576d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:32.944420 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3472679040}
I20260709 12:58:33.348567  1677 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.408260  3751 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:33.351645  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 155162us
I20260709 12:58:33.217290  1669 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:33.217274  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1527) took 1028 ms. Trace:
I20260709 12:58:33.352566  1747 raft_consensus.cc:2410] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:32.838227  3809 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.997433  3835 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:33.346534  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:33.318013  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.410729  1674 rpcz_store.cc:276] 0709 12:58:32.188408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.189250 (+   842us) service_pool.cc:224] Handling call
0709 12:58:33.216963 (+1027713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:33.488502  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1536) took 1274 ms. Trace:
W20260709 12:58:33.492268  2313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.004s
I20260709 12:58:33.491775  1746 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:33.498673  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1539) took 1284 ms. Trace:
I20260709 12:58:33.547875  1673 rpcz_store.cc:276] 0709 12:58:32.214697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.917784 (+703087us) service_pool.cc:224] Handling call
0709 12:58:33.480224 (+562440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:33.545059  1669 rpcz_store.cc:276] 0709 12:58:32.214002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.913527 (+699525us) service_pool.cc:224] Handling call
0709 12:58:33.488186 (+574659us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540036e2d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:33.488419 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691634944}
I20260709 12:58:33.552369  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:33.555161  2313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.008s	sys 0.004s
W20260709 12:58:33.559983  1672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.013s	sys 0.024s
W20260709 12:58:33.560249  1745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.002s	sys 0.007s
W20260709 12:58:33.560513  1672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.013s	sys 0.024s
W20260709 12:58:33.560808  1745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.002s	sys 0.007s
I20260709 12:58:33.561692  3852 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.562203  3859 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.562445  3978 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.562879  3859 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:33.563151  3978 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:33.565539  3978 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:33.566210  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:33.567142  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.023s	sys 0.009s
W20260709 12:58:33.567569  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.023s	sys 0.009s
I20260709 12:58:33.568284  1750 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:33.568614  3843 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.569607  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:33.569480  3843 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:33.571789  3751 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:33.573057  3751 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:33.577107  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.557367  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:33.604776  1752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.008s	sys 0.025s
I20260709 12:58:33.604990  4026 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:33.605486  1752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.009s	sys 0.025s
W20260709 12:58:33.613039  3969 consensus_meta.cc:287] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.006s
W20260709 12:58:33.615808  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.027s	sys 0.049s
W20260709 12:58:33.616312  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.027s	sys 0.049s
W20260709 12:58:33.617305  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.617358  3937 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:33.618252  3937 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:33.568328  1566 connection.cc:256] RPC call timeout handler was delayed by -2.1782515760000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:58:33.565541  3859 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:33.637108  1566 connection.cc:256] RPC call timeout handler was delayed by -2.1782515760000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:58:33.591164  2312 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:58:33.648257  1566 connection.cc:256] RPC call timeout handler was delayed by -2.0495515760000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:58:33.643287  3935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.019s
W20260709 12:58:33.659509  1749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.009s
W20260709 12:58:33.683491  1566 connection.cc:256] RPC call timeout handler was delayed by -2.0495515760000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:58:33.676559  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 405581us
W20260709 12:58:33.695966  1749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.002s	sys 0.009s
I20260709 12:58:33.696882  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:33.698432  1677 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
W20260709 12:58:33.700088  1566 connection.cc:256] RPC call timeout handler was delayed by -1.9271515760000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 12:58:33.677332  3978 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:33.708762  1566 connection.cc:256] RPC call timeout handler was delayed by -1.9271515760000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 12:58:33.712587  1566 connection.cc:256] RPC call timeout handler was delayed by -1.912751576000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:58:33.714623  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1538) took 1500 ms. Trace:
W20260709 12:58:33.722129  1566 connection.cc:256] RPC call timeout handler was delayed by -1.8713515760000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 12:58:33.720585  1677 rpcz_store.cc:276] 0709 12:58:32.214450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.940826 (+726376us) service_pool.cc:224] Handling call
0709 12:58:33.707758 (+766932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:33.723909  3809 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.726668  3809 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:33.727722  4013 consensus_meta.cc:287] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.000s
I20260709 12:58:33.728145  1671 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:33.728286  4013 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:33.730501  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 234198us
I20260709 12:58:33.731671  4009 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.732489  4009 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:33.733574  3981 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.733692  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:33.734254  3981 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.734905  3981 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.738134  3981 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.738619  3859 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:33.739189  3859 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.739636  3859 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:33.739706  3991 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.738734  3981 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.747339  3978 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:33.749516  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.735384  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:33.750533  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.752161  3809 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:33.752698  3809 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.753113  3809 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:33.755823  4041 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.290s	user 0.000s	sys 0.002s
I20260709 12:58:33.749725  3981 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:33.762391  3909 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.828s	user 0.006s	sys 0.011s
W20260709 12:58:33.739917  2279 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.838s (SENT)
I20260709 12:58:33.758919  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:58:33.741672  1715 connection.cc:256] RPC call timeout handler was delayed by -1.5823075939999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:58:33.773267  1566 connection.cc:256] RPC call timeout handler was delayed by -1.8713515760000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 12:58:33.731215  4013 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:33.714397  3843 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:33.785648  1715 connection.cc:256] RPC call timeout handler was delayed by -1.5787075939999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 12:58:33.787241  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7984515760000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 12:58:33.796347  3989 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.797478  2311 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:33.785622  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:33.785887  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:33.718189  3751 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:33.797515  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:33.807394  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7984515760000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 12:58:33.751029  3978 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.797971  3981 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.763108  3909 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:33.828189  1566 connection.cc:256] RPC call timeout handler was delayed by -1.734551576000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 12:58:33.831492  1674 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:33.832525  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 116725us
W20260709 12:58:33.836099  3938 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.010s
I20260709 12:58:33.840071  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1375) took 2139 ms. Trace:
W20260709 12:58:33.841018  4042 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.378s	user 0.003s	sys 0.003s
I20260709 12:58:33.844281  3830 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:33.856341  1744 rpcz_store.cc:276] 0709 12:58:31.700686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.701191 (+   505us) service_pool.cc:224] Handling call
0709 12:58:31.701540 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.034171 (+1332631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:33.034223 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:33.259170 (+224947us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.554462 (+295292us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:33.627962 (+ 73500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.675106 (+ 47144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:33.839624 (+164518us) raft_consensus.cc:1685] finished
0709 12:58:33.839646 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.839837 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87581,"raft.queue_time_us":86408,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":7981,"thread_start_us":1527095,"threads_started":2,"wal-append.queue_time_us":531280}
I20260709 12:58:33.859331  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:33.860935  4037 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.229s	user 0.000s	sys 0.002s
I20260709 12:58:33.861789  3830 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:33.759723  4038 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:33.850255  4035 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.385s	user 0.002s	sys 0.000s
I20260709 12:58:33.863123  4038 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:33.863945  4044 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 12:58:33.864637  3937 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.740360  3991 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.865841  4038 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:33.867779  3991 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:33.868456  3909 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:33.869736  1670 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:33.851778  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 88390.3us
I20260709 12:58:33.872417  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:33.873410  3859 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.874681  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:33.852612  4026 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:33.862479  3830 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:33.875773  4026 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.876312  4026 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:33.880796  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:33.881649  1674 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:33.883708  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:33.884326  1675 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:33.884567  1669 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:33.885847  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:33.887719  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:33.887557  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:33.871456  1670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 253) took 1868 ms (client timeout 1802 ms). Trace:
I20260709 12:58:33.889124  1674 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
W20260709 12:58:33.889323  1670 rpcz_store.cc:269] 0709 12:58:32.002667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.002807 (+   140us) service_pool.cc:224] Handling call
0709 12:58:33.871154 (+1868347us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540006e354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:33.871361 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429184768}
I20260709 12:58:33.854128  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1372) took 2303 ms. Trace:
I20260709 12:58:33.889153  1669 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:33.884510  1673 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:33.916445  1566 connection.cc:256] RPC call timeout handler was delayed by -1.734551576000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:58:33.938699  1566 connection.cc:256] RPC call timeout handler was delayed by -1.638251576000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 12:58:33.939451  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5779515760000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2268s for a response
I20260709 12:58:33.944605  4038 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.945708  4038 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.891464  1749 rpcz_store.cc:276] 0709 12:58:31.521650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.521837 (+   187us) service_pool.cc:224] Handling call
0709 12:58:31.522157 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.522391 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:32.975892 (+1453501us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.739363 (+763471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:33.739495 (+   132us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.805879 (+ 66384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.819130 (+ 13251us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.824792 (+  5662us) inbound_call.cc:177] Queueing success response
0709 12:58:33.840050 (+ 15258us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
Metrics: {"mutex_wait_us":21960,"prepare.queue_time_us":1492697,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":49846,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":66549,"spinlock_wait_cycles":87660288,"thread_start_us":2183115,"threads_started":2,"wal-append.queue_time_us":486205}
W20260709 12:58:33.954787  3930 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.973s	user 0.011s	sys 0.010s
I20260709 12:58:33.955688  3930 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:33.967654  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0847515760000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2816s for a response
I20260709 12:58:33.913861  4013 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:33.968432  4013 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:33.968928  4013 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.971917  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:33.972786  1597 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:33.972841  1595 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:33.973112  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:33.973843  1669 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:58:33.974491  3937 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.974874  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:33.975311  3937 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:33.977830  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:33.983124  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0847515760000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2816s for a response
W20260709 12:58:33.983946  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0199515760000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2888s for a response
W20260709 12:58:33.984380  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0199515760000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2888s for a response
I20260709 12:58:33.989806  1677 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:33.997128  1676 raft_consensus.cc:2368] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:33.977537  1598 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:34.002249  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:34.016872  3930 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.006038  3909 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:34.018424  3830 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.019263  3909 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:34.020905  3909 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.026033  3809 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.029904  1670 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
W20260709 12:58:34.036317  3999 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.929s	user 0.017s	sys 0.000s
I20260709 12:58:34.036901  3999 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:33.933949  3938 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.039319  3999 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:34.057114  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.051106  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 12:58:34.052695  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 225195us
I20260709 12:58:34.059453  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:34.031466  3937 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.062191  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1587) took 1144 ms. Trace:
I20260709 12:58:34.066670  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.067157  3830 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:34.068876  4008 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.992s	user 0.010s	sys 0.007s
I20260709 12:58:34.072067  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.074293  1746 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:34.074867  1751 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:34.088634  4008 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.088939  1747 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:58:34.091025  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:34.092187  4008 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.092442  3843 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:34.093094  3843 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:34.093243  3938 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.094585  4038 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.094421  3843 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:34.092206  3751 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:34.096143  3751 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.096474  3751 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:34.096858  4026 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:34.099366  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.100014  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.074741  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.075583  1743 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:34.063210  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:34.075938  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.076781  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.077445  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.079802  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:34.081214  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67890.5us
I20260709 12:58:34.082089  3978 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:34.083065  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.083946  3809 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.084208  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:34.106120  1752 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:34.089306  1715 connection.cc:256] RPC call timeout handler was delayed by -1.4320075940000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 12:58:34.110788  1715 connection.cc:256] RPC call timeout handler was delayed by -1.4248075940000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 12:58:34.112408  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.110361  1598 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:34.099095  4026 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.106618  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.104869  3978 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.108980  3859 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.125377  1749 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:34.126403  1747 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:34.105430  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 228) took 2664 ms. Trace:
I20260709 12:58:34.120716  3978 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.120393  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:34.137153  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.138166  1602 raft_consensus.cc:2410] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:34.087867  1745 rpcz_store.cc:276] 0709 12:58:32.909707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.914441 (+  4734us) service_pool.cc:224] Handling call
0709 12:58:32.914751 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.915027 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:33.561394 (+646367us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.818941 (+257547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:33.826839 (+  7898us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:33.930415 (+103576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.942896 (+ 12481us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.053452 (+110556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107385,"prepare.queue_time_us":100431,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":110634,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":34590,"thread_start_us":779898,"threads_started":2,"wal-append.queue_time_us":466169}
I20260709 12:58:34.144521  3897 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:34.153076  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:34.153294  1715 leader_election.cc:336] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.880s (SENT)
I20260709 12:58:34.154057  1600 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
W20260709 12:58:34.154680  1715 connection.cc:256] RPC call timeout handler was delayed by -1.3861075940000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:58:34.156004  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:34.156677  1602 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:34.160033  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.160903  1600 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:34.170480  4013 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:58:34.172827  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81932.6us
I20260709 12:58:34.173184  4013 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.176874  1602 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:34.176043  3897 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:34.155283  1715 connection.cc:256] RPC call timeout handler was delayed by -1.3753075939999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 12:58:34.189239  1715 connection.cc:256] RPC call timeout handler was delayed by -1.3348075939999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 12:58:34.210197  1598 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:34.213702  1715 connection.cc:256] RPC call timeout handler was delayed by -1.2043075939999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23460000000000003s for a response
W20260709 12:58:34.215634  1715 connection.cc:256] RPC call timeout handler was delayed by -1.1251075939999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24340000000000003s for a response
I20260709 12:58:34.215080  1752 raft_consensus.cc:2410] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:58:34.223146  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0981075939999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2464s for a response
W20260709 12:58:34.231827  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0954075939999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24670000000000003s for a response
I20260709 12:58:34.233628  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.234812  1598 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:34.244382  1750 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:34.236366  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 251) took 2230 ms. Trace:
W20260709 12:58:34.255995  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.254338  3830 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:34.261755  3830 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.270776  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.270963  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.247315  1672 rpcz_store.cc:276] 0709 12:58:32.002077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.040910 (+ 38833us) service_pool.cc:224] Handling call
0709 12:58:32.041378 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:32.943435 (+902057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.943468 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:32.955884 (+ 12416us) log.cc:844] Serialized 52 byte log entry
0709 12:58:33.561347 (+605463us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:33.675337 (+113990us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.795961 (+120624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.211814 (+415853us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54001ab8d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:34.211886 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.211958 (+    72us) raft_consensus.cc:1685] finished
0709 12:58:34.220513 (+  8555us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.232376 (+ 11863us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84274,"prepare.queue_time_us":398070,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":92224,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":50684,"spinlock_wait_cycles":2073239424,"thread_start_us":711943,"threads_started":2,"wal-append.queue_time_us":843256}
I20260709 12:58:34.270821  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.273936  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.275020  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:34.290759  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 146704us
I20260709 12:58:34.292086  4039 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:34.292546  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:34.290707  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:34.287983  3937 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:34.294734  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:34.298513  4063 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:34.299104  4063 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.299264  3999 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:34.296991  3937 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.299577  4063 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.300156  3937 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:34.305296  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 248) took 1357 ms. Trace:
I20260709 12:58:34.306408  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.305850  1748 rpcz_store.cc:276] 0709 12:58:32.947894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.380531 (+432637us) service_pool.cc:224] Handling call
0709 12:58:33.382772 (+  2241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.499264 (+116492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:33.499317 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:33.596019 (+ 96702us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.781972 (+185953us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:33.782030 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.782119 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.304986 (+522867us) raft_consensus.cc:1685] finished
0709 12:58:34.305015 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.305206 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66135,"raft.queue_time_us":97761,"raft.run_cpu_time_us":816,"raft.run_wall_time_us":85664,"thread_start_us":95597,"threads_started":1,"wal-append.queue_time_us":560365}
W20260709 12:58:34.307708  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.308109  4038 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:34.308627  4038 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.309067  4038 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.314312  4053 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:34.315572  3897 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:34.316167  3897 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.316690  3897 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.288133  3830 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.324545  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:34.331871  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.335233  1599 raft_consensus.cc:2410] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:34.339624  1747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:58:34.340744  1747 raft_consensus.cc:606] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:34.340348  3751 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.341208  1747 raft_consensus.cc:614] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:34.341953  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.334015  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.344588  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.346429  1602 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.346606  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.346850  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.347342  1595 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:34.347851  1597 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.348673  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.346879  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.349537  1600 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
W20260709 12:58:34.356055  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 48217.8us
I20260709 12:58:34.356331  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.357164  1745 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:34.358341  3751 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.356055  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:34.331358  3830 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:34.369910  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.374202  1598 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.381670  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.382970  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.391731  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.402210  1752 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:34.377900  3751 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:34.403710  1598 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:34.407014  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:34.407709  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:34.414650  1596 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:34.415381  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:34.416815  1745 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:34.405961  3751 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.439963  3751 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:34.424137  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.444304  3897 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:34.450372  3897 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.454141  1596 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:34.458295  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.425593  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.427937  3978 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:34.430351  4053 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.433346  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.436175  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:34.459998  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.457381  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 162695us
I20260709 12:58:34.476293  1745 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:34.134961  2313 rpcz_store.cc:276] 0709 12:58:31.394216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.396836 (+  2620us) service_pool.cc:224] Handling call
0709 12:58:31.435512 (+ 38676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.569205 (+133693us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:32.964607 (+1395402us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.685647 (+721040us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.796072 (+110425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:33.796171 (+    99us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.818988 (+ 22817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.863060 (+ 44072us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:33.931314 (+ 68254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.058982 (+127668us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":387527,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":6843,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":12582,"spinlock_wait_cycles":55061888,"thread_start_us":668313,"threads_started":2,"wal-append.queue_time_us":626886}
I20260709 12:58:34.482776  1752 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
W20260709 12:58:34.483285  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 57794.4us
I20260709 12:58:34.421320  3909 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:34.495043  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 193) took 8603 ms. Trace:
I20260709 12:58:34.495711  1500 rpcz_store.cc:276] 0709 12:58:25.891994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.892173 (+   179us) service_pool.cc:224] Handling call
0709 12:58:26.154744 (+262571us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:58:34.494779 (+8340035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:31.866847 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:31.896154 (+ 29307us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:31.896216 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:58:31.896251 (+    35us) tablet.cc:662] Decoding operations
0709 12:58:31.897877 (+  1626us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:31.897974 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:31.898024 (+    50us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:58:32.400775 (+502751us) tablet.cc:701] Row locks acquired
0709 12:58:32.407699 (+  6924us) write_op.cc:260] PREPARE: finished
0709 12:58:32.572765 (+165066us) write_op.cc:270] Start()
0709 12:58:32.595509 (+ 22744us) write_op.cc:276] Timestamp: P: 1783601912489337 usec, L: 0
0709 12:58:32.595580 (+    71us) op_driver.cc:348] REPLICATION: starting
0709 12:58:32.709691 (+114111us) log.cc:844] Serialized 4417 byte log entry
0709 12:58:34.256055 (+1546364us) op_driver.cc:464] REPLICATION: finished
0709 12:58:34.375379 (+119324us) write_op.cc:301] APPLY: starting
0709 12:58:34.381051 (+  5672us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:34.406625 (+ 25574us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:34.406782 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:34.433029 (+ 26247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:34.433487 (+   458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:58:34.433564 (+    77us) write_op.cc:312] APPLY: finished
0709 12:58:34.434236 (+   672us) log.cc:844] Serialized 82 byte log entry
0709 12:58:34.434551 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:34.434893 (+   342us) write_op.cc:454] Released schema lock
0709 12:58:34.435000 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:34.489437 (+ 54437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:34.490623 (+  1186us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2619,"reported_tablets":16,"spinlock_wait_cycles":10176256,"child_traces":[["op",{"apply.queue_time_us":51203,"apply.run_cpu_time_us":6084,"apply.run_wall_time_us":126218,"num_ops":11,"prepare.queue_time_us":1498199,"prepare.run_cpu_time_us":16542,"prepare.run_wall_time_us":997528,"raft.queue_time_us":1011243,"raft.run_cpu_time_us":11483,"raft.run_wall_time_us":192884,"replication_time_us":1618664,"thread_start_us":1653711,"threads_started":4,"wal-append.queue_time_us":231325}]]}
I20260709 12:58:34.501142  3978 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.490594  3909 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.484889  4053 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.420313  3937 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.505795  4053 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.506675  1597 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.507967  3937 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.512686  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.514276  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.518074  4067 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:34.518705  4067 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.519186  4067 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:34.535992  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.536861  1670 raft_consensus.cc:2368] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:34.526532  4066 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:34.537567  4066 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:34.538013  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.538703  1672 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:34.531087  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:34.518915  1497 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.544662  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:34.544590  1497 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.545351  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:34.538893  4066 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.546293  1497 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.487010  3843 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:34.547896  3843 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.548311  3843 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:34.549371  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 73273.5us
W20260709 12:58:34.549785  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 118224us
I20260709 12:58:34.529202  3909 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.533332  1673 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:34.533478  1677 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:34.531184  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:34.533648  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:34.534843  1669 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:34.553601  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.556779  1670 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.556896  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.557823  1674 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:34.572176  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:34.503281  4063 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:34.566953  1672 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:34.552448  1497 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:34.574582  1676 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:58:34.707245  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.589363  1675 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:34.709956  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49394.3us
W20260709 12:58:34.711618  1715 connection.cc:256] RPC call timeout handler was delayed by -1.2575276790000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:58:34.611163  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:34.699762  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0634895540000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:58:34.711266  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:34.712776  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0148895540000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:58:34.713769  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0130895540000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:58:34.699896  1676 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:34.653270  1497 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.602645  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:34.660200  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49273.3us
W20260709 12:58:34.621213  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.719967  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60639.1us
I20260709 12:58:34.707756  3909 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:34.720158  1678 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:34.707437  4013 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.713444  1671 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.738888  1674 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:34.727653  1497 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:34.678438  3830 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.750794  3830 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.753717  3830 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:34.756119  3843 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.758780  3843 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.761518  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.762660  1597 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.761945  1497 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 3 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.742038  1669 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:34.608038  3937 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:34.763854  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.772179  1596 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:34.767855  3909 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.771134  3937 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.775921  3937 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.749483  4068 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:34.787783  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:34.616760  4063 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.617820  4038 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.801220  1670 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
W20260709 12:58:34.801661  1715 leader_election.cc:336] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.093s (SENT)
I20260709 12:58:34.803259  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:34.804520  1597 raft_consensus.cc:2368] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
W20260709 12:58:34.810119  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.811596  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.813287  1671 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:34.771268  4013 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.818647  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.810695  3809 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:34.821235  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 76062.7us
I20260709 12:58:34.812644  3751 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.833340  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.837556  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:34.838303  1752 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.841286  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.842034  1674 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.844059  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:34.843634  1745 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:34.844857  1676 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.846762  4067 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.849790  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:34.850246  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.852408  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:34.858732  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.859750  1596 raft_consensus.cc:2368] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8.
W20260709 12:58:34.858933  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.101s (SENT)
I20260709 12:58:34.867506  1597 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:34.876523  4013 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.877529  4013 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:34.877974  4013 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:34.878345  4013 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:34.878774  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.879743  1598 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.879932  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.880205  1603 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:58:34.880779  1600 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.880697  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.881445  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.882090  1596 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:34.882125  1602 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:34.889899  1752 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:34.902717  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.903440  1676 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:34.904059  1597 raft_consensus.cc:2368] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:34.906522  1674 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:34.916334  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.917162  1598 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:34.908474  4038 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:34.912487  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.912444  1602 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:34.915316  1595 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:58:34.929332  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.931063  1598 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:34.927930  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:34.932824  3909 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:34.941823  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 101819us
I20260709 12:58:34.942752  3809 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:34.964088  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 128026us
I20260709 12:58:34.958370  4038 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.958702  3909 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.972783  1594 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:34.973503  1603 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:34.981326  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:34.989454  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:35.004765  2279 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.953s (SENT)
I20260709 12:58:35.006232  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:35.008932  1602 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:34.970774  3937 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.988260  3751 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:35.014631  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:35.004839  4084 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:35.010936  4067 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:34.978621  3909 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:34.990764  4038 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:35.020619  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:35.088325  1603 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:35.083463  1602 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:58:35.089408  4083 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:58:35.100430  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 82888us
I20260709 12:58:35.102846  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:35.104789  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 126466us
I20260709 12:58:35.103639  1594 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:35.017594  4077 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:35.111340  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:35.108285  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:35.109110  1600 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:35.110267  1602 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:58:35.118211  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:35.118960  1594 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:58:35.119361  1594 pending_rounds.cc:85] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
W20260709 12:58:35.119503  4080 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:58:35.120174  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:35.121224  1603 raft_consensus.cc:2368] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
W20260709 12:58:35.121486  4086 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:58:35.119613  1594 pending_rounds.cc:107] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:58:35.122200  1594 raft_consensus.cc:2889] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:35.129455  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:35.130530  3937 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:35.132148  1602 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:35.133553  4084 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:35.134197  4084 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:35.134698  4084 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:35.149192  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:35.150532  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:35.151304  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:35.151990  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:35.152141  2312 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:35.152832  2314 raft_consensus.cc:2368] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3.
I20260709 12:58:35.153016  3909 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:35.162074  4038 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:35.050599  3809 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:35.215306  4084 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:36.826874  4084 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:36.199519  1532 debug-util.cc:398] Leaking SignalData structure 0x7b080003d480 after lost signal to thread 431
W20260709 12:58:36.827849  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800064180 after lost signal to thread 434
W20260709 12:58:36.421463   436 debug-util.cc:398] Leaking SignalData structure 0x7b080033a5a0 after lost signal to thread 1641
W20260709 12:58:36.541759  1597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1007) took 1431 ms (client timeout 1733 ms). Trace:
W20260709 12:58:36.829689  1597 rpcz_store.cc:269] 0709 12:58:35.109943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.111031 (+  1088us) service_pool.cc:224] Handling call
0709 12:58:36.541661 (+1430630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.830950  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:36.565553  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 1.43592e+06us
I20260709 12:58:36.832407  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:36.600135  1601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.510s	user 0.013s	sys 0.013s
W20260709 12:58:36.834709  1601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.746s	user 0.014s	sys 0.013s
W20260709 12:58:36.605991  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.617970  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.661875  2317 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 1.510s	user 0.019s	sys 0.001s
I20260709 12:58:36.837466  2317 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:36.838258  2317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 189) took 1688 ms (client timeout 1979 ms). Trace:
W20260709 12:58:36.838645  2317 rpcz_store.cc:269] 0709 12:58:35.149825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.150138 (+   313us) service_pool.cc:224] Handling call
0709 12:58:36.838147 (+1688009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:36.674469  1596 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.634s	user 0.011s	sys 0.057s
I20260709 12:58:36.840893  1597 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:36.841120  1596 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.800s	user 0.011s	sys 0.058s
W20260709 12:58:36.690963  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.695737  4013 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.817s	user 0.024s	sys 0.009s
W20260709 12:58:36.842701  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.842499  4013 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:36.844671  4093 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.845060  4013 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:36.845304  4093 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:36.845855  4013 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:36.708142  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.712008  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.847018  1594 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:36.847754  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.848089  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.848634  1602 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.848914  1594 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.849540  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.712922  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.850399  1602 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.851027  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.851765  1599 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 12:58:36.852319  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800064160 after lost signal to thread 1535
I20260709 12:58:36.852733  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.853615  1599 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:36.854563  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.855284  1599 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:36.713687  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.855947  1603 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:36.853621  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0019276790000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 12:58:36.856993  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.858064  1603 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:36.858937  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:36.715471  1598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.665s	user 0.014s	sys 0.012s
W20260709 12:58:36.860451  1598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.810s	user 0.015s	sys 0.012s
W20260709 12:58:36.720796  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.743774  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:36.756240  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:36.748637  1745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.610s	user 0.008s	sys 0.017s
I20260709 12:58:36.785372  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.804428  1500 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:36.863706  1745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.746s	user 0.008s	sys 0.020s
W20260709 12:58:36.864077  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1009) took 1753 ms (client timeout 1959 ms). Trace:
W20260709 12:58:36.774212  1566 connection.cc:256] RPC call timeout handler was delayed by -2.4101872489999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 12:58:36.864643  1566 connection.cc:256] RPC call timeout handler was delayed by -2.3831872490000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:58:36.864903  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:36.865226  1566 connection.cc:256] RPC call timeout handler was delayed by -2.1689872489999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:58:36.865538  1566 connection.cc:256] RPC call timeout handler was delayed by -2.0771872490000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:58:36.865803  1566 connection.cc:256] RPC call timeout handler was delayed by -2.0726872490000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:58:36.864547  1500 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 2 to 4, term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to <none>, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:36.866151  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.866899  1595 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
W20260709 12:58:36.864492  1600 rpcz_store.cc:269] 0709 12:58:35.110610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.784961 (+1674351us) service_pool.cc:224] Handling call
0709 12:58:36.864017 (+ 79056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.820047  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:36.867043  1500 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:36.866084  1566 connection.cc:256] RPC call timeout handler was delayed by -1.9502872490000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 12:58:36.872426  1566 connection.cc:256] RPC call timeout handler was delayed by -1.8908872490000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 12:58:36.872794  1566 connection.cc:256] RPC call timeout handler was delayed by -1.8395872490000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:58:36.821094  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:36.871140  1500 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196), now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:36.822031  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:36.875074  2311 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 4: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:36.823568  2316 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:58:36.876212  4068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.713s	user 0.013s	sys 0.016s
W20260709 12:58:36.876847  4068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.714s	user 0.013s	sys 0.016s
I20260709 12:58:36.849802  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.880142  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:36.880455  1532 debug-util.cc:398] Leaking SignalData structure 0x7b080003d2e0 after lost signal to thread 1627
I20260709 12:58:36.880549  1594 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
W20260709 12:58:36.881032  1532 debug-util.cc:398] Leaking SignalData structure 0x7b080003d300 after lost signal to thread 1628
W20260709 12:58:36.882512  1532 debug-util.cc:398] Leaking SignalData structure 0x7b08003a89c0 after lost signal to thread 1702
I20260709 12:58:36.882010  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.863479  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.883471  1597 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.883919  4093 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:36.884491  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.884882  4093 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.868847  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:36.873102  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7144872490000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2352s for a response
W20260709 12:58:36.886070  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7135872489999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23530000000000004s for a response
W20260709 12:58:36.886504  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7090872489999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2358s for a response
I20260709 12:58:36.885721  4093 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:36.887673  1603 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.888682  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.889237  1603 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:36.857039  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:36.814304  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 163) took 3653 ms. Trace:
I20260709 12:58:36.851243  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:36.882862  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800293a80 after lost signal to thread 1703
W20260709 12:58:36.886957  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5506872490000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2534s for a response
I20260709 12:58:36.891595  1497 rpcz_store.cc:276] 0709 12:58:33.161377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.162368 (+   991us) service_pool.cc:224] Handling call
0709 12:58:36.814193 (+3651825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:36.555607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:36.556442 (+   835us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:36.556510 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:58:36.556539 (+    29us) tablet.cc:662] Decoding operations
0709 12:58:36.557650 (+  1111us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:36.557788 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:36.557845 (+    57us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:58:36.559187 (+  1342us) tablet.cc:701] Row locks acquired
0709 12:58:36.559229 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:58:36.559751 (+   522us) write_op.cc:270] Start()
0709 12:58:36.559907 (+   156us) write_op.cc:276] Timestamp: P: 1783601916559381 usec, L: 0
0709 12:58:36.559931 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:58:36.561034 (+  1103us) log.cc:844] Serialized 2869 byte log entry
0709 12:58:36.598712 (+ 37678us) op_driver.cc:464] REPLICATION: finished
0709 12:58:36.600095 (+  1383us) write_op.cc:301] APPLY: starting
0709 12:58:36.600197 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:36.600403 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:36.600542 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:36.601446 (+   904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:36.601687 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:58:36.601733 (+    46us) write_op.cc:312] APPLY: finished
0709 12:58:36.602004 (+   271us) log.cc:844] Serialized 58 byte log entry
0709 12:58:36.602180 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:36.602321 (+   141us) write_op.cc:454] Released schema lock
0709 12:58:36.602369 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:36.602779 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:36.602810 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7954,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":1111,"apply.run_cpu_time_us":2649,"apply.run_wall_time_us":2649,"num_ops":7,"prepare.queue_time_us":1129,"prepare.run_cpu_time_us":5137,"prepare.run_wall_time_us":5878,"replication_time_us":38619,"thread_start_us":2371,"threads_started":2}]]}
W20260709 12:58:36.895339  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5506872490000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2534s for a response
W20260709 12:58:36.895982  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3598872489999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2746s for a response
W20260709 12:58:36.896309  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2617872490000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28550000000000003s for a response
W20260709 12:58:36.896543  1532 debug-util.cc:398] Leaking SignalData structure 0x7b08003688a0 after lost signal to thread 1776
I20260709 12:58:36.886806  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:36.896943  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800340840 after lost signal to thread 1777
I20260709 12:58:36.897949  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:36.898283  1532 debug-util.cc:398] Leaking SignalData structure 0x7b08003a03e0 after lost signal to thread 2341
W20260709 12:58:36.898662  1532 debug-util.cc:398] Leaking SignalData structure 0x7b08001b31a0 after lost signal to thread 2342
I20260709 12:58:36.899879  3843 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:36.883495  1594 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 4: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.902134  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.902714  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.903343  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.907573  1594 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:36.929688  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.905575  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.880971  1595 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:36.930864  1597 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:36.931773  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.904146  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.932917  1595 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.933509  1602 raft_consensus.cc:2368] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:36.933878  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.934721  1595 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.808121  4104 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.899024  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:36.935428  1602 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:36.935953  4104 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:36.936831  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:36.937758  3751 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:36.937912  1602 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:36.938532  4104 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:36.899295  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.938634  3751 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:36.931963  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:36.939652  3751 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:36.940253  1600 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:36.940964  4053 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:36.904407  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:36.942343  1597 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:36.942603  1599 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:36.944118  1599 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:58:36.940899  3751 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:36.952621  1594 raft_consensus.cc:2368] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:36.889448  4093 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:36.958353  4093 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:36.959084  4093 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:36.961150  1599 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:58:36.965329  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 131452us
I20260709 12:58:36.965844  4113 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:36.966627  4113 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:36.966814  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:36.998888  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.043745  1747 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:36.972786  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 987) took 2093 ms. Trace:
I20260709 12:58:37.045035  1596 rpcz_store.cc:276] 0709 12:58:34.888804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.903216 (+ 14412us) service_pool.cc:224] Handling call
0709 12:58:34.915236 (+ 12020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.924050 (+  8814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.924106 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.936404 (+ 12298us) log.cc:844] Serialized 26 byte log entry
0709 12:58:35.019580 (+ 83176us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:36.841666 (+1822086us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.972228 (+130562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.972372 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:36.972443 (+    71us) raft_consensus.cc:1685] finished
0709 12:58:36.972468 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.972669 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69802,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":3247,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":5970,"spinlock_wait_cycles":61952,"thread_start_us":1983883,"threads_started":3,"wal-append.queue_time_us":285017,"wal-append.run_cpu_time_us":1875,"wal-append.run_wall_time_us":1001865}
I20260709 12:58:36.982712  1595 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:37.025388  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.048858  1595 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:37.050066  1595 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.026782  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:37.012696  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 269126us
I20260709 12:58:36.999677  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 257) took 2163 ms. Trace:
W20260709 12:58:37.025386  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 58744.7us
I20260709 12:58:37.052228  1595 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.051644  1745 rpcz_store.cc:276] 0709 12:58:34.835759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.836841 (+  1082us) service_pool.cc:224] Handling call
0709 12:58:34.843176 (+  6335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.843430 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:34.997471 (+154041us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.864163 (+1866692us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.999120 (+134957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.999182 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:36.999229 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.999298 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.999499 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":102478,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":116272,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":265,"thread_start_us":1979107,"threads_started":5,"wal-append.queue_time_us":228388,"wal-append.run_cpu_time_us":1820,"wal-append.run_wall_time_us":1018157}
I20260709 12:58:37.053208  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:37.002657  1603 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:37.028055  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.054536  4013 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:37.054697  1749 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:37.055079  4013 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:37.055653  4013 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:37.017396  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 126343us
I20260709 12:58:37.029670  4093 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:37.022574  4108 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.029479  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.030156  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 998) took 2079 ms. Trace:
I20260709 12:58:37.012727  4110 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:37.059165  1746 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:37.038800  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.058888  1598 rpcz_store.cc:276] 0709 12:58:34.951167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.952065 (+   898us) service_pool.cc:224] Handling call
0709 12:58:34.952614 (+   549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.983155 (+ 30541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.983209 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:35.010309 (+ 27100us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.860906 (+1850597us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:37.011808 (+150902us) log.cc:844] Serialized 14 byte log entry
0709 12:58:37.029810 (+ 18002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:37.029897 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:37.029943 (+    46us) raft_consensus.cc:1685] finished
0709 12:58:37.029955 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:37.030092 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150497,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":9628,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":10679,"thread_start_us":1978254,"threads_started":3,"wal-append.queue_time_us":203866,"wal-append.run_cpu_time_us":2455,"wal-append.run_wall_time_us":1006170}
I20260709 12:58:37.060810  4108 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.016813  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 985) took 2138 ms. Trace:
I20260709 12:58:37.062462  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:37.063369  4116 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:37.064275  4093 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.062091  1601 rpcz_store.cc:276] 0709 12:58:34.878796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.880901 (+  2105us) service_pool.cc:224] Handling call
0709 12:58:34.881324 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.881774 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.881805 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.882340 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:58:35.020374 (+138034us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:36.835189 (+1814815us) log.cc:844] Serialized 14 byte log entry
0709 12:58:37.016337 (+181148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:37.016452 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:37.016509 (+    57us) raft_consensus.cc:1685] finished
0709 12:58:37.016521 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:37.016706 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20268,"prepare.queue_time_us":108130,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":10466,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":5974,"thread_start_us":2064244,"threads_started":3,"wal-append.queue_time_us":381863,"wal-append.run_cpu_time_us":2011,"wal-append.run_wall_time_us":1002042}
I20260709 12:58:37.066823  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.067631  1744 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:37.070889  4093 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:37.079713  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:37.080569  2279 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.228s (SENT)
I20260709 12:58:37.081771  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.082603  1744 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:37.081331  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:37.084393  4108 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:37.085229  2279 connection.cc:256] RPC call timeout handler was delayed by -1.4389181550000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 12:58:37.085870  2279 connection.cc:256] RPC call timeout handler was delayed by -1.2400181550000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:58:37.086095  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.087438  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:37.088923  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.746s (SENT) [suppressed 46 similar messages]
I20260709 12:58:37.089975  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.042510  1600 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:36.976447  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 266) took 2143 ms. Trace:
I20260709 12:58:37.095794  1670 rpcz_store.cc:276] 0709 12:58:34.832884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.833043 (+   159us) service_pool.cc:224] Handling call
0709 12:58:36.976158 (+2143115us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b5400193f54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:36.976352 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4917091584}
I20260709 12:58:36.986833  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.025641  3809 raft_consensus.cc:2764] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:58:36.939648  1602 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:37.051363  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:36.998533  4118 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:37.104393  4118 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:36.967442  4113 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:37.112918  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50543.2us
I20260709 12:58:37.116385  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 82) took 1955 ms. Trace:
W20260709 12:58:37.118275  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 65213us
I20260709 12:58:37.119920  1597 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:37.122859  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.122943  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:37.118196  1500 rpcz_store.cc:276] 0709 12:58:35.160780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.479346 (+1318566us) service_pool.cc:224] Handling call
0709 12:58:37.116230 (+636884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:36.926948 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:36.927574 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:36.927609 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:58:36.927627 (+    18us) tablet.cc:662] Decoding operations
0709 12:58:36.928252 (+   625us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:36.928315 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:36.928353 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:58:36.928841 (+   488us) tablet.cc:701] Row locks acquired
0709 12:58:36.928856 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:58:36.929017 (+   161us) write_op.cc:270] Start()
0709 12:58:36.929142 (+   125us) write_op.cc:276] Timestamp: P: 1783601916928968 usec, L: 0
0709 12:58:36.929158 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:58:36.929875 (+   717us) log.cc:844] Serialized 2028 byte log entry
0709 12:58:36.932326 (+  2451us) op_driver.cc:464] REPLICATION: finished
0709 12:58:36.932697 (+   371us) write_op.cc:301] APPLY: starting
0709 12:58:36.932781 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:36.932947 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:36.933067 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:36.933708 (+   641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:36.933895 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:58:36.933950 (+    55us) write_op.cc:312] APPLY: finished
0709 12:58:36.934188 (+   238us) log.cc:844] Serialized 40 byte log entry
0709 12:58:36.934404 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:36.934511 (+   107us) write_op.cc:454] Released schema lock
0709 12:58:36.934559 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:36.934906 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:36.934933 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":108216,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":2182,"apply.run_wall_time_us":2181,"num_ops":4,"prepare.queue_time_us":198,"prepare.run_cpu_time_us":3241,"prepare.run_wall_time_us":3241,"replication_time_us":3041}]]}
I20260709 12:58:37.116565  1595 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:58:37.126776  1750 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:37.100147  4114 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:37.130548  1595 pending_rounds.cc:85] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
I20260709 12:58:37.131588  1595 pending_rounds.cc:107] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:37.132028  1595 raft_consensus.cc:2889] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:37.132210  4121 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:37.133239  4121 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:37.136212  4093 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:37.136739  4093 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.140048  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.140772  1750 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.140543  3809 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.142684  3809 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.143046  3809 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.143992  4118 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:37.150377  4013 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.118422  4110 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:37.159672  1749 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:37.163136  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.165475  1748 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:37.165560  1746 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:37.165428  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.167917  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.168803  1747 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:37.169057  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.169589  4108 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.172854  4122 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:37.170058  4108 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:37.174196  1750 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:58:37.176404  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 63025.6us
I20260709 12:58:37.178691  4123 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:37.161624  4118 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.179873  4108 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.174041  4013 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:37.180614  4116 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:37.180157  4113 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.212095  4118 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:37.213208  4118 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.213481  4113 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:37.214425  4105 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:37.194360  4123 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.217928  4123 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.218756  1744 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:37.183853  1501 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.162371  4093 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.202085  1747 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:37.202551  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.223119  1746 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:37.203362  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.223680  1748 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.204159  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.224344  1749 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:37.224216  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:37.204394  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.204910  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.207702  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:37.225747  1745 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.226078  1743 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:37.208947  4013 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:37.230362  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61427.8us
I20260709 12:58:37.233094  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:37.233465  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.233618  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.233994  1750 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:37.234781  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.236440  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.237517  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.237207  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 5 to 7, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.241262  1501 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 6, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:37.242569  1743 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:37.235481  3843 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:37.244024  4093 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.244122  3843 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:37.244715  3843 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.239205  1746 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:37.250581  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.250959  1745 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:58:37.209062  4116 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.261210  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.237701  4084 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:37.237329  4053 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:37.266010  4113 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:37.268033  4104 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:37.280441  4104 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:37.280968  4104 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:37.258018  4114 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:58:37.283746  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.268664  4105 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:37.269345  4127 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:37.247713  4120 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:37.279563  1715 leader_election.cc:400] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:37.237243  4121 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:58:37.286576  1750 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:37.290756  1715 leader_election.cc:403] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:37.279701  4113 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:37.276228  4084 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:37.310990  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60492.1us
I20260709 12:58:37.276149  4053 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:37.314201  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.305681  4113 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.353880  1748 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:37.311688  4120 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:37.255419  4110 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.348394  4053 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.308911  4127 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:37.315361  4084 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.349108  3751 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:37.364084  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 97398.3us
I20260709 12:58:37.409252  1749 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:37.371901  4105 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:37.411631  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.410166  3751 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:37.414687  4133 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:37.424474  4105 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.428287  4093 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:37.418188  4129 raft_consensus.cc:2764] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:37.348850  4116 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.432039  3809 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.367920  3843 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.416497  4113 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:58:37.455925  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44397.8us
I20260709 12:58:37.456904  4013 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:37.457715  4120 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.530980  4123 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:37.534744  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.535816  1743 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:37.536228  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:37.535866  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.474574  4134 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:58:37.486955  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.496868  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 181) took 3111 ms. Trace:
W20260709 12:58:37.507134  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 272372us
I20260709 12:58:37.475582  3751 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.544700  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.517712  4127 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:37.518884  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 172151us
W20260709 12:58:37.484025  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 207600us
I20260709 12:58:37.566111  4139 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.566929  4139 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:37.574462  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 58501.8us
I20260709 12:58:37.575793  1670 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:37.549630  4108 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.537933  4133 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:37.540786  4013 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:37.567471  4139 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.542524  1501 rpcz_store.cc:276] 0709 12:58:34.385481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.409867 (+ 24386us) service_pool.cc:224] Handling call
0709 12:58:37.496772 (+3086905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:37.287240 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:37.340130 (+ 52890us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:37.340181 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:58:37.340203 (+    22us) tablet.cc:662] Decoding operations
0709 12:58:37.340853 (+   650us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:37.340938 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:37.340974 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:37.341350 (+   376us) tablet.cc:701] Row locks acquired
0709 12:58:37.341372 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:58:37.341566 (+   194us) write_op.cc:270] Start()
0709 12:58:37.341707 (+   141us) write_op.cc:276] Timestamp: P: 1783601917341501 usec, L: 0
0709 12:58:37.341744 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:58:37.380932 (+ 39188us) log.cc:844] Serialized 1374 byte log entry
0709 12:58:37.428933 (+ 48001us) op_driver.cc:464] REPLICATION: finished
0709 12:58:37.433088 (+  4155us) write_op.cc:301] APPLY: starting
0709 12:58:37.433183 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:37.433354 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:37.433478 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:37.433963 (+   485us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:37.434157 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:37.434214 (+    57us) write_op.cc:312] APPLY: finished
0709 12:58:37.434474 (+   260us) log.cc:844] Serialized 34 byte log entry
0709 12:58:37.434674 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:37.434783 (+   109us) write_op.cc:454] Released schema lock
0709 12:58:37.434829 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:37.435191 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:37.435222 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":3869,"apply.run_cpu_time_us":2082,"apply.run_wall_time_us":2083,"num_ops":3,"prepare.queue_time_us":189,"prepare.run_cpu_time_us":4441,"prepare.run_wall_time_us":135014,"replication_time_us":87034}]]}
I20260709 12:58:37.574178  4113 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.605674  3809 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:37.608372  3843 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:37.582823  4137 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.611049  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.621670  1715 leader_election.cc:400] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:37.622110  1715 leader_election.cc:403] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:58:37.622345  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.599610  4116 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:37.612212  4137 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:37.625528  4123 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:37.623384  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:37.633124  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:37.633605  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 88961.9us
I20260709 12:58:37.635704  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:37.636683  1678 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:37.636113  4133 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.637565  4093 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.642460  4104 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.643735  4129 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
I20260709 12:58:37.647123  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.648670  4143 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.650367  4143 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:37.650876  4143 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.652019  4144 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:37.628564  4137 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.653169  4144 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:37.653566  4144 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.654652  4144 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.656769  4136 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.668697  4141 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:37.668980  4136 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.628659  4147 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:37.670827  4140 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:37.671257  4140 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:37.672361  4140 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.669605  4136 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.680198  3843 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:37.680680  3843 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:37.681654  3843 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.626348  3809 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:37.683676  3809 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.684079  3809 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:37.656379  4143 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.686879  1678 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:37.689314  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:37.690443  1678 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:37.691744  4013 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.701000  4084 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.703609  1669 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 12:58:37.715221  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.710377  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:37.796470  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.781087  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:37.710501  1675 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:37.780915  1673 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:37.798164  1678 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:37.710899  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:37.752235  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:37.791159  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.800226  1676 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:37.782217  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:37.807907  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.809006  1674 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:37.703770  4084 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:37.820494  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.820587  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.705340  4118 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.825867  4118 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:37.766513  4104 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:37.826385  3809 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.816144  4140 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.798691  3843 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.798178  4144 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.832716  1674 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:37.799227  4105 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:37.831686  1671 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:37.845047  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.710602  4053 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.851222  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.770680  4137 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.857061  4137 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:37.821782  4123 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:37.798921  3751 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.835906  4084 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.872993  4084 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.849622  4118 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.869274  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:37.879232  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.849912  4113 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:37.881319  1669 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:37.886540  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:37.869582  4141 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:37.888656  1674 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:37.848927  4116 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:58:37.867954  4123 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:37.868170  4105 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:37.870584  4108 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:37.889400  4113 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.907673  4149 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:58:37.908270  4136 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:37.908918  4149 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:37.909328  4149 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:37.909403  4113 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.910230  4149 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.880934  4129 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:37.911388  4129 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:37.880831  4118 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.894927  4123 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:37.912031  4118 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.917477  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:37.890173  4141 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.915732  4146 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:58:37.872035  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:37.941025  4105 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:37.910723  4136 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:37.965999  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 94050.1us
W20260709 12:58:37.954938  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.960009  3809 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:37.960556  4141 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.959895  4139 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:37.959931  4084 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:37.978605  1674 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4.
I20260709 12:58:37.980087  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:37.971933  4108 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:37.982244  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:37.988024  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.982497  4149 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.995568  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.005328  1673 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:38.011759  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.986915  4108 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:38.004307  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.015810  1671 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.022241  1669 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:38.028230  4139 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:38.031533  1674 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:38.032426  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.035413  4146 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:38.042593  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.021688  4053 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:38.048107  1675 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:38.033516  4152 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:38.042544  4146 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.052789  1671 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:38.054291  1673 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:58:38.055230  1676 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:38.060264  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.061353  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.066039  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.067749  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.069108  1673 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:38.046607  3751 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:38.075955  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.077713  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.078589  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.013636  4129 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.079252  1674 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:38.055153  4152 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.084020  1677 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:38.086941  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.087990  1675 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.089363  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:38.090225  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:38.085549  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:38.091866  4146 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.095422  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.118053  4152 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.118690  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.071030  4120 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:58:38.132200  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.133041  1674 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.064363  4108 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.160907  1674 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:38.159893  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.163020  1676 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.170469  4118 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:38.174973  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 354485us
I20260709 12:58:38.100520  4123 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:38.187261  4123 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:38.178893  1743 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:38.178891  1676 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:38.188217  1748 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:38.196964  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:38.203074  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.245307  3751 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:38.188686  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.237193  1674 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:58:38.247242  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:38.311178  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.300038  4152 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:38.308272  4121 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:58:38.300643  3751 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:38.295671  4068 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:58:38.328610  3751 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:38.267416  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.329633  3751 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.296938  4155 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:58:38.331081  3751 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:38.331626  4152 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.332700  4152 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:38.305724  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58546.8us
I20260709 12:58:38.335824  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:38.340684  4139 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:38.340730  3843 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:38.307251  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.345049  1676 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:38.345355  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.206852  4118 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:38.315586  4141 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.264227  4159 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 12:58:38.348969  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.349864  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.249838  4146 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:38.347440  4159 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:38.355707  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.264103  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:38.261451  4053 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:58:38.272642  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.381356  1670 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:38.271915  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.371060  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:38.379735  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.375047  1675 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:38.384972  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.387120  1671 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.389300  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.389458  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:38.356896  4159 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.407444  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.409734  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.410030  4172 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:38.392377  4141 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:38.422253  1676 raft_consensus.cc:2410] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:58:38.422361  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 321908us
I20260709 12:58:38.427127  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:38.600389  1715 connection.cc:256] RPC call timeout handler was delayed by -3.3477122349999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:58:38.600909  1715 connection.cc:256] RPC call timeout handler was delayed by -3.223512234999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:58:38.601358  1715 connection.cc:256] RPC call timeout handler was delayed by -3.1704122349999579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 12:58:38.601679  1715 connection.cc:256] RPC call timeout handler was delayed by -3.1155122349999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:58:38.601933  1715 connection.cc:256] RPC call timeout handler was delayed by -3.1110122349999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 12:58:38.602196  1715 connection.cc:256] RPC call timeout handler was delayed by -3.1056122349999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 12:58:38.602720  1715 connection.cc:256] RPC call timeout handler was delayed by -2.8644122349999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23730000000000004s for a response
W20260709 12:58:38.602991  1715 connection.cc:256] RPC call timeout handler was delayed by -2.661012234999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2599s for a response
I20260709 12:58:38.569237  4159 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.528470  4139 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.603823  4172 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.604228  4159 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:38.604497  4139 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.604894  4172 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:38.504487  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.609194  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.432595  4053 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:38.610435  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.610667  4053 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:38.429803  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.611202  1676 raft_consensus.cc:2368] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:38.616107  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.616921  1671 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:38.622243  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 232873us
W20260709 12:58:38.611862  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.612475  1673 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.631881  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.632984  1673 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.612802  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.627429  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.615345  1670 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.644735  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.645555  1670 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:38.603233  1715 connection.cc:256] RPC call timeout handler was delayed by -2.2326122349999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30750000000000005s for a response
W20260709 12:58:38.646555  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1695348319999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:58:38.647047  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1596348319999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:58:38.647429  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1506348319999233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:58:38.647863  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9976348319999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 12:58:38.650462  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.650774  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.815663  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:38.740504  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.803510  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.726759  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.773520  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.792433  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:38.771733  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.823187  1598 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:38.823962  1596 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:38.671746  4141 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.151s
I20260709 12:58:38.824640  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.676535  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.818548  1678 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.672933  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.816308  1676 raft_consensus.cc:2376] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 4. Re-sending same reply.
I20260709 12:58:38.858264  1672 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.748162  1600 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:38.858712  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:38.648239  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9688348319999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:58:38.691859  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.827769  4147 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:38.860325  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:38.860559  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.860950  1595 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:38.861436  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.828413  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.859530  1675 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:38.862542  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.862942  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.828848  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.804097  2312 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:38.830298  4114 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:38.831385  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:38.866575  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9688348319999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:58:38.613484  4068 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:38.817162  1670 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.832038  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:38.833809  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.836176  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:38.770965  1752 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:38.837294  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:38.838449  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:38.696487  4127 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.754312  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:38.882176  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.681741  4108 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.896595  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.711998  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.819723  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.899964  1748 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:38.819024  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.786028  1501 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 3 to 5, term changed from 5 to 6, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to <none>, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:38.900722  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.901815  1676 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:38.902901  4174 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.718984  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.774044  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.903718  4174 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:38.904742  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.905035  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.905858  1600 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:38.905997  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.906652  4174 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:38.855878  4053 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.857106  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:38.859316  1603 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:38.914678  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.827980  1750 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:38.863329  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.916196  1675 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.916078  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.916841  1677 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.907333  4127 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:38.918236  1675 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:38.858798  4118 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.918474  4108 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.863571  1744 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.919790  1603 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:38.888984  4147 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:38.862022  1674 raft_consensus.cc:2368] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5.
I20260709 12:58:38.860081  1749 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:38.866987  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9517348319999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 12:58:38.921345  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9319348319999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:58:38.921808  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9184348319999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 12:58:38.919414  1675 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:38.922237  1715 connection.cc:256] RPC call timeout handler was delayed by -1.8293348319999723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:58:38.922704  1715 connection.cc:256] RPC call timeout handler was delayed by -1.8086348319999388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 12:58:38.923044  1715 connection.cc:256] RPC call timeout handler was delayed by -1.7447348319999492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:58:38.923426  1715 connection.cc:256] RPC call timeout handler was delayed by -1.5854348319999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:58:38.925700  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0355348319999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2819s for a response
I20260709 12:58:38.719296  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.873982  1595 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:38.874251  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.878098  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.929961  1747 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:38.878964  1746 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:38.879628  1598 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:38.880450  1669 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.875140  4068 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 12:58:38.881716  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.882855  1596 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:38.876027  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.817058  4129 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.902168  1501 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 3, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.844323  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.946732  1594 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.907392  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.907847  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.947034  1669 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:38.908823  1743 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:38.920759  4108 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:38.909801  4105 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.947468  1669 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:38.888952  4114 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:38.935420  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.951510  1602 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.919199  4118 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:38.936219  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.936951  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:38.937907  1674 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:58:38.955741  1672 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:38.955921  1673 raft_consensus.cc:2376] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5. Re-sending same reply.
I20260709 12:58:38.944828  1744 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:38.949087  1600 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:38.887822  4173 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.953323  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 1 to 4, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.955354  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:38.968570  1501 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 3 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:38.968891  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.979616  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:38.980288  1595 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:38.982371  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.984323  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.987463  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:38.988317  1750 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:38.988981  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:38.989295  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.990010  1750 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:38.990198  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.990820  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:38.991245  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:38.991377  1750 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:38.993461  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:38.964109  1669 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:38.995002  1669 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:38.996063  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 161232us
I20260709 12:58:38.992130  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.002529  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:39.012212  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.013603  1597 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:58:39.014787  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.016944  1748 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:39.019374  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:39.019315  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.020656  1598 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:39.030603  1750 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:39.042615  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:39.043358  1745 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:39.043416  1602 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:39.044314  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:39.044832  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.045111  1596 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:39.047186  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.048751  1595 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:39.049538  1744 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:39.050072  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.051090  1744 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:39.051260  1595 raft_consensus.cc:2410] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:39.052830  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.053669  1595 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:39.059482  1749 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:39.061347  1749 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:39.062891  1749 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:39.064234  1595 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:39.065835  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.066783  1595 raft_consensus.cc:2376] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:58:39.067930  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.068667  1595 raft_consensus.cc:2376] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:58:39.069768  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.071219  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.072525  4127 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:39.073077  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.072527  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.074414  1603 raft_consensus.cc:2368] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:39.074607  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.075212  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.076193  1595 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:39.076419  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.077253  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.042449  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:39.079432  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.080264  1600 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.078388  1595 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:39.078088  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.082676  1595 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:58:39.083992  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94199.3us
W20260709 12:58:39.086591  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.090418  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.091604  1748 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:39.092123  1603 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 3: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:39.093118  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.094635  1603 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:39.095286  1598 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:58:39.101342  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:39.102571  1600 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:39.102911  1598 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:39.086076  3843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.035s
I20260709 12:58:39.108363  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:38.954602  4129 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:39.111855  1600 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:39.121749  1603 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:39.104358  3843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.035s
I20260709 12:58:39.161114  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:38.962787  4105 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.162245  1596 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:58:39.161410  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44526.6us
I20260709 12:58:38.981360  4173 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.158921  1602 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:39.108585  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:39.113503  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:39.203029  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.214811  1602 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:39.214588  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 204249us
I20260709 12:58:39.214576  1745 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:39.219201  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.220268  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:39.223281  1670 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 3: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:39.223853  1671 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:39.168054  4141 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.093463  4068 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:39.229399  1599 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:39.230998  1602 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:39.234073  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:39.234906  1602 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:39.225008  4108 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.216711  4185 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:39.262893  4185 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:39.232687  3751 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.896s	user 0.007s	sys 0.007s
I20260709 12:58:39.233747  2312 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:39.261626  4146 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.904s	user 0.027s	sys 0.006s
I20260709 12:58:39.232158  4141 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.273228  1601 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:39.274482  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:39.280910  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.290887  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.290730  1597 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:39.275429  4068 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:39.272898  4187 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.294495  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 52790.1us
I20260709 12:58:39.291093  4183 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.301640  4189 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.304418  4114 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.273698  4108 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:39.328303  1641 connection.cc:256] RPC call timeout handler was delayed by -3.2403249730000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 12:58:39.327883  4177 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.330317  4118 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:39.379179  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:39.380235  4175 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:58:39.381326  4174 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:39.383013  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1592) took 1081 ms. Trace:
I20260709 12:58:39.398993  1670 rpcz_store.cc:276] 0709 12:58:38.301957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.875733 (+573776us) service_pool.cc:224] Handling call
0709 12:58:39.382661 (+506928us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003e62d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:39.382911 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641417088}
W20260709 12:58:39.401324  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.376902  1641 connection.cc:256] RPC call timeout handler was delayed by -3.219624973000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 12:58:39.373867  3843 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:58:39.389155  1745 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:39.336350  4181 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.394042  4176 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 12:58:39.422027  4178 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:58:39.422439  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.374547  4189 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:39.423269  4182 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:58:39.423810  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.395586  4129 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:39.425101  1746 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:58:39.426203  1594 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:39.427296  1596 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 12:58:39.427596  4189 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:39.404906  1641 connection.cc:256] RPC call timeout handler was delayed by -3.219624973000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 12:58:39.396780  4174 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:39.412973  4118 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.435302  1641 connection.cc:256] RPC call timeout handler was delayed by -3.2151249730000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 12:58:39.435945  1641 connection.cc:256] RPC call timeout handler was delayed by -3.1773249730000543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 12:58:39.435443  4118 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:39.436357  1641 connection.cc:256] RPC call timeout handler was delayed by -3.1503249730000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:58:39.436751  1641 connection.cc:256] RPC call timeout handler was delayed by -3.1503249730000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:58:39.436057  4174 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.420223  4181 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:39.440680  4181 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:39.451511  1745 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:39.320757  4187 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:39.437106  1641 connection.cc:256] RPC call timeout handler was delayed by -3.0972249730000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 12:58:39.458425  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.457864  1641 connection.cc:256] RPC call timeout handler was delayed by -3.0540249730000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:58:39.459599  1641 connection.cc:256] RPC call timeout handler was delayed by -3.043224973000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:58:39.460180  1641 connection.cc:256] RPC call timeout handler was delayed by -2.9793249730000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 12:58:39.460677  1641 connection.cc:256] RPC call timeout handler was delayed by -2.978424973000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:58:39.461102  1641 connection.cc:256] RPC call timeout handler was delayed by -2.9424249730000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 12:58:39.461599  1641 connection.cc:256] RPC call timeout handler was delayed by -2.9343249730000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 12:58:39.462095  1641 connection.cc:256] RPC call timeout handler was delayed by -2.9145249730000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 12:58:39.462622  1641 connection.cc:256] RPC call timeout handler was delayed by -2.8578249730000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 12:58:39.463630  1641 connection.cc:256] RPC call timeout handler was delayed by -2.8578249730000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 12:58:39.464146  1641 connection.cc:256] RPC call timeout handler was delayed by -2.8245249730000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:58:39.464633  1641 connection.cc:256] RPC call timeout handler was delayed by -2.811924973000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:58:39.465138  1641 connection.cc:256] RPC call timeout handler was delayed by -2.7615249730000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:58:39.466039  1641 connection.cc:256] RPC call timeout handler was delayed by -2.6499249730000543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:58:39.467442  1641 connection.cc:256] RPC call timeout handler was delayed by -2.1333249730000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2784s for a response
W20260709 12:58:39.468560  1641 connection.cc:256] RPC call timeout handler was delayed by -2.0307249730000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2898s for a response
I20260709 12:58:39.368682  4183 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.403357  4147 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.391773  4177 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:39.442541  4174 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:39.531360  1669 consensus_meta.cc:287] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.001s
I20260709 12:58:39.737767  1669 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:58:39.738248  1669 pending_rounds.cc:85] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 4
I20260709 12:58:39.738540  1669 pending_rounds.cc:107] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 3.5
W20260709 12:58:39.504160  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 227753us
I20260709 12:58:39.739002  1745 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:39.543200  4185 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:39.623117  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55479.9us
I20260709 12:58:39.738818  1669 raft_consensus.cc:2889] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:39.645363  4194 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:58:39.731828  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 285) took 1323 ms. Trace:
I20260709 12:58:39.742664  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 286) took 1134 ms. Trace:
W20260709 12:58:39.483878  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.516687  1670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
W20260709 12:58:39.706629  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.734026  4108 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:39.643157  4188 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 12:58:39.736732  1748 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:39.487362  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.516602  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 290506us
I20260709 12:58:39.743117  1669 rpcz_store.cc:276] 0709 12:58:38.608400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.932761 (+324361us) service_pool.cc:224] Handling call
0709 12:58:38.946902 (+ 14141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.742330 (+795428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.742593 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.768245  1670 raft_consensus.cc:606] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.768941  1670 raft_consensus.cc:614] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:39.776945  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:39.777941  1743 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:39.782785  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.742820  1675 rpcz_store.cc:276] 0709 12:58:38.408229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.922926 (+514697us) service_pool.cc:224] Handling call
0709 12:58:38.923244 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:39.104430 (+181186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.104469 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:39.114381 (+  9912us) log.cc:844] Serialized 52 byte log entry
0709 12:58:39.661124 (+546743us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:39.661193 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.661312 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.731486 (+ 70174us) raft_consensus.cc:1685] finished
0709 12:58:39.731509 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.731758 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15128,"raft.queue_time_us":346965,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":17544,"thread_start_us":628506,"threads_started":2,"wal-append.queue_time_us":562655}
I20260709 12:58:39.478443  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:39.544332  4141 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.477414  4173 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.797825  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:39.798718  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:39.670228  4187 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:39.799304  4195 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:58:39.819089  2311 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.001s
I20260709 12:58:39.812317  4118 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:39.814061  4180 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:39.818346  4177 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.809669  4105 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.815192  1671 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:39.809201  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.831895  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.811646  4198 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:58:39.813026  4129 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:58:39.787658  4147 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.837937  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.840555  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.845338  4127 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.829965  2311 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:39.847810  4105 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.848348  4105 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:39.848734  4105 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.811304  4183 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.851902  4198 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:39.852442  4198 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:39.853425  4198 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.854067  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:39.854205  4191 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:39.822782  4120 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:58:39.854863  4198 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.855480  4129 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:39.859982  4129 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:39.860430  4129 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:39.845324  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.856010  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.811717  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:39.791944  4185 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:58:39.867763  4187 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:58:39.879424  4191 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:39.880196  4191 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:39.856419  4199 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:39.864754  4121 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:58:39.794059  4189 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:58:39.881572  4191 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.874298  4197 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:39.883451  4191 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:39.881323  4199 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:39.865715  4147 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:39.885001  4199 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:39.886498  4199 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:39.887117  2312 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:39.873025  4183 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:39.888372  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.891695  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.895856  4197 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:39.900949  4147 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:39.901762  4183 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:39.906447  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.907827  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.909202  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:39.910116  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:39.910171  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 117146us
I20260709 12:58:39.911209  1745 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
W20260709 12:58:39.911358  1566 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.579s (SENT)
I20260709 12:58:39.910388  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:39.912447  1748 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:58:39.918833  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:39.911966  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.920675  1674 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:58:39.923840  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:39.927120  1566 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.601s (SENT)
I20260709 12:58:39.930948  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.934801  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:39.935866  4172 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.912155  4197 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.912398  4209 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.962617  4209 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.965467  4209 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:39.966580  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.936345  4127 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.971794  4179 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.946872  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:39.947172  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.972469  4179 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.973001  4179 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.920727  4147 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.973011  4155 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.976591  4155 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.976991  4155 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.979282  4210 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:39.936448  4174 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:39.938570  4108 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:39.922446  4191 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:39.961709  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.988850  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46931.2us
I20260709 12:58:39.988651  4191 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:39.990132  4191 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:39.990325  1566 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.609s (SENT)
I20260709 12:58:39.995975  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.983194  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:39.946084  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:39.958838  4105 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:39.988581  4108 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:39.961357  4129 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.004870  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:40.007941  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 61994.5us
W20260709 12:58:40.009433  1566 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.744s (SENT)
I20260709 12:58:40.010406  1715 leader_election.cc:400] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:40.003306  3751 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.005898  4210 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.011608  4209 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.003506  4108 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:40.025002  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.027442  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.028542  4209 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.035809  4181 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:40.011250  4195 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.028842  4147 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.043897  4129 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:40.044412  4105 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:40.050315  1715 leader_election.cc:400] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6.
W20260709 12:58:40.052201  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47398.3us
I20260709 12:58:40.053267  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.058039  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.062697  4179 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.073396  4179 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:40.063741  4195 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.065407  4173 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:40.070330  4197 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.075994  4187 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:40.076874  4053 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:40.078060  4053 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:40.078460  4053 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.080662  4173 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:40.081096  4173 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.081998  4173 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.053663  4209 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:58:40.083783  4173 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.092367  2313 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:40.079392  4053 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.093776  4053 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.094195  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.096040  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:40.097833  3751 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.082778  4155 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.097874  1747 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.096073  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 192) took 1087 ms. Trace:
I20260709 12:58:40.103890  4105 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:40.107354  2313 rpcz_store.cc:276] 0709 12:58:39.008437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.015804 (+  7367us) service_pool.cc:224] Handling call
0709 12:58:39.811467 (+795663us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b58001f0598. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:58:40.095794 (+284327us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b5400643cd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:40.095974 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249240192}
W20260709 12:58:40.111873  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53874.5us
I20260709 12:58:40.111946  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.120762  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.142262  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.116587  4191 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.152232  3751 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.153882  4191 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:40.143399  4209 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:40.151739  4105 raft_consensus.cc:2764] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:58:40.158208  1747 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
W20260709 12:58:40.160499  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.161420  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.164392  4179 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:40.164961  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.165271  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.165930  1678 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.165014  4179 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:40.167917  4179 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.172652  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.176990  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:40.178822  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.182621  4209 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.183032  1500 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.174708  4183 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:58:40.180635  4105 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:58:40.184172  4155 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:40.180809  4152 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.180616  3751 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.189797  1715 leader_election.cc:400] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:40.190214  1715 leader_election.cc:403] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:40.190901  4209 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:58:40.184525  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 83) took 1776 ms. Trace:
I20260709 12:58:40.192473  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.193962  4209 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.195638  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.192584  1501 rpcz_store.cc:276] 0709 12:58:38.406001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.409500 (+  3499us) service_pool.cc:224] Handling call
0709 12:58:40.182308 (+1772808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:39.389321 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:39.395895 (+  6574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:39.395937 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:58:39.395956 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:39.396721 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:39.396791 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:39.396820 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:39.397399 (+   579us) tablet.cc:701] Row locks acquired
0709 12:58:39.397420 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:58:39.397594 (+   174us) write_op.cc:270] Start()
0709 12:58:39.397734 (+   140us) write_op.cc:276] Timestamp: P: 1783601919397531 usec, L: 0
0709 12:58:39.397757 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:58:39.496443 (+ 98686us) log.cc:844] Serialized 2097 byte log entry
0709 12:58:39.951386 (+454943us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b18002dcfa0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1
0709 12:58:40.021380 (+ 69994us) op_driver.cc:464] REPLICATION: finished
0709 12:58:40.155120 (+133740us) write_op.cc:301] APPLY: starting
0709 12:58:40.155236 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:40.155399 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:40.155419 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:40.163621 (+  8202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:40.163870 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:40.163931 (+    61us) write_op.cc:312] APPLY: finished
0709 12:58:40.164191 (+   260us) log.cc:844] Serialized 46 byte log entry
0709 12:58:40.164411 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.164534 (+   123us) write_op.cc:454] Released schema lock
0709 12:58:40.164599 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:40.165292 (+   693us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.165337 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":133459,"apply.run_cpu_time_us":2709,"apply.run_wall_time_us":9871,"num_ops":5,"prepare.queue_time_us":282485,"prepare.run_cpu_time_us":30121,"prepare.run_wall_time_us":596152,"raft.queue_time_us":146104,"raft.run_cpu_time_us":13005,"raft.run_wall_time_us":120856,"replication_time_us":623466,"spinlock_wait_cycles":20205312,"thread_start_us":575482,"threads_started":4,"wal-append.queue_time_us":288450}]]}
I20260709 12:58:40.196550  4209 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.196230  4108 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.197903  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.198666  4209 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.198982  4108 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:40.182482  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:40.202203  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.201097  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.203612  4108 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.205310  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.206182  3751 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.206852  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.207607  4108 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:40.207863  4209 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:40.208542  4209 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:40.208132  4108 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.209406  4108 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.212073  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:40.212790  1747 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.210081  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.209625  4209 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.216791  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:40.218287  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.187089  1500 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:40.226608  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.228467  1678 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:58:40.230324  1747 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:58:40.225780  1500 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 7, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.239857  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:40.240513  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67953.6us
I20260709 12:58:40.224419  4173 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.242502  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.235867  4053 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:40.247295  4141 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:40.247174  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.253460  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.256595  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.259171  1674 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:40.259171  1670 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:40.261901  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:40.262825  4172 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:40.236057  3751 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:40.264863  3751 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.265868  3751 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.266775  4053 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.238504  4191 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.267736  4198 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.235956  4152 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:58:40.267928  4053 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.269419  4105 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:40.270579  4141 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.268543  4155 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:40.280712  4172 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:40.281293  4155 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:40.281574  4141 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.269917  4105 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.282356  4155 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.241102  4210 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.241549  4146 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:40.277117  1671 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:40.284703  4146 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:40.269641  4152 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:40.285104  4146 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.285424  4152 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:40.274708  1675 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:40.282954  4105 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.289975  1670 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:40.291316  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.293552  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 164) took 1472 ms. Trace:
I20260709 12:58:40.298476  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:40.307816  1566 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.847s (SENT)
I20260709 12:58:40.308388  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:40.308732  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.309260  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.310554  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.300453  1500 rpcz_store.cc:276] 0709 12:58:38.820994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.821194 (+   200us) service_pool.cc:224] Handling call
0709 12:58:38.881683 (+ 60489us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:58:40.293444 (+1411761us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:40.247932 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:40.248474 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:40.248509 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:58:40.248517 (+     8us) tablet.cc:662] Decoding operations
0709 12:58:40.249028 (+   511us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:40.249075 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:40.249093 (+    18us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:40.249383 (+   290us) tablet.cc:701] Row locks acquired
0709 12:58:40.249393 (+    10us) write_op.cc:260] PREPARE: finished
0709 12:58:40.249521 (+   128us) write_op.cc:270] Start()
0709 12:58:40.249626 (+   105us) write_op.cc:276] Timestamp: P: 1783601920249479 usec, L: 0
0709 12:58:40.249637 (+    11us) op_driver.cc:348] REPLICATION: starting
0709 12:58:40.250263 (+   626us) log.cc:844] Serialized 1311 byte log entry
0709 12:58:40.271815 (+ 21552us) op_driver.cc:464] REPLICATION: finished
0709 12:58:40.272284 (+   469us) write_op.cc:301] APPLY: starting
0709 12:58:40.272370 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:40.272513 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:40.272605 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:40.273069 (+   464us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:40.273252 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:40.273297 (+    45us) write_op.cc:312] APPLY: finished
0709 12:58:40.273527 (+   230us) log.cc:844] Serialized 34 byte log entry
0709 12:58:40.273720 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.273820 (+   100us) write_op.cc:454] Released schema lock
0709 12:58:40.273871 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:40.274223 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.274251 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"spinlock_wait_cycles":2489088,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":1888,"apply.run_wall_time_us":1887,"num_ops":3,"prepare.queue_time_us":1611,"prepare.run_cpu_time_us":2647,"prepare.run_wall_time_us":2646,"replication_time_us":22043}]]}
I20260709 12:58:40.305265  1670 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:40.320359  1745 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:58:40.321529  1743 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:40.318192  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.324656  1670 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:40.317333  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.326257  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:40.327287  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.329442  1750 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:58:40.329581  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.318488  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:40.332964  4172 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.315490  4146 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.336071  4146 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:40.344406  4181 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.345235  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.345108  4181 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.346205  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:40.349584  1641 leader_election.cc:400] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 2 election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 2. Current term is 3.
I20260709 12:58:40.350584  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.351991  2313 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:40.325999  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.352524  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.367864  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:40.368422  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 60646.8us
W20260709 12:58:40.369323  1566 leader_election.cc:336] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.942s (SENT)
I20260709 12:58:40.369748  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.317570  3843 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:58:40.329665  4210 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:58:40.373867  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.373515  4108 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.375618  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.375759  4191 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:40.376231  2309 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:40.376423  1671 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:40.376741  4118 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:40.377188  4118 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.377580  4118 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.375838  4187 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:40.379664  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:40.353561  1670 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:40.385162  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.300113  4195 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:58:40.347805  4185 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.377476  4191 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.347491  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:40.392186  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:40.393482  1566 leader_election.cc:336] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.949s (SENT)
W20260709 12:58:40.396245  1566 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.954s (SENT)
I20260709 12:58:40.396669  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.379804  4209 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.404131  4108 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:40.394032  4189 raft_consensus.cc:2764] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:58:40.411837  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.412308  2312 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:40.414752  4195 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:40.416246  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:40.309149  4152 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.392836  4174 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.420862  4181 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:40.421561  4129 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:40.422801  2315 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:58:40.439481  4129 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:40.440527  4129 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.442054  4129 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.419291  4118 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.449785  4118 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:40.451113  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54911.9us
W20260709 12:58:40.451846  1566 leader_election.cc:336] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.023s (SENT)
I20260709 12:58:40.325713  4183 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:58:40.386380  4210 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.431988  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:40.419247  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:40.438112  4152 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:40.450973  4195 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:40.458933  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 112773us
W20260709 12:58:40.468855  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.452239  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.479525  2311 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:40.508481  1596 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:40.510520  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:40.511024  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.457329  4053 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.513985  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:40.515388  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:40.515900  1750 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:40.517019  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:40.514956  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:40.516878  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:40.515020  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.519079  1603 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:40.519480  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.520151  1600 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
W20260709 12:58:40.522408  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 70593.7us
W20260709 12:58:40.523077  1566 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.090s (SENT)
I20260709 12:58:40.508299  4189 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:40.523772  1566 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.094s (SENT)
I20260709 12:58:40.525923  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.478256  2314 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:40.529022  1747 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:58:40.528795  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.529340  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.534832  1747 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:40.535480  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:40.536378  1743 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:40.536557  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:40.539851   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:40.543030  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.543974  1750 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:40.544196  1596 raft_consensus.cc:2410] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:40.545462  4141 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:40.499086  4195 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.547984   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:40.521340  4118 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.531232  4191 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:58:40.531388  4181 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:40.565446  4181 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:40.565919  4181 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:40.562837  1500 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.530604  1599 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:40.521863  3751 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.583628  1748 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:40.583770  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54503.9us
I20260709 12:58:40.584399  1743 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:40.593093  1751 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:40.604321  1745 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:40.589443  4108 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.625026  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:40.625751  4198 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:58:40.636907  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 89723.8us
W20260709 12:58:40.638235  1566 leader_election.cc:336] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.156s (SENT)
I20260709 12:58:40.642477  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.602399  4105 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:40.650193  1566 leader_election.cc:336] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.213s (SENT)
I20260709 12:58:40.652559  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.629889  4147 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:58:40.638880  4183 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:58:40.658299  1566 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.268s (SENT)
I20260709 12:58:40.659081  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:40.663440  4118 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:40.663988  4118 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:40.665094  4118 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.665771  4209 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:40.666301  4118 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.666379  4209 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:40.651427  4053 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.667963  4141 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.668558  4141 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.642302  4189 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:40.639657  4185 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:58:40.691679  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.642303  4210 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:58:40.696216  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.698341  4230 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.667483  4209 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.703572  4181 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:40.717614  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59406.6us
W20260709 12:58:40.711432  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 80013.5us
I20260709 12:58:40.695523  4053 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:40.729442  1566 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.352s (SENT)
I20260709 12:58:40.697530  4225 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.731312  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:40.686954  4183 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.736495  4241 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:58:40.739588  4234 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:40.711799  4185 consensus_queue.cc:1243] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:40.750206  4053 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.747519  4189 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.752665  4141 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:40.749131  4183 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:40.698705  4195 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 12:58:40.758517  1566 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.358s (SENT)
W20260709 12:58:40.762450  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:40.764389  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.764390  4141 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.766393  4141 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.769347  4141 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:40.770835  1600 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:40.772107  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:40.772521  1596 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:40.772956  1599 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:40.773425  1600 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:40.753860  4105 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:40.733484  4230 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:40.781011  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.781412  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:40.776775  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.778965  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.730724  4174 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:40.780161  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.785562  1597 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:40.786586  1596 raft_consensus.cc:2410] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:40.787911  1600 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:40.790649  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.783486  4241 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:58:40.797016  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.798305  1599 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:40.792456  4238 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:58:40.805276  4174 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:40.808180  4174 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:40.809847  4181 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:40.796128  4230 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:40.813242  4230 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.814806  4233 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:40.824195  4198 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:40.824651  4187 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:40.825101  4187 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:40.826263  4187 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:40.827702  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.828426  1675 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.828967  1671 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:40.831957  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:40.832815  1669 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:40.834085  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.848917  1669 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.851361  1600 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:40.832196  4187 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:40.856209  1747 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:40.853425  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.860690  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.880272  1597 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:40.868021  1603 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:40.868829  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.882174  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:40.881641  1596 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:40.885757  1751 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:40.899420  1675 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:40.824822  4198 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.904018  1669 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:40.906077  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.912108  1599 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:40.815420  4233 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:40.910109  4198 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.932520  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.933113  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:40.933837  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.924636  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:40.935179  1600 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:40.933801  1596 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:40.950538  1598 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:40.950769  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:40.956378  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:40.956825  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:40.957490  1598 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.951471  1599 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:40.945830  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:40.961840  1597 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:40.984450  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:40.985194  1599 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.994335  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:41.004652  1670 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:41.038100  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:41.041090  1597 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.937548  4243 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 12:58:41.018718  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.046504  1596 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:41.046734  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.937582  4186 consensus_queue.cc:1059] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:58:41.061117  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:41.062206  1596 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:41.062446  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.957335  4121 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:41.049712  1598 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:41.079006  1598 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:41.041143  1601 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
W20260709 12:58:41.051318  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 355105us
I20260709 12:58:41.080476  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.082171  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:41.087311  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 224915us
I20260709 12:58:41.089623  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.091295  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.089308  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:41.095608  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:41.098192  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:41.080044  4121 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:41.099766  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:41.094631  4105 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:41.096015  4230 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:41.191429  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44938.8us
I20260709 12:58:41.191177  1599 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:41.122763  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:41.125478  1749 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:41.193478  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 70826.9us
I20260709 12:58:41.192660  1671 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:41.101198  4227 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:41.194214  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:41.104396  4053 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:41.104177  4118 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:41.112516  4225 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:41.113715  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.006647  4233 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:41.192518  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.187669  4234 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:41.207477  4191 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:41.218546  4147 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:41.220186  4233 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.220693  4127 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:41.221372  4243 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:41.201927  3751 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:41.222703  4248 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260709 12:58:41.223645  4247 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:58:41.199162  4197 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:41.227864  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:41.149657  4105 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:41.244562  4197 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.245174  4197 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:41.247404  4244 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
I20260709 12:58:41.239895  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:41.252113  1751 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:41.115070  3843 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 12:58:41.273170  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 159550us
I20260709 12:58:41.274865  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.276315  4252 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:41.276429  4209 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:41.277009  4252 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:41.279027  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.280680  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:41.267208  1501 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.290498  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.290752  1501 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.292747  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:41.296015  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.292747  1501 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:41.231503  4255 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 12:58:41.302517  1501 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.231770  4234 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.211333  4227 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:41.288990  1596 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:41.232062  4191 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:41.235857  4127 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 12:58:41.350986  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 151227us
I20260709 12:58:41.232419  4118 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 12:58:41.381906  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.293294  4209 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:41.236687  3751 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:41.343835  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:41.397737  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.305513  4195 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:41.312570  4183 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:41.302055  4225 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:41.374466  4146 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.369244  3843 consensus_queue.cc:1243] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 570958eb733a4af7ae16ae020998c8b4 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:41.352124  4234 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:41.307230  4129 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:41.301020  4189 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:41.300860  4210 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:41.387096  1501 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:41.460860  1501 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:41.348129  4121 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:41.425681  4240 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:41.425531  4227 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:41.451710  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 156747us
I20260709 12:58:41.294857  4181 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 12:58:41.251839  4105 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:41.418619  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 303048us
I20260709 12:58:41.475245  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.521322  1501 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:41.528386  1674 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:41.530505  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:41.531769  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.485306  4240 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.538352  4240 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.540174  4152 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:41.540650  4152 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:41.541466  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:41.541563  4152 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:41.542284  1601 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
W20260709 12:58:41.542549  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.544344  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:41.545897  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:41.546505  1601 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.547664  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:41.374993  4252 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.451021  4155 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:58:41.551975  4191 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:41.515981  4225 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:58:41.516526  4129 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:41.554773  4129 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:41.555317  1598 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:41.555927  4129 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.556833  4118 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:41.557325  4129 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:41.557591  4118 consensus_queue.cc:1243] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:41.492813  4189 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:41.485612  4210 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:41.517241  4108 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.452425  4146 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.580276  1601 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:58:41.580835  1501 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.524194  4121 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.621657  1501 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.639420  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:41.646922  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 218617us
I20260709 12:58:41.647594  1598 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:41.640322  1745 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:41.619344  4183 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:41.580582  4225 consensus_queue.cc:1243] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:58:41.579937  4187 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.695s	user 0.015s	sys 0.000s
I20260709 12:58:41.699513  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:41.700615  1745 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:58:41.701337  1752 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:41.658108  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 312075us
I20260709 12:58:41.623265  4108 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.633275  4152 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.682339   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:41.520776  4127 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:41.715633  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.704854  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:41.731472  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.735060  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.703665  4174 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.588642  4209 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.712239  4181 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:41.765375  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 127749us
I20260709 12:58:41.777215  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:41.764885  4183 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.792060  4280 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:41.738575  4210 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:41.809561  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.707321  4230 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:41.772668  4279 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:41.830437  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.744267  4195 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:58:41.816439  4230 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:41.740875  4225 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:58:41.787009  3751 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:41.853477  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 76995.3us
I20260709 12:58:41.856848  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:41.773061  4181 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:41.866890  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.788969  4174 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:41.885108  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:41.914544  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2486740020000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 12:58:41.740545  4189 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:41.845618  4238 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 12:58:41.918951  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 141820us
I20260709 12:58:41.916911  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:41.929113  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:41.932476  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47435.3us
I20260709 12:58:41.939225  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:41.920501  4262 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:58:41.996315  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.006016  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 90646.8us
W20260709 12:58:42.007411  1566 leader_election.cc:336] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.534s (SENT)
I20260709 12:58:42.008083  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:41.916097  4273 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:58:42.012189  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.927230  3751 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.928030  4195 raft_consensus.cc:2764] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:58:42.061107  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 121964us
I20260709 12:58:42.062309  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:42.017827  4233 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.784s	user 0.014s	sys 0.000s
I20260709 12:58:41.992986  4279 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:42.010874  4273 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:41.927100  4281 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 12:58:42.052603  4272 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.943276  4230 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:42.071710  4256 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 12:58:42.062511  3843 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.071030  4287 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:42.103004  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 174130us
I20260709 12:58:42.121796  4297 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.122738  4297 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.123715  4264 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.124396  4264 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:42.125835  4297 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.089313  4233 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:42.065781  3751 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.151468  4292 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.151710  4301 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 12:58:42.152210  4292 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.153009  4146 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:42.153640  4146 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:42.154422  4146 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.154536  4304 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:42.155025  4304 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:42.156215  4267 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 12:58:42.156143  4304 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.156963  4286 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:42.157380  4304 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:42.157644  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1082) took 1217 ms. Trace:
I20260709 12:58:42.154913  4146 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.158041  1602 rpcz_store.cc:276] 0709 12:58:40.940368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.940860 (+   492us) service_pool.cc:224] Handling call
0709 12:58:40.960237 (+ 19377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.050096 (+ 89859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.050143 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.050760 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.260237 (+209477us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:41.260298 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.260417 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.157405 (+896988us) raft_consensus.cc:1685] finished
0709 12:58:42.157428 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.157578 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109242,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":18454,"thread_start_us":151863,"threads_started":1,"wal-append.queue_time_us":511602}
W20260709 12:58:42.159814  4261 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 12:58:42.161422  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1075) took 1232 ms. Trace:
I20260709 12:58:42.162065  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1131) took 1262 ms. Trace:
I20260709 12:58:42.162204  4265 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.162578  1676 rpcz_store.cc:276] 0709 12:58:40.899450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.901964 (+  2514us) service_pool.cc:224] Handling call
0709 12:58:40.902356 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:40.910263 (+  7907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.910300 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:40.910845 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.042943 (+132098us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:41.042993 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.043088 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.161818 (+1118730us) raft_consensus.cc:1685] finished
0709 12:58:42.161840 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.161997 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":10367,"thread_start_us":107496,"threads_started":1,"wal-append.queue_time_us":722594}
I20260709 12:58:42.164533  4146 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:42.166374  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52038.6us
W20260709 12:58:42.167019  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 98644us
I20260709 12:58:42.170380  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:42.117811  4179 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.136237  4230 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:42.161819  1603 rpcz_store.cc:276] 0709 12:58:40.929193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.929480 (+   287us) service_pool.cc:224] Handling call
0709 12:58:40.929936 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:40.937016 (+  7080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.937050 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:40.937664 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.088089 (+150425us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:41.088138 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.088219 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.217616 (+129397us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:58:42.161067 (+943451us) raft_consensus.cc:1685] finished
0709 12:58:42.161092 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.161341 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4827,"raft.run_cpu_time_us":3150,"raft.run_wall_time_us":267620,"spinlock_wait_cycles":16615168,"thread_start_us":104559,"threads_started":1,"wal-append.queue_time_us":743875}
I20260709 12:58:42.155256  4292 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.105047  4238 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:58:42.170809  2279 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.195s (SENT) [suppressed 22 similar messages]
W20260709 12:58:42.177590  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115369us
I20260709 12:58:42.133968  4233 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:42.128418  4302 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:42.102571  4271 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.335s
I20260709 12:58:42.212831  4271 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:42.214640  4271 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:42.215065  4271 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:42.111737  3843 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.189461  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:42.217233  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:42.217837  3843 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:42.218180  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:42.218603  4292 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.219081  4292 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.219740  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.154438  4301 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:42.220969  4301 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.221390  4301 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.180944  4179 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:42.223709  4317 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:42.201746  3751 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:42.224218  4317 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:42.162906  4265 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.224787  4317 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:42.204917  4198 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.250s	user 0.015s	sys 0.001s
I20260709 12:58:42.226140  4198 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.226496  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.226663  4295 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:42.215586  4181 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.227886  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.228412  4198 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.204406  4233 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.228807  4311 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.207870  4195 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:42.219753  4310 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:42.229700  4310 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:42.222795  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.230127  4310 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:42.229508  4311 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.229511  4195 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:42.231905  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.232928  4195 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:42.233543  4257 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 12:58:42.234328  4195 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.234864  4276 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.234957  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1081) took 1296 ms. Trace:
I20260709 12:58:42.235566  4276 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.238610  4296 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
W20260709 12:58:42.242179  4293 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:42.197381  4174 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:42.243818  4305 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:58:42.243960  1594 rpcz_store.cc:276] 0709 12:58:40.938818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.938949 (+   131us) service_pool.cc:224] Handling call
0709 12:58:40.939459 (+   510us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:40.940018 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:58:40.940059 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:40.940809 (+   750us) log.cc:844] Serialized 52 byte log entry
0709 12:58:41.206477 (+265668us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:41.206531 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.207959 (+  1428us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.234662 (+1026703us) raft_consensus.cc:1685] finished
0709 12:58:42.234694 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.234881 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":8448,"thread_start_us":179953,"threads_started":1,"wal-append.queue_time_us":815538}
I20260709 12:58:42.224089  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.225536  1678 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 12:58:42.246644  4277 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.309s	user 0.000s	sys 0.002s
I20260709 12:58:42.172133  4270 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.248210  4270 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.243191  4264 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:42.252794  4258 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.621s	user 0.005s	sys 0.000s
I20260709 12:58:42.254222  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1079) took 1320 ms. Trace:
I20260709 12:58:42.105756  4272 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.259516  1678 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:42.269335  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.270409  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.254791  1595 rpcz_store.cc:276] 0709 12:58:40.934943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.935257 (+   314us) service_pool.cc:224] Handling call
0709 12:58:40.935628 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:40.936033 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.936064 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:40.949754 (+ 13690us) log.cc:844] Serialized 52 byte log entry
0709 12:58:41.100782 (+151028us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:41.498508 (+397726us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.498931 (+   423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.499072 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.253901 (+754829us) raft_consensus.cc:1685] finished
0709 12:58:42.253935 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.254138 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":468973,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":2014,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":9995,"thread_start_us":474278,"threads_started":2,"wal-append.queue_time_us":595092}
I20260709 12:58:42.276909  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:42.270331  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75233.8us
I20260709 12:58:42.280884  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:42.179988  4281 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:42.182525  4279 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.129513  4287 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.282639  1678 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:42.404096  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 120760us
W20260709 12:58:42.404299  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 123532us
I20260709 12:58:42.215485  4271 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:42.308998  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.311235  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.273303  4108 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.288141  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.371634  4272 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.310938  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.227419  4295 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:42.353104  4121 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.002s
I20260709 12:58:42.259277  4238 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.173424  4273 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:42.423789  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.497390  1751 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:58:42.757489  1717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.009s	sys 0.016s
I20260709 12:58:42.410115  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:43.107108  1678 raft_consensus.cc:2376] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5. Re-sending same reply.
I20260709 12:58:42.348795  4300 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:42.437881  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.633989  1748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.015s	sys 0.031s
W20260709 12:58:43.120154  1748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.021s	sys 0.057s
W20260709 12:58:42.425803  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 418361us
I20260709 12:58:42.546245  1676 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
W20260709 12:58:43.105791  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.121694  1566 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.746s (SENT)
I20260709 12:58:43.122155  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:43.108305  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:43.123152  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 305) took 1437 ms. Trace:
I20260709 12:58:43.123993  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.403980  4174 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.126272  2314 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:58:43.126669  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:43.126839  4264 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.502826  1750 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:43.130497  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 174) took 1590 ms. Trace:
I20260709 12:58:43.128430  1678 raft_consensus.cc:2410] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:42.418665  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:42.535792  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.946293  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 493930us
I20260709 12:58:42.530949  4289 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:42.532688  4278 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.138880  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.492925  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.372840  4311 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:42.448177  4129 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.890s	user 0.013s	sys 0.005s
W20260709 12:58:42.652112  4152 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.939s	user 0.009s	sys 0.006s
I20260709 12:58:42.406847  4319 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:43.189510  4319 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.189947  4319 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:43.190301  4210 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:43.126067  4316 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:42.466976  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.192287  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.192718  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.123665  1748 rpcz_store.cc:276] 0709 12:58:41.686074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.686198 (+   124us) service_pool.cc:224] Handling call
0709 12:58:41.686610 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.808498 (+121888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.808554 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.832989 (+ 24435us) log.cc:844] Serialized 26 byte log entry
0709 12:58:43.120916 (+1287927us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:43.120980 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.121088 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.122788 (+  1700us) raft_consensus.cc:1685] finished
0709 12:58:43.122815 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.123080 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9776,"raft.queue_time_us":189406,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":22756,"thread_start_us":1390589,"threads_started":2,"wal-append.queue_time_us":1287282}
I20260709 12:58:43.192903  4299 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:42.866173  4310 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.012s
I20260709 12:58:43.193995  4310 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:42.372249  4270 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.180392  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.288870  4292 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.214654  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:43.215678  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:42.925544  4296 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:58:42.850222  4189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.003s	sys 0.017s
I20260709 12:58:43.130921  1600 rpcz_store.cc:276] 0709 12:58:41.539770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.541578 (+  1808us) service_pool.cc:224] Handling call
0709 12:58:41.541908 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.542350 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:41.783920 (+241570us) log.cc:844] Serialized 14 byte log entry
0709 12:58:42.002241 (+218321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.025166 (+ 22925us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.025346 (+   180us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.025631 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 12:58:42.157413 (+131782us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b1800436300. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:42.852912 (+695499us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b1800436300. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 12:58:43.130175 (+277263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.130255 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.130300 (+    45us) raft_consensus.cc:1685] finished
0709 12:58:43.130313 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.130437 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34295,"prepare.queue_time_us":115374,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":142431,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":13551,"spinlock_wait_cycles":140386432,"thread_start_us":591147,"threads_started":3,"wal-append.queue_time_us":402671}
I20260709 12:58:43.184209  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:43.128801  4252 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:43.185246  4311 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:43.126865  4174 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.188599  4315 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:43.190953  4210 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.191903  4316 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.189945  1596 raft_consensus.cc:2410] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:43.193480  4299 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:43.021194  4195 consensus_meta.cc:287] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.008s
W20260709 12:58:42.427173  4240 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.888s	user 0.015s	sys 0.000s
W20260709 12:58:42.971743  4317 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.003s
W20260709 12:58:42.531626  4266 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.935s	user 0.003s	sys 0.005s
W20260709 12:58:42.826323  4298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.017s
W20260709 12:58:43.197386  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 778712us
I20260709 12:58:43.301319  1595 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:43.301775  1678 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:43.199288  2313 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:43.302274  1598 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:58:43.106614  1717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.015s	sys 0.018s
W20260709 12:58:43.128463  4234 consensus_meta.cc:287] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.652s	user 0.018s	sys 0.000s
I20260709 12:58:43.205390  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:42.826376  4227 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.317799  1672 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:43.207841  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:43.209980  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:43.210306  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:43.213204  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:42.825650  4225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.008s	sys 0.012s
I20260709 12:58:42.617164  4286 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:42.535805  4312 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.624313  4265 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:42.826404  4118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.019s
W20260709 12:58:42.564283  4105 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.997s	user 0.012s	sys 0.003s
W20260709 12:58:42.750011  4197 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.504s	user 0.018s	sys 0.000s
W20260709 12:58:43.331861  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.972452  4287 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:42.620328  4179 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:42.567674  4313 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:43.140993  4272 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.531371  4294 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:43.248456  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:43.205633  4191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.011s	sys 0.009s
I20260709 12:58:43.205552  4280 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.205127  4152 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.118642  4302 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
W20260709 12:58:43.493104  1596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 173) took 1953 ms (client timeout 1798 ms). Trace:
I20260709 12:58:43.493414  1597 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:58:43.493898  1597 pending_rounds.cc:85] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 6
W20260709 12:58:43.247434  4189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.007s	sys 0.021s
I20260709 12:58:43.280471  2310 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:43.231037  4108 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:43.495195  4291 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.429s	user 0.002s	sys 0.010s
I20260709 12:58:43.495484  4108 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:43.495959  4108 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:43.497273  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1136) took 2513 ms. Trace:
I20260709 12:58:43.498742  4273 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:43.264353  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:43.493180  4152 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.501976  4152 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.502575  4152 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:43.230080  4129 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:43.504247  4129 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.340265  4197 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:43.493695  1596 rpcz_store.cc:269] 0709 12:58:41.539384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.543448 (+  4064us) service_pool.cc:224] Handling call
0709 12:58:43.492813 (+1949365us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003b3654. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.493011 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3781843200}
I20260709 12:58:43.503067  4152 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.181360  4300 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.508857  4276 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.509642  4276 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.509760  4300 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.507979  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:43.127468  4264 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.510681  1596 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:43.295359  1600 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:43.291937  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 170251us
W20260709 12:58:43.512032  1566 leader_election.cc:336] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.816s (SENT)
I20260709 12:58:43.512168  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:43.512847  1600 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
W20260709 12:58:43.513055  1566 leader_election.cc:336] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.888s (SENT)
W20260709 12:58:43.514271  1566 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.938s (SENT)
I20260709 12:58:43.292357  1674 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:58:43.308367  4234 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.265372  4311 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.497736  1677 rpcz_store.cc:276] 0709 12:58:40.984518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.984717 (+   199us) service_pool.cc:224] Handling call
0709 12:58:41.022993 (+ 38276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.032715 (+  9722us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:41.238102 (+205387us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18001d29c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 12:58:41.523035 (+284933us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.894150 (+371115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.906107 (+ 11957us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.906246 (+   139us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:41.906270 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.906324 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.494503 (+1588179us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:43.497018 (+  2515us) raft_consensus.cc:1685] finished
0709 12:58:43.497050 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.497205 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61756,"prepare.queue_time_us":175336,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":291528,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":45220,"spinlock_wait_cycles":16743168,"thread_start_us":547472,"threads_started":3,"wal-append.queue_time_us":363527}
I20260709 12:58:43.517006  4311 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.298380  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:43.517483  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:43.283157  4315 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.302639  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:43.310958  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.311609  1602 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:43.205924  4289 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:43.301019  4298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.012s	sys 0.021s
I20260709 12:58:43.317273  1601 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:58:43.320070  1746 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:43.323129  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1626) took 1057 ms. Trace:
I20260709 12:58:43.205924  4278 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:42.474517  4304 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.297013  4195 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.258590  4252 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.537613  1751 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:58:43.539922  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1609) took 1320 ms (client timeout 1699 ms). Trace:
W20260709 12:58:43.540454  1676 rpcz_store.cc:269] 0709 12:58:42.219206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.219390 (+   184us) service_pool.cc:224] Handling call
0709 12:58:43.539625 (+1320235us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400433854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.539753 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525065984}
I20260709 12:58:43.540943  4341 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:43.541407  4189 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:58:43.321244  4225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.009s	sys 0.019s
I20260709 12:58:43.541868  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:43.327816  4118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.009s	sys 0.023s
I20260709 12:58:43.260618  4296 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.542865  1676 raft_consensus.cc:2368] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:43.322685  4307 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:43.535534  4289 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:43.544901  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.536761  4195 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.337708  4265 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.546180  4265 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:43.546761  4321 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:58:43.539296  4315 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.337200  4336 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.539263  4252 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.342473  4299 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.548563  4265 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.548493  4336 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.549422  4174 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.340858  4210 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.297221  4240 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.550029  4174 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.548728  4195 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.484666  4233 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:43.296808  4317 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.337591  4105 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.551918  4240 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.333241  4270 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:43.552753  4270 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.553344  4317 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.421017  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1635) took 1133 ms. Trace:
I20260709 12:58:43.554059  1670 rpcz_store.cc:276] 0709 12:58:42.287402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.216857 (+929455us) service_pool.cc:224] Handling call
0709 12:58:43.420923 (+204066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.309702  4295 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.494277  1597 pending_rounds.cc:107] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 7.7
W20260709 12:58:43.536964  4332 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:58:43.510257  4276 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.510767  4342 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.518303  1594 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:43.315470  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 131350us
I20260709 12:58:43.537654  2311 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:43.518647  1677 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:43.575299  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1636) took 1287 ms. Trace:
I20260709 12:58:43.575839  1677 rpcz_store.cc:276] 0709 12:58:42.290628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.517182 (+1226554us) service_pool.cc:224] Handling call
0709 12:58:43.575221 (+ 58039us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.519200  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 216624us
I20260709 12:58:43.518931  1743 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:43.572834  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1137) took 2552 ms. Trace:
I20260709 12:58:43.525169  1672 rpcz_store.cc:276] 0709 12:58:42.273505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.129739 (+856234us) service_pool.cc:224] Handling call
0709 12:58:43.323047 (+193308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.541942  4189 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.578331  4342 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:43.531450  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.579895  4317 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:43.535374  2314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36884 (request call id 169) took 1878 ms (client timeout 1677 ms). Trace:
I20260709 12:58:43.580621  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:43.581041  2314 rpcz_store.cc:269] 0709 12:58:41.657219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.658976 (+  1757us) service_pool.cc:224] Handling call
0709 12:58:43.530422 (+1871446us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54005bf4d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.535282 (+  4860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176803712}
I20260709 12:58:43.582607  4311 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:43.535643  4278 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.535682  4304 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.530642  4209 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:43.517545  4127 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.537117  4309 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.579630  1672 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:43.541620  4341 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.544790  4296 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.521306  4280 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.437611  4147 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.547703  4335 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 12:58:43.548077  4238 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.545044  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1620) took 1281 ms. Trace:
I20260709 12:58:43.585973  1672 pending_rounds.cc:85] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 4
I20260709 12:58:43.550539  4174 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.325500  4310 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.415643  4294 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.555154  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:43.605155  1670 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:43.606139  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1638) took 1311 ms. Trace:
I20260709 12:58:43.490963  4316 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.362542  4313 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.332607  4312 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.325142  4227 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.619638  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:43.555905  1747 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:43.485863  4319 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:43.543362  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1637) took 1252 ms. Trace:
W20260709 12:58:43.361569  4191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.011s	sys 0.009s
I20260709 12:58:43.618973  4292 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:43.565752  4129 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.618786  4302 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:58:43.565786  1671 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:43.496903  4301 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.275s	user 0.014s	sys 0.000s
I20260709 12:58:43.553391  4105 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.569234  4336 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.713924  4292 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.584205  4252 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:43.718829  4252 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:43.719826  4252 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.721076  4252 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:43.722054  4108 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.577666  1675 rpcz_store.cc:276] 0709 12:58:41.020118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.027744 (+  7626us) service_pool.cc:224] Handling call
0709 12:58:41.028178 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.033191 (+  5013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.033238 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.060080 (+ 26842us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.248412 (+188332us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4800061a58. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:58:41.473638 (+225226us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:41.473765 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.473964 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.425872 (+951908us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:43.572590 (+1146718us) raft_consensus.cc:1685] finished
0709 12:58:43.572615 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.572764 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7607,"raft.queue_time_us":17082,"raft.run_cpu_time_us":1965,"raft.run_wall_time_us":192107,"spinlock_wait_cycles":50942720,"thread_start_us":365366,"threads_started":1,"wal-append.queue_time_us":390354}
I20260709 12:58:43.596899  1672 pending_rounds.cc:107] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:43.724231  1672 raft_consensus.cc:2889] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:43.596740  1674 rpcz_store.cc:276] 0709 12:58:42.263904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.268846 (+  4942us) service_pool.cc:224] Handling call
0709 12:58:43.544861 (+1276015us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002571d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.544981 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350741376}
I20260709 12:58:43.585217  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 306) took 1088 ms. Trace:
I20260709 12:58:43.549458  4152 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.601588  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:43.585107  4337 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.565997  4234 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.566475  4265 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:43.608847  1677 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:43.735844  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1629) took 1461 ms. Trace:
I20260709 12:58:43.606920  1670 rpcz_store.cc:276] 0709 12:58:42.294719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.554870 (+1260151us) service_pool.cc:224] Handling call
0709 12:58:43.605956 (+ 51086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.736380  1672 rpcz_store.cc:276] 0709 12:58:42.274472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.578782 (+1304310us) service_pool.cc:224] Handling call
0709 12:58:43.579199 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.735460 (+156261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.735769 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.575397  4195 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.580539  4189 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.614548  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:43.607967  4197 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.674422  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:43.422742  4272 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.593873  4209 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:43.656224  4299 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:43.611311  4333 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.604833  4147 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.665717  4278 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.667280  4296 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:43.703327  1752 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:43.704409  4319 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.661487  4338 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:43.672374  4238 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.672019  4118 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.599705  4309 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:58:43.677357  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:43.713549  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:43.715777  4301 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.720147  4292 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.764633  4240 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:43.779430  4209 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:43.757452  4265 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.738292  4337 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.794848  4342 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.765573  4195 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:43.826562  4327 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:58:43.796693  4296 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.821933  4270 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:43.795076  4278 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:43.837052  4304 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.856771  4313 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.857563  4312 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:43.852780  4322 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:58:43.803064  4338 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:43.851637  4318 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 12:58:43.868309  4309 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.869326  4296 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.869724  4338 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.871340  4337 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.856777  4301 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:43.873620  4341 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:43.878975  4328 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.217s	user 0.000s	sys 0.003s
I20260709 12:58:43.875947  4315 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:43.880300  4315 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:43.881814  4315 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:43.883430  4315 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:43.926818  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.928117  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.514712  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:43.933848  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.591305  1594 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:43.563441  1597 raft_consensus.cc:2889] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:43.936771  1595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.030s	sys 0.059s
W20260709 12:58:43.937465  1595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.030s	sys 0.059s
I20260709 12:58:43.938091  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:43.940165  1596 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:43.620285  1600 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:43.942759  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.025s	sys 0.067s
W20260709 12:58:43.943379  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.025s	sys 0.067s
I20260709 12:58:43.660627  1601 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:43.947911  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:43.948880  1601 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:43.950055  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:43.656844  1602 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:43.953202  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:43.954144  1602 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:43.945323  1603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.009s	sys 0.035s
I20260709 12:58:43.683889  1676 rpcz_store.cc:276] 0709 12:58:42.291101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.541565 (+1250464us) service_pool.cc:224] Handling call
0709 12:58:43.543299 (+  1734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.499291  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1634) took 1215 ms. Trace:
W20260709 12:58:43.739280  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 137824us
I20260709 12:58:43.565968  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:43.785862  1751 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:43.761569  1750 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:43.725824  1749 rpcz_store.cc:276] 0709 12:58:42.496363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.496523 (+   160us) service_pool.cc:224] Handling call
0709 12:58:43.533789 (+1037266us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:43.534084 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.555792 (+ 21708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.555826 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.555869 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:43.555904 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.584946 (+ 29042us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b540029cf54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:43.585002 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.585150 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101355520}
I20260709 12:58:44.046190  4108 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:44.021891  1743 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 4: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:43.954289  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:44.022137  1745 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:43.951428  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:44.195518  1675 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:58:43.972983  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.972726  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.095495  4294 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:44.205456  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.206136  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.209004  4313 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:44.208106  1600 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:43.985072  1674 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:44.026510  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:44.201921  1675 pending_rounds.cc:85] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 4
I20260709 12:58:43.995939  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1628) took 1721 ms. Trace:
I20260709 12:58:43.959255  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 180) took 2407 ms. Trace:
I20260709 12:58:44.023854  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1658) took 2396 ms. Trace:
I20260709 12:58:43.851356  4280 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.980266  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 326) took 1574 ms. Trace:
W20260709 12:58:43.980603  1671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1624) took 1715 ms (client timeout 1846 ms). Trace:
I20260709 12:58:44.215932  1597 rpcz_store.cc:276] 0709 12:58:41.552546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.552805 (+   259us) service_pool.cc:224] Handling call
0709 12:58:43.493025 (+1940220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.937408 (+444383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.958739 (+ 21331us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54003b3650. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.959000 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4460888320}
I20260709 12:58:44.070864  4147 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:44.220934  1603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.009s	sys 0.051s
I20260709 12:58:44.226606  4312 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:44.226766  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:44.227272  4309 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.214372  1675 pending_rounds.cc:107] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:44.218542  1672 rpcz_store.cc:276] 0709 12:58:42.405764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.737162 (+1331398us) service_pool.cc:224] Handling call
0709 12:58:43.979000 (+241838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.979646 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.979677 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.979737 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:43.979771 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.979845 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.979982 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.227849  1597 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:44.197296  4272 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:44.234263  1675 raft_consensus.cc:2889] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:44.071144  4129 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.229504  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:44.215056  1677 rpcz_store.cc:276] 0709 12:58:42.274197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.576806 (+1302609us) service_pool.cc:224] Handling call
0709 12:58:43.581928 (+  5122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.736269 (+154341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.995027 (+258758us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b54002fce54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:43.995658 (+   631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42099584}
W20260709 12:58:44.219442  1671 rpcz_store.cc:269] 0709 12:58:42.265209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.440553 (+175344us) service_pool.cc:224] Handling call
0709 12:58:43.980019 (+1539466us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400193054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.980313 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958321024}
I20260709 12:58:44.233544  1601 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:44.235677  4340 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:44.216082  1747 rpcz_store.cc:276] 0709 12:58:41.627067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.627590 (+   523us) service_pool.cc:224] Handling call
0709 12:58:41.627990 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.680933 (+2052943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.023103 (+342170us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54004218d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:44.023598 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4432851840}
I20260709 12:58:44.195101  4341 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:44.231127  4309 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.072221  2314 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:43.828483  4240 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:44.086647  4174 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:44.259317  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.266592  4278 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:44.267765  4280 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.268960  1678 rpcz_store.cc:276] 0709 12:58:42.284200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.214291 (+930091us) service_pool.cc:224] Handling call
0709 12:58:43.499097 (+284806us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b5400322dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:43.499231 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198360832}
I20260709 12:58:44.269968  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:43.803318  4238 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:44.271757  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 734310us
I20260709 12:58:44.272876  4129 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.273850  4317 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:44.281895  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:44.283792  4180 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.284396  1672 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:44.285310  4304 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:44.285948  4342 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:44.287473  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:58:44.288455  4363 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.082s	user 0.000s	sys 0.002s
I20260709 12:58:44.350006  1602 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 12:58:44.350831  4320 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:58:44.289865  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:44.298151  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1140) took 2377 ms. Trace:
I20260709 12:58:44.352632  1669 rpcz_store.cc:276] 0709 12:58:41.920541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.921242 (+   701us) service_pool.cc:224] Handling call
0709 12:58:41.921641 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.077007 (+155366us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:42.077039 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.082788 (+  5749us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.405301 (+322513us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:42.405354 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.405435 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.230029 (+1824594us) raft_consensus.cc:1685] finished
0709 12:58:44.235018 (+  4989us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.297892 (+ 62874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8206,"raft.queue_time_us":226138,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":2301,"thread_start_us":465303,"threads_started":2,"wal-append.queue_time_us":1502087}
I20260709 12:58:44.299765  4195 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:43.802958  4118 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.366885  4265 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:44.367899  4118 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:44.302934  4240 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:44.304899  4361 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:58:44.305557  4276 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:44.210264  4313 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.308426  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:44.372329  1594 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:58:44.310914  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.312578  4279 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.260949  1596 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:44.375718  4296 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.321784  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:44.376056  4279 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.376740  4296 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.378957  4279 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:44.322399  4341 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.338977  4227 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:44.341823  1597 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:44.364102  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1640) took 1936 ms. Trace:
I20260709 12:58:44.321576  4264 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:44.631414  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.828950  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.389845  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.829839  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.444768  1669 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:58:44.443900  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 156670us
W20260709 12:58:44.830602  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.828409  1672 rpcz_store.cc:276] 0709 12:58:42.419187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.282693 (+1863506us) service_pool.cc:224] Handling call
0709 12:58:44.283402 (+   709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.340963 (+ 57561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.355939 (+ 14976us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:44.830446  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.383370  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:44.660997  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:44.837191  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1465) took 1513 ms. Trace:
I20260709 12:58:44.433295  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:44.837252  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1641) took 2368 ms. Trace:
I20260709 12:58:44.841620  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1460) took 1127 ms. Trace:
I20260709 12:58:44.852223  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1465) took 1128 ms. Trace:
I20260709 12:58:44.639456  4118 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:44.850720  1669 rpcz_store.cc:276] 0709 12:58:42.469354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.355433 (+1886079us) service_pool.cc:224] Handling call
0709 12:58:44.403617 (+ 48184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.834711 (+431094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.837162 (+  2451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.854494  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1455) took 1214 ms. Trace:
I20260709 12:58:44.853191  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:44.380999  4272 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:44.856622  1752 rpcz_store.cc:276] 0709 12:58:43.714331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.382932 (+668601us) service_pool.cc:224] Handling call
0709 12:58:44.841036 (+458104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:44.464361  1566 leader_election.cc:336] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.944s (SENT)
I20260709 12:58:44.444115  4304 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:44.866860  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.463719  4238 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:44.859464  1747 rpcz_store.cc:276] 0709 12:58:43.724180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.503192 (+779012us) service_pool.cc:224] Handling call
0709 12:58:44.852105 (+348913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.845428  1595 rpcz_store.cc:276] 0709 12:58:43.316106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.316442 (+   336us) service_pool.cc:224] Handling call
0709 12:58:43.316864 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:43.938376 (+621512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.938468 (+    92us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:43.940061 (+  1593us) log.cc:844] Serialized 52 byte log entry
0709 12:58:44.202602 (+262541us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:44.627122 (+424520us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.640226 (+ 13104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.640356 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.640419 (+    63us) raft_consensus.cc:1685] finished
0709 12:58:44.640439 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.829688 (+189249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42777,"raft.queue_time_us":244992,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":12242,"thread_start_us":1247731,"threads_started":3,"wal-append.queue_time_us":265038}
I20260709 12:58:44.625787  4129 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:44.870136  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 580597us
I20260709 12:58:44.870639  1600 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:44.874163  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1480) took 1216 ms. Trace:
I20260709 12:58:44.861431  1743 rpcz_store.cc:276] 0709 12:58:43.639918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.674077 (+ 34159us) service_pool.cc:224] Handling call
0709 12:58:44.854188 (+1180111us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54002e6b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:44.854381 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585176320}
I20260709 12:58:44.871389  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:44.465050  4317 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.874730  1600 rpcz_store.cc:276] 0709 12:58:43.657640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.239361 (+581721us) service_pool.cc:224] Handling call
0709 12:58:44.831305 (+591944us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:44.848662 (+ 17357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.873814 (+ 25152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.874086 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592640}
W20260709 12:58:44.879036  1598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.038s	sys 0.102s
W20260709 12:58:44.881218  1598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.039s	sys 0.103s
I20260709 12:58:44.460938  4280 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.863449  4265 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.891403  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:44.891065  4265 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.900326  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 313) took 1286 ms. Trace:
W20260709 12:58:44.901598  4252 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.180s	user 0.015s	sys 0.006s
I20260709 12:58:44.900928  1744 rpcz_store.cc:276] 0709 12:58:43.613803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.614654 (+   851us) service_pool.cc:224] Handling call
0709 12:58:43.660465 (+ 45811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.723943 (+ 63478us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:44.020012 (+296069us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.238807 (+218795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.252083 (+ 13276us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:44.268125 (+ 16042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.899775 (+631650us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b5400283a54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:44.899838 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.900086 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85363,"prepare.queue_time_us":96575,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":46224,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":78160,"spinlock_wait_cycles":145362688,"thread_start_us":450730,"threads_started":2,"wal-append.queue_time_us":216913}
I20260709 12:58:44.904035  4265 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:44.904393  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:44.866328  4279 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:44.909415  1748 raft_consensus.cc:2410] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:44.464735  4180 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.875824  4272 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:44.914583  1744 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:44.916679  4174 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:44.904507  4341 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:44.921404  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:44.919896  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1457) took 1245 ms. Trace:
I20260709 12:58:44.917963  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1464) took 1192 ms. Trace:
I20260709 12:58:44.918803  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1466) took 1189 ms. Trace:
I20260709 12:58:44.922952  1743 rpcz_store.cc:276] 0709 12:58:43.724575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.880683 (+1156108us) service_pool.cc:224] Handling call
0709 12:58:44.914228 (+ 33545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.922600  1744 rpcz_store.cc:276] 0709 12:58:43.671308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.904034 (+1232726us) service_pool.cc:224] Handling call
0709 12:58:44.916702 (+ 12668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.922614  1748 rpcz_store.cc:276] 0709 12:58:43.723339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.852754 (+1129415us) service_pool.cc:224] Handling call
0709 12:58:44.915436 (+ 62682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.909655  4309 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:44.925685  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:44.934899  4271 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 2.450s	user 0.012s	sys 0.012s
I20260709 12:58:44.916975  4252 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:44.920320  4313 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:44.930022  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 328) took 2499 ms. Trace:
I20260709 12:58:44.941223  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1630) took 2666 ms. Trace:
I20260709 12:58:44.942926  1671 rpcz_store.cc:276] 0709 12:58:42.425657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.314160 (+1888503us) service_pool.cc:224] Handling call
0709 12:58:44.867920 (+553760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.920714 (+ 52794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.920760 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.924263 (+  3503us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:44.924311 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.924385 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.924515 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.943003  1675 rpcz_store.cc:276] 0709 12:58:42.274724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.723577 (+1448853us) service_pool.cc:224] Handling call
0709 12:58:43.723951 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.307915 (+583964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.940801 (+632886us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54001847d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:44.941087 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855245056}
I20260709 12:58:44.932756  4296 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:44.946482  1747 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:44.927299  4279 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.926892  4118 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.958259  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1458) took 1273 ms. Trace:
I20260709 12:58:44.958570  1747 rpcz_store.cc:276] 0709 12:58:43.679587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.885028 (+1205441us) service_pool.cc:224] Handling call
0709 12:58:44.952877 (+ 67849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.962016  1744 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:44.937382  4271 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.965694  1743 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:44.965379  4342 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:44.966373  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1463) took 1240 ms. Trace:
I20260709 12:58:44.968003  1744 rpcz_store.cc:276] 0709 12:58:43.723088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.932560 (+1209472us) service_pool.cc:224] Handling call
0709 12:58:44.953114 (+ 20554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.962440 (+  9326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.963037 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.968087  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1462) took 1245 ms. Trace:
I20260709 12:58:44.969059  1743 rpcz_store.cc:276] 0709 12:58:43.722827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.933363 (+1210536us) service_pool.cc:224] Handling call
0709 12:58:44.961461 (+ 28098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.966200 (+  4739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.968037 (+  1837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.957429  4252 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:44.972848  4366 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 12:58:44.959851  4276 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:58:44.975111  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 63967.8us
W20260709 12:58:44.974550  4209 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.134s	user 0.015s	sys 0.004s
I20260709 12:58:44.977869  4209 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:44.980012  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:44.992506  4309 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:44.969556  4272 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:44.996414  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1449) took 1787 ms. Trace:
W20260709 12:58:44.992364  4233 consensus_meta.cc:287] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.413s	user 0.011s	sys 0.011s
I20260709 12:58:44.986220  4276 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:45.024765  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44916.2us
I20260709 12:58:45.028482  4118 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:44.994479  4317 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:45.031857  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 240822us
I20260709 12:58:44.993929  4309 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.008441  4280 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.040123  4300 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.040953  4300 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:45.041735  2279 leader_election.cc:336] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.798s (SENT)
I20260709 12:58:44.999137  1745 rpcz_store.cc:276] 0709 12:58:43.209058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.209200 (+   142us) service_pool.cc:224] Handling call
0709 12:58:43.249733 (+ 40533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.207418 (+957685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.989745 (+782327us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540022abd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:44.996321 (+  6576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773897600}
I20260709 12:58:45.042416  4309 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:45.045439  1673 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:45.050652  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1451) took 1837 ms. Trace:
I20260709 12:58:45.051084  1751 rpcz_store.cc:276] 0709 12:58:43.209815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.209980 (+   165us) service_pool.cc:224] Handling call
0709 12:58:45.044012 (+1834032us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001c2fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:45.047423 (+  3411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503043840}
I20260709 12:58:45.051733  1671 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:45.062047  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.049913  4252 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.064903  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.056003  4271 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.069869  1671 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:45.070663  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1464) took 1767 ms. Trace:
I20260709 12:58:45.058707  4276 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.082849  1669 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:45.070813  4353 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.009s	sys 0.010s
I20260709 12:58:45.071943  1598 rpcz_store.cc:276] 0709 12:58:43.303388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.315112 (+ 11724us) service_pool.cc:224] Handling call
0709 12:58:43.315526 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:43.943065 (+627539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.943128 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:43.944185 (+  1057us) log.cc:844] Serialized 52 byte log entry
0709 12:58:44.176232 (+232047us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:44.349911 (+173679us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b18002a0e80. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:44.881700 (+531789us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.882198 (+   498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.070284 (+188086us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54003b4a54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:45.070350 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.070398 (+    48us) raft_consensus.cc:1685] finished
0709 12:58:45.070411 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.070596 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9186,"prepare.queue_time_us":732939,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":226718,"raft.run_cpu_time_us":821,"raft.run_wall_time_us":54690,"spinlock_wait_cycles":1453780480,"thread_start_us":872753,"threads_started":2,"wal-append.queue_time_us":261755}
W20260709 12:58:45.095505  4353 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.009s	sys 0.010s
I20260709 12:58:45.076874  4209 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:45.106979  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.109261  1671 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:45.116461  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1631) took 2841 ms. Trace:
W20260709 12:58:45.117311  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 652962us
I20260709 12:58:45.116918  1674 rpcz_store.cc:276] 0709 12:58:42.274985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.725248 (+1450263us) service_pool.cc:224] Handling call
0709 12:58:43.725563 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.234752 (+509189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.110699 (+875947us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003232d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:45.116374 (+  5675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595109760}
I20260709 12:58:45.124003  1669 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:45.127192  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.129601  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1474) took 1510 ms. Trace:
I20260709 12:58:45.132529  1601 rpcz_store.cc:276] 0709 12:58:43.619164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.238676 (+619512us) service_pool.cc:224] Handling call
0709 12:58:44.462202 (+223526us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:44.462598 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.463247 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:44.957969 (+494722us) log.cc:844] Serialized 14 byte log entry
0709 12:58:45.118676 (+160707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:45.118753 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:45.124659 (+  5906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.124777 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.129541 (+  4764us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":953,"prepare.queue_time_us":497279,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2675,"raft.queue_time_us":3096,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":27671,"spinlock_wait_cycles":4651264,"thread_start_us":641904,"threads_started":2}
I20260709 12:58:45.141876  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.143195  4280 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:45.143770  4280 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.144148  4280 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.128443  4271 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:58:45.151197  1674 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:45.152607  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 335) took 1175 ms. Trace:
I20260709 12:58:45.153052  1678 rpcz_store.cc:276] 0709 12:58:43.977393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.681312 (+703919us) service_pool.cc:224] Handling call
0709 12:58:44.834489 (+153177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.928745 (+ 94256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.928803 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.932412 (+  3609us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:44.932454 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.152244 (+219790us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b540006cf54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:45.152321 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.152522 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187165440}
I20260709 12:58:45.154650  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 334) took 1177 ms. Trace:
I20260709 12:58:45.154876  4300 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.155085  1676 rpcz_store.cc:276] 0709 12:58:43.977010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.377365 (+400355us) service_pool.cc:224] Handling call
0709 12:58:44.377733 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.872071 (+494338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.872114 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.872182 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:44.872215 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.154418 (+282203us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400193f54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:45.154462 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.154590 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123707776}
W20260709 12:58:45.155997  1673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1612) took 2934 ms (client timeout 2872 ms). Trace:
W20260709 12:58:45.156493  1673 rpcz_store.cc:269] 0709 12:58:42.221170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.223679 (+  2509us) service_pool.cc:224] Handling call
0709 12:58:45.155690 (+2932011us) spinlock_profiling.cc:243] Waited 2.8 s on lock 0x7b540036f1d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:45.155904 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6429385600}
I20260709 12:58:45.158298  1670 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:58:45.158721  1670 pending_rounds.cc:85] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 2
I20260709 12:58:45.158866  4180 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.160049  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 314) took 1086 ms. Trace:
I20260709 12:58:45.160465  1748 rpcz_store.cc:276] 0709 12:58:44.073431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.929582 (+856151us) service_pool.cc:224] Handling call
0709 12:58:44.937705 (+  8123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.971363 (+ 33658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.971388 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.971422 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:44.971444 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.159748 (+188304us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b540017c5d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:45.159804 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.159942 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70652288}
I20260709 12:58:45.159001  1670 pending_rounds.cc:107] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:58:45.164029  1670 raft_consensus.cc:2889] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.168264  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.169361  4342 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:45.169828  4342 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:45.170289  4342 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.172585  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.178081  4279 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.180315  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1639) took 2812 ms. Trace:
I20260709 12:58:45.180886  1670 rpcz_store.cc:276] 0709 12:58:42.368313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.736739 (+1368426us) service_pool.cc:224] Handling call
0709 12:58:45.157663 (+1420924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.164987 (+  7324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.180027 (+ 15040us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540036f1d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:45.180233 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3266398976}
I20260709 12:58:45.182808  4276 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.199883  4271 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:45.200624  4271 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:45.201694  4271 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.145783  4304 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:45.204442  1677 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:45.204823  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.206188  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 333) took 1229 ms. Trace:
I20260709 12:58:45.206794  1677 rpcz_store.cc:276] 0709 12:58:43.976628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.319724 (+343096us) service_pool.cc:224] Handling call
0709 12:58:45.205874 (+886150us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400432454. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:45.206060 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793359232}
I20260709 12:58:45.207458  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.220749  4300 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:45.220988  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:45.211364  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.221674  4300 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:45.222476  1673 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:45.222976  4300 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.226564  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.227352  1671 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.227470  1676 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:45.228662  2314 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:45.228868  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.230376  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.231853  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.232978  1673 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:45.214395  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.234499  1677 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:45.235920  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.214877  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.239143  1671 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:58:45.240160  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.215384  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.246572  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.247651  1671 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:45.271512  1677 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:45.261257  1670 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:45.194968  4280 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.274933  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.208324  4304 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:45.278061  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 161508us
W20260709 12:58:45.288693  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 156701us
I20260709 12:58:45.264945  4279 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:45.217278  4342 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:45.289311  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0029740020000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:58:45.285997  4304 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:45.319726  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 98841.1us
I20260709 12:58:45.305189  4342 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:45.305717  4375 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:58:45.306674  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.308951  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.322535  1674 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:45.304301  1566 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 3.349s (SENT)
I20260709 12:58:45.295848  4279 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:45.326323  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.321233  4304 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:45.329533  4340 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:45.330267  4340 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.327189  2314 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:45.330842  4372 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.331578  4372 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:45.333555  4340 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.334204  4313 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.334647  4372 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:45.334842  4313 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.336755  4264 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:45.337217  4313 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.325356  4279 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.346055  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:45.346980  2314 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.349870  4304 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.301709  4309 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.360739  1678 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:45.364660  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:45.365291  4280 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.365440  2310 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:45.367183  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.368664  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.369805  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:45.371201  4252 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:45.372844  4252 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:45.374110  4252 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.371660  4233 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:45.371688  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.376279  4233 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:45.376827  4233 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.371899  4342 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:45.380056  4342 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:45.381367  4342 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.382774  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.386374  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.408202  1674 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:45.411137  4304 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.421720  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.429777  2310 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:45.432844  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.433072  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 97019.5us
I20260709 12:58:45.408692  4271 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.429840  4309 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.458401  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.439942  4313 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:45.439872  4174 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:58:45.432003  4280 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:58:45.471058  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.473978  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.454099  4271 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.478256  1500 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 6 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:45.486881  2314 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:45.491966  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:45.495883  4372 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:45.492990  4233 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.502365  4372 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:45.504153  4233 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.504581  4372 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:45.508409  4233 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.509295  4233 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.510556  1601 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:45.513007  4233 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.513216  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.514034  1600 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:45.514384  1748 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:45.514484  1749 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:45.515942  1746 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:45.517839  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.517923  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.518803  1601 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:45.520642  4174 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:45.521291  4174 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:45.522413  4174 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.526046  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.527033  1674 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:45.527284  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.478700  4313 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:58:45.527984  1678 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:45.528967  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.526057  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.530517  4271 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:45.541633  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.543417  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.545913  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.546693  2314 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:45.548273  1746 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:45.550511  1677 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 3.
I20260709 12:58:45.554284  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.560731  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 182) took 5036 ms. Trace:
I20260709 12:58:45.563078  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.564139  4372 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:45.564818  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.565757  4372 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:45.569629  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.572540  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.573257  1600 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:45.574648  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.574892  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.575707  1750 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:45.575954  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.576310  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.576910  1598 raft_consensus.cc:2410] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:45.577097  1749 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:45.574714  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.578517  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.578735  4272 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.579298  2314 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:45.579746  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.559000  4279 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:45.579663  4272 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.580504  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:45.581691  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.575614  1746 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:45.582469  4272 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:45.578540  1715 connection.cc:256] RPC call timeout handler was delayed by -1.6724815409999678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 12:58:45.578557  1601 raft_consensus.cc:2410] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:45.584690  4272 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:45.612599  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 127450us
I20260709 12:58:45.561309  1501 rpcz_store.cc:276] 0709 12:58:40.520627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.525124 (+  4497us) service_pool.cc:224] Handling call
0709 12:58:40.676308 (+151184us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400002490. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e3690b2 00007f94872e2a89 00007f948727ada6 00007f948724c088 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc
0709 12:58:45.557404 (+4881096us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:42.088212 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:42.116179 (+ 27967us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:42.128229 (+ 12050us) write_op.cc:435] Acquired schema lock
0709 12:58:42.135782 (+  7553us) tablet.cc:662] Decoding operations
0709 12:58:42.198786 (+ 63004us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:42.198859 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:42.198890 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:58:42.199803 (+   913us) tablet.cc:701] Row locks acquired
0709 12:58:42.199830 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:58:42.200027 (+   197us) write_op.cc:270] Start()
0709 12:58:42.200170 (+   143us) write_op.cc:276] Timestamp: P: 1783601922199970 usec, L: 0
0709 12:58:42.200196 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:58:42.200997 (+   801us) log.cc:844] Serialized 4029 byte log entry
0709 12:58:44.336628 (+2135631us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b540036d920. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f94814046b8 00007f94814042fa 00007f9481488965 00007f9481488e09 00007f9484ec3581 00007f9484ec2d58 00007f9484ec79f1 00007f9484ec79a9 00007f9484ec7939 00007f9484ec7901
0709 12:58:44.364293 (+ 27665us) op_driver.cc:464] REPLICATION: finished
0709 12:58:45.052887 (+688594us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f947e3830ac 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f9484ec3ef0
0709 12:58:45.108515 (+ 55628us) write_op.cc:301] APPLY: starting
0709 12:58:45.115307 (+  6792us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:45.124828 (+  9521us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:45.124895 (+    67us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:45.144126 (+ 19231us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148a32a 00007f948140ff14 00007f948140fec3 00007f948140fe38 00007f948140fdf3 00007f948140f0dc 00007f9481438e16 00007f9481420cbb 00007f948140b39d 00007f948140ed75
0709 12:58:45.164614 (+ 20488us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:45.165000 (+   386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:58:45.165050 (+    50us) write_op.cc:312] APPLY: finished
0709 12:58:45.165737 (+   687us) log.cc:844] Serialized 76 byte log entry
0709 12:58:45.302747 (+137010us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:45.394432 (+ 91685us) write_op.cc:454] Released schema lock
0709 12:58:45.415791 (+ 21359us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:45.416592 (+   801us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:45.416626 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116972,"reported_tablets":22,"spinlock_wait_cycles":92096768,"child_traces":[["op",{"apply.queue_time_us":739240,"apply.run_cpu_time_us":20897,"apply.run_wall_time_us":311661,"num_ops":10,"prepare.queue_time_us":291122,"prepare.run_cpu_time_us":53956,"prepare.run_wall_time_us":2249415,"raft.queue_time_us":277426,"raft.run_cpu_time_us":26541,"raft.run_wall_time_us":1284766,"replication_time_us":2155566,"spinlock_wait_cycles":1280029184,"thread_start_us":2458818,"threads_started":5,"wal-append.queue_time_us":1181537,"wal-append.run_cpu_time_us":45603,"wal-append.run_wall_time_us":1572937}]]}
I20260709 12:58:45.627332  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.587610  4279 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:45.643117  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.643194  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.675318  1746 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:45.627238  4264 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:45.684437  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.684522  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.685376  1671 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:45.688336  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.689342  1678 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:45.675731  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.692997  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:45.706521  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 120440us
I20260709 12:58:45.706525  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.678246  4264 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.707700  1749 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:45.711921  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.712903  4174 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:45.713579  4390 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.717608  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 89913.3us
I20260709 12:58:45.717845  4390 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:45.718427  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.718735  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.720489  4390 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:45.724216  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.727305  1601 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:45.731355  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.734105  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:45.735498  2279 connection.cc:256] RPC call timeout handler was delayed by -1.250084706999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
I20260709 12:58:45.735096  1598 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:58:45.727823  4264 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:45.744030  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.739725  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:45.750052  1678 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 3.
I20260709 12:58:45.753666  4392 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:45.741966  4174 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:45.767746  1601 raft_consensus.cc:2410] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:58:45.773345  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54748.1us
I20260709 12:58:45.775141  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 85) took 4637 ms. Trace:
I20260709 12:58:45.793190  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.797755  1598 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:45.797967  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.788638  4264 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:45.798883  1595 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:45.798065  4393 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:45.801741  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56360.6us
I20260709 12:58:45.804432  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:45.805591  1748 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:45.814746  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.776201  1500 rpcz_store.cc:276] 0709 12:58:41.138348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.140033 (+  1685us) service_pool.cc:224] Handling call
0709 12:58:45.775056 (+4635023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:45.722425 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:45.723228 (+   803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:45.723293 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:58:45.723312 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:45.723752 (+   440us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:45.723832 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:45.723860 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:45.724206 (+   346us) tablet.cc:701] Row locks acquired
0709 12:58:45.724250 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:58:45.724441 (+   191us) write_op.cc:270] Start()
0709 12:58:45.724624 (+   183us) write_op.cc:276] Timestamp: P: 1783601925724370 usec, L: 0
0709 12:58:45.724642 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:58:45.725368 (+   726us) log.cc:844] Serialized 598 byte log entry
0709 12:58:45.743336 (+ 17968us) op_driver.cc:464] REPLICATION: finished
0709 12:58:45.743730 (+   394us) write_op.cc:301] APPLY: starting
0709 12:58:45.743810 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:45.743948 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:45.744050 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:45.744381 (+   331us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:45.744574 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:45.744637 (+    63us) write_op.cc:312] APPLY: finished
0709 12:58:45.744827 (+   190us) log.cc:844] Serialized 22 byte log entry
0709 12:58:45.745023 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:45.745131 (+   108us) write_op.cc:454] Released schema lock
0709 12:58:45.745173 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":72343,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":1802,"apply.run_wall_time_us":1802,"num_ops":1,"prepare.queue_time_us":158453,"prepare.run_cpu_time_us":3383,"prepare.run_wall_time_us":10664,"replication_time_us":18486,"thread_start_us":64771,"threads_started":1}]]}
I20260709 12:58:45.815886  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.816579  1751 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:45.818812  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.819806  1601 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:45.820850  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.821868  1750 raft_consensus.cc:2410] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:58:45.802527  4393 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:45.824949  1752 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:45.832286  1749 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:58:45.833032  1745 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:45.832779  1749 pending_rounds.cc:85] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 2
I20260709 12:58:45.837143  1746 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:45.837417  1749 pending_rounds.cc:107] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:58:45.837769  1749 raft_consensus.cc:2889] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.830901  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.840627  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.843441  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.868237  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:45.868752  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:45.871942  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:45.872843  1596 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:45.875108  4391 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:58:45.872042  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:45.875973  1603 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.876283  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.875914  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:45.877053  1674 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:45.878377  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 74871.7us
W20260709 12:58:45.873144  4385 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:58:45.880110  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:45.885524  1602 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:45.886955  4392 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:45.887669  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:45.887771  4392 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.888940  4392 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.888484  1602 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:45.893234  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:45.893076  4209 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.865881  4174 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:45.878398  4264 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:45.900202  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.903349  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:45.904481  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 94895.2us
I20260709 12:58:45.941546  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:45.946841  1602 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:45.964295  1674 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:45.968050  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:45.968926  1600 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:45.979763  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:45.980494  1602 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.976933  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:45.992123  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 124446us
I20260709 12:58:45.975967  1745 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:45.996469  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71520.1us
I20260709 12:58:45.965970  4279 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:45.978127  4252 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.000267  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:45.997270  4174 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:58:45.997154  4304 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:58:46.007824  1566 leader_election.cc:400] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
I20260709 12:58:46.039363  1566 leader_election.cc:403] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:46.037169  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:45.933475  4393 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.016657  1602 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:46.011056  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:45.999410  1600 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:46.036880  1603 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:45.981297  4209 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.007954  4271 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:46.040606  1596 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:46.046176  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:46.041632  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:46.048154  1751 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:46.049607  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:46.049945  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.047129  1750 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:58:46.055721  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:46.054526  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:46.057708  1746 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:46.061789  2279 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.034s (SENT)
I20260709 12:58:46.062912  4399 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:46.075214  4399 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.049721  4304 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:46.075672  4399 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.075811  4304 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:46.077319  4304 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:46.079099  4304 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.079591  4396 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:46.080068  4396 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:46.049456  4209 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.040949  4279 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.059499  4372 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 3. Current term is 4.
W20260709 12:58:46.122293  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 124596us
I20260709 12:58:46.074455  4393 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.127890  1751 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:46.050644  4252 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.089298  4342 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:46.138156  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 140121us
W20260709 12:58:46.147749  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 136833us
I20260709 12:58:46.062930  4395 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 12:58:46.152819  1746 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:58:46.180154  4400 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:58:46.180397  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 118660us
W20260709 12:58:46.181138  2279 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.195s (SENT)
I20260709 12:58:46.181509  4409 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:46.182060  4409 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.182416  4409 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:46.093941  4396 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:46.194522  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.181543  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:46.209738  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:46.141021  4280 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:46.172998  4372 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.220077  4398 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.282s	user 0.004s	sys 0.001s
W20260709 12:58:46.252375  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51461.9us
W20260709 12:58:46.258359  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 131566us
I20260709 12:58:46.221356  4280 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:46.245582  4180 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:46.262832  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 84773.3us
I20260709 12:58:46.252281  4342 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:46.258318  4395 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:46.272516  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:46.320219  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 139100us
W20260709 12:58:46.329532  1601 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.005s
I20260709 12:58:46.330459  1601 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:46.322327  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.326473  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:46.264748  4372 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.274406  4395 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:46.343235  4419 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:46.344707  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83685.9us
W20260709 12:58:46.345131  4407 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:58:46.345332  4422 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:46.345947  4418 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:58:46.348680  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:46.273801  4421 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:58:46.361488  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.362272  4424 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:46.363055  4240 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:46.373965  4390 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:46.374444  4390 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:46.374858  4390 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:46.372637  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.373505  4382 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:46.376341  4382 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.376804  4382 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:46.386299  4390 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:46.388772  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.390553  4209 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.391659  4395 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.393101  4395 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:46.357527  4271 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:46.368434  4422 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.416608  4411 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:46.417405  4411 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.417927  4411 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:46.369796  4342 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:58:46.419885  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.422816  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.425099  4240 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:46.425412   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:46.426059  4240 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:46.429675  4342 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:46.397761  4252 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:46.424098  4422 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:46.436507  4392 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.000s
I20260709 12:58:46.437033  4392 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.436894  4240 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.390617  4396 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:46.444182  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 70379.9us
I20260709 12:58:46.446517  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:58:46.452618  4180 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:46.453234  4180 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:46.453559  4280 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:46.454231  4180 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:46.455032  4280 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.413057  4271 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.409334  4372 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:46.465883  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 106858us
W20260709 12:58:46.469060  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.470377  4393 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:46.471006  4393 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:46.472177  4252 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:46.472081  4393 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.477797  4279 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:46.478550  4279 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:46.456854  4392 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.481208  4390 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.408213  4409 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.465073  4271 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:46.469538  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.475200  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:46.490383  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.494943  4399 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.486752  4279 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:46.499289  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.502015  4304 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:46.502542  4304 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:46.503504  4304 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.504667  4304 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:46.506042  4417 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 12:58:46.506182  4342 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:46.506635  4342 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:46.507368  2310 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:46.507527  4342 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.508801  4408 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:46.509310  4408 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:46.509604  4342 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.509740  4408 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.516600  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.518173  4392 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:46.518759  4392 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.519209  4392 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:46.513720  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 245836us
I20260709 12:58:46.498039  4409 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:46.526737  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.515496  4390 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:46.531941  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60120.6us
W20260709 12:58:46.535606  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.540010  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:46.534456  4390 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.553064  4390 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.559710  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:46.561024  4372 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:46.561605  4372 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.561988  4372 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:46.562129  4420 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:46.564702  4420 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:46.566919  4426 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:46.589442  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.597165  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:46.618553  1674 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:46.622069  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:46.634048  4422 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.635500  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:46.637166  4372 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.642203  4411 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.643666  4431 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:46.644174  4431 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.644582  4431 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.644747  4411 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.645304  4422 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.647594  1677 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:46.648017  1677 pending_rounds.cc:85] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 3
I20260709 12:58:46.648316  1677 pending_rounds.cc:107] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:58:46.648584  1677 raft_consensus.cc:2889] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:46.649895  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.652055  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:46.652410  1671 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:46.652845  1674 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:46.624395  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.654336  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:46.589931  4426 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:58:46.662614  4279 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:46.663172  4279 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.663568  4279 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:46.612433  4420 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:58:46.639487  4372 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:46.673674  1674 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:46.585045  4252 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:58:46.595112  4399 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.686115  4430 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:46.686643  4430 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:46.688201  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66163.4us
W20260709 12:58:46.671885  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47562.4us
I20260709 12:58:46.676800  1669 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:46.678725  4408 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.678814  4372 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:46.681115  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.681730  4382 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:46.711086  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.727s (SENT)
I20260709 12:58:46.713362  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:46.715131  1674 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:46.715346  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.715793  4180 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:46.707347  1500 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.730355  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.732823  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:46.733953  1672 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:58:46.734287  4432 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:58:46.738356  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.687721  4430 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.740554  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:46.730612  1500 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.728710  4252 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:46.729048  4240 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.745023  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:46.757325  4428 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:58:46.767974  4430 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:46.770957  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.732208  4422 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:46.740412  4409 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:46.771780  1500 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 7, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:46.778136  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48720.4us
I20260709 12:58:46.778436  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:46.729334  4431 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.787302  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.787774  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:46.789268  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.841686  4431 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:46.745407  4395 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:46.731995  4396 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:58:46.756405  4420 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.844101  4372 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:46.844178  4382 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:46.842329  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 54638.3us
W20260709 12:58:46.845534  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67168us
I20260709 12:58:46.846238  4420 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.846537  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:46.848539  4420 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:46.849042  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:46.849968  4372 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:46.794037  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 76967.8us
I20260709 12:58:46.825138  4271 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.763993  4392 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:46.829715  4264 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:58:46.799507  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.781786  4342 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:46.821530  4408 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.806023  4411 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:46.806600  4409 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:46.779969  4252 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.813194  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.793365  4240 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.864738  4409 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.877949  4271 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:46.856666  4431 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:58:46.864926  4252 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.881870  4411 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:46.882984  4411 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:46.883716  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:46.865264  1674 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:46.886494  4444 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:58:46.837934  1672 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:46.837781  4279 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:46.824189  1500 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.842144  1678 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:46.845383  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:46.821426  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.865495  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:46.890988  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 45700.4us
I20260709 12:58:46.876044  1751 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:46.889747  1500 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.896190  1500 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:46.898833  1669 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:46.873013  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.900326  1675 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:46.872318  4264 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:58:46.913753  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48329.9us
I20260709 12:58:46.869279  4240 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:46.912400  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:46.895593  4395 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:46.904026  1500 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.917294  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:46.922266  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.923890  1500 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 1 to 3, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.920337  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.926642  1672 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.874183  4420 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:58:46.926585  1674 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:46.928514  1500 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.899689  4426 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:46.913158  4264 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:46.933758  1500 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 3 to 4, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.863965  4440 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:58:46.939679  2313 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:46.940409  2314 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:46.945552  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:46.921550  4342 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:46.949069  1678 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:46.948352  1500 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:47.100175  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.101167  1601 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:47.100435  1500 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:47.102952  1500 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.013124  4279 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:46.965399  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 63514.9us
I20260709 12:58:47.012204  4264 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.013072  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:47.106457  1677 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.105641  1500 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:58:47.015640  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.975327  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.026335  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.920852  4390 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.119782  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:47.120525  1751 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:46.929222  4442 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:47.006987  4426 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:47.057822  4429 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.098070  1675 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:46.953361  1672 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:58:47.036099  1669 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:47.114262  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.158568  1601 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:47.070959  4252 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:47.143049  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 244898us
I20260709 12:58:47.147924  1678 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:47.099155  4342 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.148329  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:47.155261  1751 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:47.159514  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:47.161114  1748 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:47.172646  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:47.173092  1752 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:47.173563  1752 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:47.156040  4240 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:58:47.174137  4252 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:47.174639  1752 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.172650  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:47.175920  1676 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:47.177114  1752 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:47.175367  4441 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:47.182475  1601 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:47.116503  4392 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:47.187194  1603 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:47.167817  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:47.184587  4180 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:58:47.178122  4441 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:47.210146  1752 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:58:47.210906  1752 pending_rounds.cc:85] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 5
I20260709 12:58:47.211939  1752 pending_rounds.cc:107] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:58:47.191814  4408 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.114854  4395 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:58:47.193938  4424 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.194582  4393 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:47.125133  4409 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.198982  1599 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.191524  1744 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:47.213598  1601 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:47.193135  1600 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:47.214789  1752 raft_consensus.cc:2889] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.216765  4441 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.218511  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.197883  4264 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.180351  4342 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:47.220786  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.224716  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:47.248070  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:47.253123  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.201619  4442 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:47.298158  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:47.247581  1671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.019s
I20260709 12:58:47.301103  1677 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:58:47.301611  1671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.019s
I20260709 12:58:47.304842  1596 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:47.228073  4393 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.311589  1602 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:47.317476  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.318277  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.310889  1594 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:47.322119  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:47.323908  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.326833  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:47.328228  1747 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:47.326750  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:47.331136  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:47.333732  1752 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:47.321496  1641 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:35919 timed out after 2.002s (SENT) [suppressed 14 similar messages]
I20260709 12:58:47.178853  4429 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.232702  4426 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
W20260709 12:58:47.343039  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.315377  4393 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.237008  4448 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 12:58:47.405443  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 227020us
I20260709 12:58:47.359009  4419 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:47.410121  1603 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:47.389256  1602 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:47.410826  1603 pending_rounds.cc:85] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 4
I20260709 12:58:47.428387  1603 pending_rounds.cc:107] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:47.428798  1603 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.440223  1594 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:58:47.440979  1594 pending_rounds.cc:85] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 3
I20260709 12:58:47.441252  1594 pending_rounds.cc:107] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:47.441591  1594 raft_consensus.cc:2889] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.406303  4448 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:47.452870  1752 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:58:47.499441  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.499962  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.501246  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.502132  1603 raft_consensus.cc:2376] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:58:47.481958  4448 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:47.493379  4429 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:47.521601  1594 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:47.429356  4419 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.514164  4390 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:47.538769  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.552325  1594 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:47.533443  4408 consensus_queue.cc:1243] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:58:47.571110  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 312800us
I20260709 12:58:47.448915  4442 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.583685  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.559477  4372 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:47.598417  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 276914us
I20260709 12:58:47.600613  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:47.600692  2279 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.765s (SENT)
W20260709 12:58:47.600117  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 173292us
I20260709 12:58:47.601953  1671 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:47.603109  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:47.607823  4469 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.608459  4469 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.610543  4395 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.611241  4395 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.556116  4448 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.619782  4458 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:47.621148  4458 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:47.610970  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.621572  4458 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:47.622560  4458 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.615306  4448 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.599604  4372 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.589664  4278 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:58:47.659871  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:47.659770  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.674877  1599 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:58:47.669152  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.680371  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 77336us
W20260709 12:58:47.683643  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 85331.4us
I20260709 12:58:47.664400  4461 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:47.688097  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:47.690358  4468 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:58:47.691798  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:47.692678  4473 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:47.693254  4473 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:47.694602  4462 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:47.694214  4473 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.695209  4462 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:47.698149  4462 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:47.706112  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.683995  4458 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.699836  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:47.715824  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.717964  1677 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:47.721412  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.728405  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:47.688305  4395 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:47.731931  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.732421  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:47.721032  4470 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:47.732829  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.734467  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:47.740322  1603 raft_consensus.cc:2410] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:47.704402  4372 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:47.744429  1671 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:58:47.712186  4452 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.699332  4479 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:47.758698  1672 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:47.728747  4471 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.755416  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:47.766433  1670 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:47.738004  4252 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.724231  4419 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:47.754994  4470 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:47.771706  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 86386.3us
I20260709 12:58:47.770925  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:47.800774  4470 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:47.771777  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.772377  4471 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.816377  1603 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:47.819336  4471 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:47.820089  4472 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:47.826337  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:58:47.830557  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.837298  1671 raft_consensus.cc:1217] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Deduplicated request from leader. Original: 6.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 12:58:47.837993  1671 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:47.795311  4479 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:47.805652  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:47.854957  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:47.733866  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:47.865365  1669 raft_consensus.cc:606] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:47.866235  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.857831  4424 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:58:47.870561  4393 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:47.875293  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.875628  4411 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:47.876401  4411 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.877003  4411 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.881325  1751 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:47.854651  4442 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:47.897765  1603 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:47.900971  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:47.896557  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48324.9us
W20260709 12:58:47.892304  4264 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.006s
I20260709 12:58:47.761430  4452 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:47.805423  4252 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:47.881747  2310 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:47.921759  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 118372us
I20260709 12:58:47.926946  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.930948  1603 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:47.933162  4342 consensus_meta.cc:287] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.004s
I20260709 12:58:47.906632  4459 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:47.944080  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.950136  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:47.950675  1603 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:47.907225  4396 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 12:58:47.956847  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.961472  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.962186  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.964301  1601 raft_consensus.cc:2368] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8.
W20260709 12:58:47.965284  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.958949  2314 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:47.971343  2313 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:47.984054  1675 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.994799  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.995337  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:47.961558  4252 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:47.952229  4342 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.022568  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:48.141340  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.200922  1599 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:48.118606  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.203025  1596 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.009019  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.144263  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:48.084479  1675 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:58:48.008562  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:48.190006  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 239973us
I20260709 12:58:47.996168  1594 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:48.206511  1678 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:48.203292  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:48.123076  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.206835  1602 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:48.020015  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.211258  1746 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
W20260709 12:58:48.212157  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.214043  4409 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:48.215627  4496 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.216382  4448 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.002s
I20260709 12:58:48.216241  4496 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.218643  4496 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:48.218910  2310 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:48.164111  4475 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.436s	user 0.004s	sys 0.000s
W20260709 12:58:48.045004  4468 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:58:48.227406  1600 raft_consensus.cc:2410] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:58:48.228675  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.208719  1672 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:58:48.231482  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.146831  4393 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:48.210225  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:48.237605  1746 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:58:48.148171  4487 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:58:48.152064  4478 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:58:48.240255  1603 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:48.128463  4452 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:48.231959  1599 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:58:48.276598  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.160818  4240 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:48.219825  4252 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.281606  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:48.282588  1672 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:48.219671  4382 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:58:48.258301  4392 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:48.260720  4496 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:48.236711  4409 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:58:48.266041  4396 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.299692  4458 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.007s
I20260709 12:58:48.205796  4499 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 12:58:48.315328  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 105230us
I20260709 12:58:48.339498  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1511) took 1025 ms. Trace:
I20260709 12:58:48.340533  4504 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:48.320614  1596 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:48.343600  4504 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:48.342341  4409 consensus_queue.cc:1243] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:48.340586  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.281291  4240 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:48.341332  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:48.309424  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.345781  1599 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:48.324704  1602 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:48.340343  4396 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.343086  1744 rpcz_store.cc:276] 0709 12:58:47.315841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.332094 (+ 16253us) service_pool.cc:224] Handling call
0709 12:58:47.342472 (+ 10378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.534809 (+192337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.534881 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.548197 (+ 13316us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.683329 (+135132us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:47.683372 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.683445 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.163121 (+479676us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:48.330097 (+166976us) raft_consensus.cc:1685] finished
0709 12:58:48.330121 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.339416 (+  9295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40011,"raft.queue_time_us":248439,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5164,"spinlock_wait_cycles":11502336,"thread_start_us":264424,"threads_started":2,"wal-append.queue_time_us":170758}
I20260709 12:58:48.345985  4240 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.347869  1672 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:48.348045  4240 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:48.347208  4504 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:48.354983  2279 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.763s (SENT)
I20260709 12:58:48.303767  4392 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:48.362339  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.365888  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1512) took 1029 ms. Trace:
I20260709 12:58:48.366382  1747 rpcz_store.cc:276] 0709 12:58:47.336294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.336495 (+   201us) service_pool.cc:224] Handling call
0709 12:58:47.336890 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.668541 (+331651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.668575 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.705952 (+ 37377us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.811063 (+105111us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:47.811901 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.812004 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.133265 (+321261us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:58:48.365548 (+232283us) raft_consensus.cc:1685] finished
0709 12:58:48.365572 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.365820 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14200,"raft.queue_time_us":247810,"raft.run_cpu_time_us":4581,"raft.run_wall_time_us":541666,"spinlock_wait_cycles":10325376,"thread_start_us":348556,"threads_started":2,"wal-append.queue_time_us":184926}
I20260709 12:58:48.368594  4342 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:48.369692  4395 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:48.370345  4395 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:48.363121  4424 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:58:48.021982  4479 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.373255  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1519) took 1277 ms. Trace:
I20260709 12:58:48.374028  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.373747  1602 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:48.294559  4252 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.377614  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:48.391259  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.385891  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1503) took 1088 ms. Trace:
I20260709 12:58:48.394014  1751 rpcz_store.cc:276] 0709 12:58:47.297283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.297753 (+   470us) service_pool.cc:224] Handling call
0709 12:58:48.385622 (+1087869us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400283f54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:48.385811 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335320832}
I20260709 12:58:48.394064  1599 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:48.381032  1595 rpcz_store.cc:276] 0709 12:58:47.095610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.095808 (+   198us) service_pool.cc:224] Handling call
0709 12:58:47.104978 (+  9170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.115048 (+ 10070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.115078 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.156708 (+ 41630us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.721330 (+564622us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:47.721373 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.721446 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.373001 (+651555us) raft_consensus.cc:1685] finished
0709 12:58:48.373025 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.373183 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39314,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":426449,"threads_started":1,"wal-append.queue_time_us":692402}
I20260709 12:58:48.396384  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:48.400465  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 204) took 1242 ms. Trace:
I20260709 12:58:48.401073  2313 rpcz_store.cc:276] 0709 12:58:47.151622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.162480 (+ 10858us) service_pool.cc:224] Handling call
0709 12:58:48.393726 (+1231246us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54004a1fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:48.393844 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720117632}
I20260709 12:58:48.403226  1672 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:48.408977  1743 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:48.413033  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 72564us
I20260709 12:58:48.414369  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.416987  1675 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:48.409444  1743 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:48.427963  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.431674  1599 raft_consensus.cc:2410] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:58:48.438730  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.452224  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.420253  4393 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:48.390756  4409 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:58:48.424901  4411 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.005s
I20260709 12:58:48.371384  4395 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:48.437392  1743 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.500267  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:48.502265  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 90346.7us
I20260709 12:58:48.502723  1596 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:48.505646  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.502310  1743 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:48.509332  1600 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:48.510468  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.511323  1603 raft_consensus.cc:2410] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:48.512331  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.513000  4484 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 12:58:48.516462  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.518766  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.488098  4392 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.546510  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:48.545435  1599 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:48.545243  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.545655  1594 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:48.518893  4497 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:48.490711  4448 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.550204  1595 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:48.551651  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:48.556506  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 142264us
I20260709 12:58:48.557845  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:48.560388  4476 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.142s	user 0.001s	sys 0.003s
I20260709 12:58:48.561043  4396 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:48.561638  4392 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:48.496374  4411 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.563920  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1504) took 1266 ms. Trace:
I20260709 12:58:48.565207  4411 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:48.564358  1748 rpcz_store.cc:276] 0709 12:58:47.297620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.299344 (+  1724us) service_pool.cc:224] Handling call
0709 12:58:47.299752 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.553223 (+253471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.553274 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.553938 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.764254 (+210316us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:47.764308 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.764842 (+   534us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.563672 (+798830us) raft_consensus.cc:1685] finished
0709 12:58:48.563700 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.563851 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18564,"raft.queue_time_us":241681,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":24399,"thread_start_us":394171,"threads_started":2,"wal-append.queue_time_us":736734}
I20260709 12:58:48.552384  4393 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:48.568385  1597 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:48.569469  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.570128  1601 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:48.571630  1598 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:48.571879  4342 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:48.575443  4469 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:48.582288  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.584335  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.585879  1743 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:48.589542  1603 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:48.590190  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1501) took 1428 ms. Trace:
I20260709 12:58:48.590631  1743 rpcz_store.cc:276] 0709 12:58:47.161697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.161825 (+   128us) service_pool.cc:224] Handling call
0709 12:58:47.185181 (+ 23356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.408861 (+1223680us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000878a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481404dc0 00007f948148f1c0 00007f9481490231 00007f948148cd8f 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c
0709 12:58:48.589743 (+180882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.590119 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863276928}
I20260709 12:58:48.586967  1596 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:48.591965  1601 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:48.593163  4507 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:48.593562  4497 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:48.589326  4452 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:58:48.594889  4252 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:48.594627  4497 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:48.601083  4500 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.493s	user 0.000s	sys 0.002s
I20260709 12:58:48.600718  4393 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:48.602406  4422 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:58:48.585870  4506 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:48.573004  4448 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.611094  4448 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:48.614292  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.615604  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.617167  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.620112  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.621194  1603 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:58:48.622437  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.622195  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:48.618046  1597 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:48.615707  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.629995  1596 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:58:48.632004  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.641692  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.643314  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.648049  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.650363  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.651151  1602 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:48.655534  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.657521  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.598961  4504 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:48.629269  4442 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:48.672704  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.675616  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:48.677608  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.660765  4452 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:48.651412  4507 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:48.650347  4448 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.659219  4252 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:48.679718  1595 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:48.679854  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.665320  4506 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:48.664975  4499 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:48.686869  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.693080  1602 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:58:48.704039  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.689145  1669 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:48.671967  4508 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:48.753700  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.681387  4501 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:48.716593  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.751693  1596 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:48.684180  4507 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:48.687783  4503 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:48.693341  4252 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:48.692142  4506 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:48.772735  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.753623  4442 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:48.779413  1602 raft_consensus.cc:2410] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:58:48.780021  2279 leader_election.cc:336] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.882s (SENT)
W20260709 12:58:48.764160  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.705224  4499 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:48.780704  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:48.769443  4507 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.693204  4448 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:48.794126  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.778234  4252 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:48.770756  4180 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:49.006613  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.255208  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:48.802574  1596 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:49.256291  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.256539  1596 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:49.257054  1600 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:48.780221  4506 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:48.785246  4499 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.883886  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.831120  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.807487  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:49.058387  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.263441  1597 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:58:48.912494  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.967058  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.070637  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.266844  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.885079  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:48.887115  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:48.843863  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.269295  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:49.270056  1602 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:49.269922  1676 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:49.270744  1595 raft_consensus.cc:2410] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:49.271924  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:49.263365  1567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.012s
I20260709 12:58:49.272578  1600 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:49.272768  1567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.008s	sys 0.012s
W20260709 12:58:48.959712  4521 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:58:48.963790  4519 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:58:49.277585  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:49.278277  1677 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:48.961625  4526 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:58:48.960671  4523 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:58:48.880096  4530 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:49.283368  1669 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:49.284031  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.284880  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.283075  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:48.827075  4442 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:48.963349  4504 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:49.294508  1598 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:49.274109  4503 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:48.900521  4448 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:49.295924  1597 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:49.289021  1596 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.302655  1598 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:49.306262  1598 pending_rounds.cc:85] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 4
I20260709 12:58:49.306555  1598 pending_rounds.cc:107] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:49.306829  1598 raft_consensus.cc:2889] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.114946  4252 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.305133  4465 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.318199  2280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.017s
W20260709 12:58:49.333541  2280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.010s	sys 0.018s
I20260709 12:58:49.319046  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1216) took 1038 ms. Trace:
I20260709 12:58:49.325533  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.337036  1598 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:49.325932  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.328101  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.339291  1600 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:49.332774  1599 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:49.340770  1599 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:49.312407  1596 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:49.345381  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.341517  1599 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:48.807607  4180 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:49.410055  1596 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:49.334501  1678 rpcz_store.cc:276] 0709 12:58:48.281839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.286116 (+  4277us) service_pool.cc:224] Handling call
0709 12:58:48.295666 (+  9550us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:48.363499 (+ 67833us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:48.401887 (+ 38388us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.549464 (+147577us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:48.567758 (+ 18294us) log.cc:844] Serialized 590 byte log entry
0709 12:58:48.567913 (+   155us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:48.567949 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.568021 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.578274 (+ 10253us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b18002604a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:49.318651 (+740377us) raft_consensus.cc:1685] finished
0709 12:58:49.318776 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.318974 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109135,"prepare.queue_time_us":41660,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":34136,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":31830,"spinlock_wait_cycles":12888832,"thread_start_us":110990,"threads_started":1,"wal-append.queue_time_us":246284}
W20260709 12:58:49.417755  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.429083  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.417761  1677 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:49.429826  1600 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:49.428401  1596 pending_rounds.cc:85] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 3
I20260709 12:58:49.351485  1602 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:49.430814  1596 pending_rounds.cc:107] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 12:58:49.416077  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.057s	sys 0.113s
W20260709 12:58:49.431528  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.057s	sys 0.114s
W20260709 12:58:49.431968  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 640819us
I20260709 12:58:49.431465  1596 raft_consensus.cc:2889] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.353482  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.436376  1595 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:49.384394  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.438318  1597 raft_consensus.cc:2410] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:49.428212  1599 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:49.449890  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.461127  1600 raft_consensus.cc:2376] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7. Re-sending same reply.
W20260709 12:58:49.361809  4526 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:58:49.467869  4534 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:58:49.469149  4534 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:49.469534  4528 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.582s	user 0.000s	sys 0.021s
I20260709 12:58:49.477233  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.478581  1600 raft_consensus.cc:2368] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8.
I20260709 12:58:49.320811  4252 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:49.500430  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:49.478585  4529 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.597s	user 0.011s	sys 0.005s
W20260709 12:58:49.507458  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.019s	sys 0.022s
I20260709 12:58:49.310664  4448 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:49.319028  4465 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:49.508185  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.019s	sys 0.023s
I20260709 12:58:49.472594  4543 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:49.469573  4534 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 12:58:49.528925  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 759550us
I20260709 12:58:49.530593  1595 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:49.532616  4543 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:49.552222  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:49.315979  4442 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.319598  4503 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:49.507972  4508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.007s	sys 0.037s
I20260709 12:58:49.508363  4542 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:49.566938  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.568482  4543 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:49.572695  1595 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 5: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:49.573233  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:49.570140  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.569228  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.574152  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:49.574337  1601 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:49.567965  4534 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:49.583055  4543 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:49.585095  4538 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:58:49.586658  4544 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:49.588788  4544 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:49.593201  4252 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:49.593806  4252 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:49.594195  4252 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.595965  4536 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:49.596585  4536 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.596971  4536 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:49.602069  4522 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.721s	user 0.009s	sys 0.006s
I20260709 12:58:49.606882  4465 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:49.607635  4525 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.703s	user 0.002s	sys 0.000s
I20260709 12:58:49.609153  2311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 268) took 1210 ms. Trace:
I20260709 12:58:49.609584  2311 rpcz_store.cc:276] 0709 12:58:48.398720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.415486 (+ 16766us) service_pool.cc:224] Handling call
0709 12:58:48.505935 (+ 90449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.593106 (+ 87171us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:48.593171 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.593792 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.756884 (+163092us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:48.759585 (+  2701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.771466 (+ 11881us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.606828 (+835362us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:49.608796 (+  1968us) raft_consensus.cc:1685] finished
0709 12:58:49.608825 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.609061 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3413,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":5071,"spinlock_wait_cycles":133242240,"thread_start_us":104630,"threads_started":1,"wal-append.queue_time_us":244863}
I20260709 12:58:49.623710  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.624377  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.624598  1595 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:49.625267  1600 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:49.625682  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.626207  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.626575  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.626859  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:49.627184  1596 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:49.627772  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.628113  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.628528  1597 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:49.629007  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.629468  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.629673  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.630275  1596 raft_consensus.cc:2376] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6. Re-sending same reply.
I20260709 12:58:49.630702  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:49.569710  4508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.007s	sys 0.038s
I20260709 12:58:49.636145  4508 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:49.636301  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.637348  4508 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.578402  4533 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.643673  4533 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.644229  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.644971  1595 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:49.645247  1602 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:49.646052  4533 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:49.581518  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.595801  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.532168  4448 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:49.570995  4505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.017s	sys 0.027s
I20260709 12:58:49.654700  1599 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:49.651576  1598 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:49.653823  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.695011  1602 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:58:49.680642  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.680205  1594 raft_consensus.cc:2410] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:49.692116  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:49.681775  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:49.697292  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:49.637360  1600 raft_consensus.cc:2376] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9. Re-sending same reply.
I20260709 12:58:49.745020  4448 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:49.578611  4537 raft_consensus.cc:2764] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:58:49.700986  1669 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:49.750051  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.742098  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44890.4us
I20260709 12:58:49.754781  1669 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:49.756223  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:49.697956  4501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.004s	sys 0.021s
W20260709 12:58:49.695871  4505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.017s	sys 0.028s
W20260709 12:58:49.686409  4507 consensus_meta.cc:287] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
I20260709 12:58:49.758517  1675 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:49.761155  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:49.763103  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.758873  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.745944  4544 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:49.757164  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:49.751576  4496 raft_consensus.cc:2764] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:49.746938  4533 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:49.784765  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:49.769250  4342 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:49.579957  4542 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:49.770610  4501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.005s	sys 0.022s
I20260709 12:58:49.786564  1600 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:58:49.797015  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.800536  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:49.695333  4499 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:49.812796  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.784163  4180 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:49.799424  4506 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
I20260709 12:58:49.790629  4544 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:49.822975  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.824734  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.828117  1676 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:49.818522  4429 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:49.862531  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.869091  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 111992us
I20260709 12:58:49.823101  4544 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:49.873878  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.874981  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:49.884907  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.885149  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.885524  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.891090  1595 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:49.887208  1603 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:49.802275  4533 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.892614  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:49.893457  1746 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:49.789986  4507 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:49.894829  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:49.891151  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:49.898953  1751 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:49.901424  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:49.903512  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:49.906534  2315 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:49.825594  4342 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:49.902281  1751 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:49.917955  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.918705  1602 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:49.919170  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.823014  4511 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 12:58:49.854624  4441 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:49.823297  4506 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:49.925555  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:49.930500  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:49.931531  1599 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:49.938740  4533 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:49.910043  4496 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:49.951016  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:49.955386  1747 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.956493  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:49.957463  2313 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:49.926762  1746 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:49.907760  4424 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.968439  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:49.806546  4501 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:49.998339  1602 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:58:50.004299  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.016930  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:50.020399  1603 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.953779  2311 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.005549  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.025362  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:49.953351  4532 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.025197  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.028193  1746 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:50.037703  1749 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:50.026265  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.031028  1678 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:50.055526  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:49.973281  4542 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:50.058447  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:50.061959  1602 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:50.064157  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:50.008939  4496 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:49.947952  4441 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:49.973754  4518 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 12:58:50.084226  1670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.015s
I20260709 12:58:50.000118  4424 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:50.076478  4529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.044s	sys 0.069s
W20260709 12:58:50.097167  1670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.013s	sys 0.015s
I20260709 12:58:50.100976  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:50.104303  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 407161us
I20260709 12:58:50.108095  1603 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:58:50.109654  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.111183  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.056478  4532 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:50.131063  1602 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 12:58:50.107568  4529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.045s	sys 0.069s
I20260709 12:58:50.097373  4452 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.158048  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.159091  1746 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:50.133291  1641 connection.cc:256] RPC call timeout handler was delayed by -1.5214024550000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:58:50.162163  1641 connection.cc:256] RPC call timeout handler was delayed by -1.4215024550000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:58:50.162516  1641 connection.cc:256] RPC call timeout handler was delayed by -1.3000024550000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:58:50.162760  1641 connection.cc:256] RPC call timeout handler was delayed by -1.2568024550000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 12:58:50.163022  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0129024550000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 12:58:50.128707  4543 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.187485  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:58:50.181874  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.081139  4342 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.189287  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:50.178084  4539 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:58:50.139232  4448 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.189769  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.200517  1751 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:50.155587  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:50.192476  4504 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:58:50.157508  4497 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.204974  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.196061  4536 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.003s
W20260709 12:58:50.216109  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.124864  4501 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.239218  4536 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.181008  4542 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:58:50.199126  4499 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.165967  4452 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:50.251114  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.198359  4547 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:50.253368  1751 raft_consensus.cc:2410] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:50.201265  4543 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.194664  4503 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:58:50.235242  4180 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.251999  4506 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.208565  4448 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.237213  4497 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.212666  4496 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:50.272815  4546 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.267596  4508 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.280124  4507 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:50.282261  4547 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:50.378072  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.370355  1747 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:58:50.309520  4550 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:58:50.387327  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1226) took 1132 ms. Trace:
I20260709 12:58:50.387799  1672 rpcz_store.cc:276] 0709 12:58:49.255021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.260154 (+  5133us) service_pool.cc:224] Handling call
0709 12:58:49.277057 (+ 16903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.277439 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.277465 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.288452 (+ 10987us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.788004 (+499552us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:49.788052 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.788125 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.387070 (+598945us) raft_consensus.cc:1685] finished
0709 12:58:50.387096 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.387255 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54414,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":23140,"thread_start_us":459539,"threads_started":1,"wal-append.queue_time_us":718748}
W20260709 12:58:50.390398  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.396118  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.301887  4551 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 12:58:50.401556  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.304104  4561 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:58:50.314867  4252 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.720s	user 0.013s	sys 0.002s
W20260709 12:58:50.405249  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.325114  4452 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.333443  4441 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:50.305603  4543 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.329366  4532 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:50.320930  4424 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:50.312301  4465 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.396309  4499 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.293535  4180 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:50.447145  2279 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.863s (SENT)
I20260709 12:58:50.452481  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:50.332612  4544 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:50.465652  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.385119  4546 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.401662  4508 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.410346  4252 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.448637  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:50.474304  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:50.468400  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 76142.6us
I20260709 12:58:50.431466  4499 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.430058  4465 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:50.522330  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.555570  4465 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:50.557667  4568 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:58:50.479491  4547 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:50.560895  4180 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.563071  4252 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:50.563618  4562 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:50.517812  4424 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:58:50.564780  4570 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:50.565850  4497 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:50.563313  4566 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:58:50.571610  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.576458  1750 raft_consensus.cc:2410] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:58:50.602942  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.603056  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:50.604151  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:50.604853  2310 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:50.605628  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:50.607779  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 94567.8us
I20260709 12:58:50.614151  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.625442  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.591699  4252 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:50.630054  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 120355us
I20260709 12:58:50.589586  4499 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.639412  1750 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:50.641489  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.886s (SENT)
I20260709 12:58:50.642189  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:50.649626  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.651178  4546 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:50.652206  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.654615  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.656826  1750 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:50.659315  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:50.633168  4448 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.664875  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.653693  4564 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:50.632757  4252 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:50.677177  4579 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
W20260709 12:58:50.678397  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.667686  4588 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:58:50.680874  1750 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:50.659054  4546 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:58:50.710122  4546 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:50.718779  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.008s
I20260709 12:58:50.677376  4575 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:50.719789  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.010s	sys 0.008s
W20260709 12:58:50.720388  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 530145us
I20260709 12:58:50.736778  4252 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:50.708554  4588 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:50.745893  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 375) took 1254 ms. Trace:
I20260709 12:58:50.746456  1678 rpcz_store.cc:276] 0709 12:58:49.491734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.491868 (+   134us) service_pool.cc:224] Handling call
0709 12:58:49.492241 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.039895 (+547654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.745596 (+705701us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400193f54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:50.745821 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238240512}
I20260709 12:58:50.754158  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:50.766062  4511 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:50.767665  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.793754  1750 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:58:50.769222  4594 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:58:50.776726  4584 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:58:50.705202  4497 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:58:50.781178  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:50.783030  4592 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:50.783423  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.784309  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.802336  1747 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
W20260709 12:58:50.802608  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59333.4us
I20260709 12:58:50.785238  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.787148  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:50.788249  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.810205  1748 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:50.761866  4591 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:58:50.789445  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.811235  1678 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:50.789649  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:50.761592  4544 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:50.753756  4575 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:50.795403  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.834820  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.835783  1750 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:50.797039  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:50.798906  4442 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:50.849261  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52298.3us
W20260709 12:58:50.856915  4578 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:58:50.872303  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:50.872957  4511 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:50.861179  4442 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.876077  4511 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.876637  4511 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:50.876614  4442 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:50.873235  4575 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:51.018266  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.135031  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 267160us
I20260709 12:58:50.912751  1750 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:50.884740  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.140584  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.138626  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.139369  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.082341  2315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36896 (request call id 207) took 1153 ms. Trace:
W20260709 12:58:50.825567  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 78249.6us
W20260709 12:58:50.961898  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.146698  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:51.147869  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:51.148504  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:51.152294  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.007717  4580 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.442s	user 0.000s	sys 0.003s
W20260709 12:58:50.899845  4584 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:58:51.206281  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:51.159653  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.003611  4556 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.724s	user 0.003s	sys 0.000s
I20260709 12:58:51.206964  4424 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:58:50.896569  4581 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.299s	user 0.001s	sys 0.002s
I20260709 12:58:51.217963  1743 raft_consensus.cc:2410] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:51.218060  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:51.152232  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:51.216552  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.212750  1747 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:58:51.213790  1748 raft_consensus.cc:2410] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:51.217444  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:51.228168  1672 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:51.079041  4508 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:51.241410  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0841759639999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:58:51.252158  1715 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.544s (SENT)
I20260709 12:58:51.252861  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:51.210673  2315 rpcz_store.cc:276] 0709 12:58:49.929256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.929439 (+   183us) service_pool.cc:224] Handling call
0709 12:58:49.996785 (+ 67346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.105722 (+108937us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:50.289854 (+184132us) log.cc:844] Serialized 14 byte log entry
0709 12:58:50.498550 (+208696us) log.cc:844] Serialized 14 byte log entry
0709 12:58:50.513190 (+ 14640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:50.513266 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:50.513336 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.006159 (+492823us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b18003460c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:51.082021 (+ 75862us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400643cd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:58:51.082099 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.082272 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17548,"prepare.queue_time_us":130376,"prepare.run_cpu_time_us":230,"prepare.run_wall_time_us":4418,"raft.queue_time_us":44025,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":51714,"spinlock_wait_cycles":257355648,"thread_start_us":327371,"threads_started":2,"wal-append.queue_time_us":341920}
I20260709 12:58:51.256197  4508 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:51.257114  4508 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:51.265620  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.266732  4601 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:51.267314  4592 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:51.267424  4601 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.270395  4601 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:51.290171  1751 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:58:51.222016  4586 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:51.228868  4534 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:51.294850  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.258669  4508 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.297413  1747 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:51.295719  1748 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:51.218281  4424 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:51.318982  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1548) took 1225 ms. Trace:
I20260709 12:58:51.322309  1598 rpcz_store.cc:276] 0709 12:58:50.093677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.093898 (+   221us) service_pool.cc:224] Handling call
0709 12:58:50.094395 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:50.113704 (+ 19309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:50.113738 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:50.160143 (+ 46405us) log.cc:844] Serialized 26 byte log entry
0709 12:58:50.405462 (+245319us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:50.405507 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.405619 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.007031 (+601412us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:51.309124 (+302093us) raft_consensus.cc:1685] finished
0709 12:58:51.309160 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.318859 (+  9699us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15529,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":24699,"spinlock_wait_cycles":7616896,"thread_start_us":193319,"threads_started":1,"wal-append.queue_time_us":290256}
W20260709 12:58:51.307847  4547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.016s	sys 0.031s
I20260709 12:58:51.345999  1747 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:51.371408  1748 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:51.372445  1749 raft_consensus.cc:1217] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:58:51.373028  1749 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:58:51.373028  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.375052  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.388335  1751 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:51.347635  4547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.017s	sys 0.031s
I20260709 12:58:51.297745  4586 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.391639  1747 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:58:51.411955  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.412989  1744 raft_consensus.cc:2410] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:51.414803  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.417593  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.418327  1747 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:51.419874  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.419909  1751 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:51.424288  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.425203  1748 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:51.441421  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.452622  4591 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:51.453187  4591 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:51.454136  4591 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.457991  4536 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:51.473446  4549 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.385s	user 0.003s	sys 0.007s
I20260709 12:58:51.413695  4597 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:51.479902  1501 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 2 to 5, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:58:51.493094  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.433954  4429 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:51.498600  4598 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:58:51.486248  4597 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.518671  4597 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:51.416875  4424 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.455440  4591 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:51.557919  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 405727us
I20260709 12:58:51.559448  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.565747  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:51.561780  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 335728us
I20260709 12:58:51.574343  4424 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:51.578622  4586 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:51.581830  1566 connection.cc:256] RPC call timeout handler was delayed by -6.6256403330000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 12:58:51.583580  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:51.588205  4586 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:51.588802  4586 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.589207  4586 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:51.505350  4429 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.597927  4429 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:51.562683  4543 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.599016  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.609026  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:51.620862  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:58:51.621802  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 353057us
I20260709 12:58:51.637303  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:51.638085  1600 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:51.638015  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:51.638911  1601 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:51.620047  4429 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:51.640479  4429 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:51.642439  4429 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:51.642832  4429 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:51.643464  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.648067  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:51.649021  1596 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:51.617908  4543 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.653745  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:51.654356  1715 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.622s (SENT)
I20260709 12:58:51.656145  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:51.659052  1715 leader_election.cc:336] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.660s (SENT)
W20260709 12:58:51.659521  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.659654  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:51.654564  1599 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:51.662139  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:51.667330  1715 leader_election.cc:336] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.674s (SENT)
I20260709 12:58:51.670799  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:51.631919  4565 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:51.682632  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.686095  1600 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
W20260709 12:58:51.694444  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.698395  1601 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:51.678787  4609 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:51.702975  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.705588  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:58:51.714116  4603 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:58:51.714672  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:51.668530  4605 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:51.710525  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.719034  1594 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:51.711728  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.708648  1599 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:51.720119  1595 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:51.721328  1596 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:51.722780  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.722646  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:51.723625  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.745249  1599 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:51.745792  1594 raft_consensus.cc:2410] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:58:51.716791  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49509us
W20260709 12:58:51.746879  1715 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.785s (SENT)
I20260709 12:58:51.715620  2311 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:51.739744  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.740873  4606 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:58:51.751313  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:51.763232  1599 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:51.700537  4597 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:51.771127  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.763334  1601 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:51.773962  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.775295  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.797s (SENT)
I20260709 12:58:51.778389  1594 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:51.778647  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:51.779736  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:58:51.777061  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 144892us
I20260709 12:58:51.774062  1595 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:58:51.781987  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.772374  4442 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
W20260709 12:58:51.794541  1715 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.889s (SENT)
I20260709 12:58:51.770608  4620 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.701031  4565 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.813514  2313 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:51.810006  1599 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:51.865304  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.864215  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:51.738998  4586 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:51.800045  4511 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.006s
I20260709 12:58:51.865880  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.864215  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.797736  4613 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:51.870323  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.869992  1601 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:51.799211  4543 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:51.890141  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.895226  4511 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.889817  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.814873  4542 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:51.742424  4429 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.811430  4605 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.916070  4496 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:51.810194  4508 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:51.916581  2316 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:58:51.916832  4508 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.918130  4586 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:51.901300  1596 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:51.795248  4442 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.909868  4536 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:51.923758  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.884407  4564 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.936512  1678 raft_consensus.cc:606] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:58:51.941531  1678 raft_consensus.cc:614] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:51.938482  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.945400  1596 raft_consensus.cc:2410] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:58:51.951741  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.953903  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.957172  1599 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:51.931043  4496 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:51.962723  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.962709  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.935318  4627 raft_consensus.cc:2764] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:51.930269  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:51.958616  4610 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:58:51.964231  1599 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:51.920017  4543 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.993240  4543 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:51.994115  4632 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.966898  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:51.923686  4542 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.932722  4586 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:58:51.997519  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:51.972780  4442 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:51.975114  4619 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:58:51.977159  2313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 208) took 1947 ms (client timeout 2032 ms). Trace:
W20260709 12:58:52.002355  2313 rpcz_store.cc:269] 0709 12:58:50.029396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.029716 (+   320us) service_pool.cc:224] Handling call
0709 12:58:51.976902 (+1947186us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54007f7e54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:58:51.977058 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3854469888}
W20260709 12:58:51.978883  4631 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:58:51.979696  4617 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:58:51.980258  4599 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.561s	user 0.003s	sys 0.001s
I20260709 12:58:51.960827  4508 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:51.962641  4429 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.020941  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.022176  1600 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:58:51.964120  4629 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:58:51.943141  4564 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.970551  2312 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:51.998417  1599 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:52.000253  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.036556  1596 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:51.910612  4613 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:51.930543  4505 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:58:51.991076  4605 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:58:51.865201  4620 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:51.994781  4632 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.032399  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.045908  1600 raft_consensus.cc:2410] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:58:52.046844  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.047926  1599 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:51.996728  1595 raft_consensus.cc:2368] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 12:58:52.041335  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.049887  1596 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:58:52.032459  4608 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:58:52.059775  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.060622  1600 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:52.064816  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.065380  1601 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:58:52.065925  1600 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:58:52.069602  4630 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:58:52.071666  4511 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.072094  4542 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.072381  4613 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.073257  4604 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:52.073360  4424 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:52.076975  4632 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.078944  4620 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:52.079728  4565 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.080315  4575 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:52.084661  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.085834  1603 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:58:52.094350  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.095230  1603 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:52.105206  1594 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:52.108765  4628 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:58:52.122910  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.123917  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.124444  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.124842  1595 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:52.125049  1596 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:52.125998  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.126072  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:52.126585  1596 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:52.126832  1595 raft_consensus.cc:2376] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:58:52.127983  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:52.106428  4591 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
I20260709 12:58:52.128858  1597 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:52.127485  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.129791  1596 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:52.130474  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.131589  1603 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:52.133025  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.133939  1600 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
W20260709 12:58:52.137969  4623 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.273s	user 0.001s	sys 0.001s
W20260709 12:58:52.139421  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.082197  4609 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:58:52.154250  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.162380  1749 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:52.165143  1595 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:52.165534  1595 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:52.164460  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 101310us
W20260709 12:58:52.171928  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.172036  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:52.174284  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.175851  4591 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:52.189386  2315 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:58:52.173682  4609 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:52.196153  4625 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.308s	user 0.003s	sys 0.000s
W20260709 12:58:52.198870  4624 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
W20260709 12:58:52.199697  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.199954  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 272) took 1048 ms. Trace:
I20260709 12:58:52.200385  2310 rpcz_store.cc:276] 0709 12:58:51.151708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.213951 (+ 62243us) service_pool.cc:224] Handling call
0709 12:58:51.517382 (+303431us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b58001f0598. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:58:51.517645 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.518097 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.518137 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:51.518689 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:58:51.711841 (+193152us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:51.711900 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.711988 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:52.195451 (+483463us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:52.199647 (+  4196us) raft_consensus.cc:1685] finished
0709 12:58:52.199668 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.199881 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2029,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"spinlock_wait_cycles":59238528,"thread_start_us":192669,"threads_started":1,"wal-append.queue_time_us":272039}
I20260709 12:58:52.189057  1595 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.207983  1595 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.211786  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.212742  1598 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:52.214919  1598 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:52.220184  1599 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:52.220692  1599 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:52.221606  1599 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:52.222890  1599 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.235107  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:52.236538  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.237285  1598 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:52.238320  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.270963  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:52.271690  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.272187  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:52.244889  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 315055us
I20260709 12:58:52.275421  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:52.277189  4638 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:52.277904  4638 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:52.278801  4638 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.282577  4564 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:52.283588  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.252635  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.285048  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.285399  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.254485  4643 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:52.286584  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.287496  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.287587  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.288306  1678 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:58:52.288350  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.289269  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.290071  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.290735  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:52.291508  4637 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:52.254680  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:52.293098  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.294144  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.294775  1744 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:58:52.296315  1596 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:52.296756  1596 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:52.297626  1596 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.298539  1596 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:52.299599  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.301198  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.303682  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:52.304525  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.305209  1747 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:52.306656  1745 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:52.308151  1603 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:52.308427  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.309154  4542 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:52.309504  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.310171  1743 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:52.310266  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.310864  4508 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:52.311057  4505 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:52.311147  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:58:52.311517  4508 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:52.311717  4505 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:52.312835  4612 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:52.312623  4508 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.313265  4612 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.313632  4612 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:52.315497  4543 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:52.315900  4547 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:52.316926  4496 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:52.317943  4615 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:52.318586  4496 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:52.319104  4496 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:52.319747  4615 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.320214  4615 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:52.320370  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:52.320617  4615 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.310896  4452 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:52.323176  4452 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.323575  4452 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.265703  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:52.327943  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.328928  4496 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.329833  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:52.312623  4505 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.339274  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:52.340932  4564 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:52.341384  4564 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.341738  4564 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.342530  1596 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:52.343619  1599 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:58:52.344200  4635 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:58:52.344929  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.340276  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:52.346688  4441 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:52.353274  1595 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:58:52.353751  1595 pending_rounds.cc:85] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
I20260709 12:58:52.353986  1595 pending_rounds.cc:107] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:58:52.354216  1595 raft_consensus.cc:2889] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:52.354439  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.355146  1745 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:52.322539  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.254674  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:52.360107  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:52.361747  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:52.364048  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:52.390903  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.397298  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.399060  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.399580  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.404084  1601 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
W20260709 12:58:52.422904  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1183022860000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:58:52.423565  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1066022859999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:58:52.424005  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1066022859999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:58:52.424437  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0877022860000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 12:58:52.424849  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0436022860000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:58:52.425237  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0319022859999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:58:52.425645  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0319022859999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:58:52.428306  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 173720us
I20260709 12:58:52.429502  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:52.439606  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.477969  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 113964us
I20260709 12:58:52.486528  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:52.488142  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56130.7us
W20260709 12:58:52.484934  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58341.9us
I20260709 12:58:52.490568  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:52.489092  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:52.480319  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 167882us
I20260709 12:58:52.489081  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:52.500788  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.502476  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.533313  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:52.534614  1748 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:52.535022  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.476655  4629 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.422243  4635 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.380196  4441 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:52.539695  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44181.5us
I20260709 12:58:52.476362  4620 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:52.421548  4540 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:52.479192  4547 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:52.493319  4611 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.544394  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:52.544510  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 55527.7us
I20260709 12:58:52.582293  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:52.490226  4637 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:52.545333  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.492221  4588 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:52.488766  4424 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:52.573814  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73989us
I20260709 12:58:52.545904  1497 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:52.661530  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79333.1us
I20260709 12:58:52.476950  4644 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:52.612290  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.477061  4564 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:52.680838  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.681495  1749 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:58:52.688501  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.589516  4543 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:52.660418  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69137.6us
I20260709 12:58:52.497586  4643 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:58:52.541747  4609 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:58:52.556823  4629 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.581562  4604 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:52.589660  4611 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:52.707459  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 43897.2us
I20260709 12:58:52.716336  1748 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:52.663322  4424 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.497396  4518 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.580624  4620 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.728658  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.729048  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.747515  1675 raft_consensus.cc:2410] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:52.695104  4441 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:52.676234  4588 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:52.755462  4441 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:52.756000  4588 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.678866  1715 leader_election.cc:400] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8.
I20260709 12:58:52.715023  4547 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.763943  1715 leader_election.cc:403] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:52.749177  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:58:52.750787  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.569628  4635 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.765259  4632 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:52.766788  1566 leader_election.cc:400] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:52.767078  1566 leader_election.cc:403] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:52.767102  4635 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.753122  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.767732  4605 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8.
I20260709 12:58:52.741212  4518 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:52.768532  4518 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.770267  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.756138  4441 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:52.771756  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:52.772264  4661 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:52.773216  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:52.774003  1672 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7.
I20260709 12:58:52.776731  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.776473  4612 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:52.778271  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.778867  4612 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.780861  4629 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.781674  4543 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.737352  4424 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.819092  4564 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.822139  4588 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.814693  4441 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:52.823740  1743 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:52.824186  4620 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.827188  4588 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:52.724532  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.680671  4597 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:52.807812  4632 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:52.833379  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.816901  4518 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:52.696540  4644 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.734135  4611 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:52.842327  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 351772us
W20260709 12:58:52.829173  4615 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 12:58:52.853986  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.835120  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.816258  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:52.833598  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 168419us
I20260709 12:58:52.865926  4614 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:52.866696  4614 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:52.869097  4614 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.846300  4637 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:52.869108  4644 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.858665  4615 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.873227  1678 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:52.874457  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 194) took 6226 ms. Trace:
W20260709 12:58:52.874701  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58598.3us
I20260709 12:58:52.876564  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:52.878438  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.880287  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:52.876091  1497 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:52.783505  4452 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.917261  1497 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:52.927611  1497 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:52.918354  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:52.918594  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:52.930825  1675 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.874233  4615 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:52.923671  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:52.932184  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.934979  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:52.935870  1748 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.937268  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:52.857317  4597 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:52.940500  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.941112  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:52.930051  1497 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index 3 to 5, term changed from 4 to 6, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to <none>, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:58:52.953899  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.956907  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:52.874876  1500 rpcz_store.cc:276] 0709 12:58:46.648269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.648438 (+   169us) service_pool.cc:224] Handling call
0709 12:58:52.874380 (+6225942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:47.559091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:47.712991 (+153900us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:47.719921 (+  6930us) write_op.cc:435] Acquired schema lock
0709 12:58:47.726843 (+  6922us) tablet.cc:662] Decoding operations
0709 12:58:48.085440 (+358597us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:48.085510 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:48.085544 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:58:48.086914 (+  1370us) tablet.cc:701] Row locks acquired
0709 12:58:48.086944 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:58:48.095997 (+  9053us) write_op.cc:270] Start()
0709 12:58:48.104005 (+  8008us) write_op.cc:276] Timestamp: P: 1783601928087094 usec, L: 0
0709 12:58:48.109548 (+  5543us) op_driver.cc:348] REPLICATION: starting
0709 12:58:48.285594 (+176046us) log.cc:844] Serialized 5566 byte log entry
0709 12:58:48.664706 (+379112us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f947e3830ac 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b
0709 12:58:49.470209 (+805503us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:50.316211 (+846002us) op_driver.cc:464] REPLICATION: finished
0709 12:58:50.551151 (+234940us) write_op.cc:301] APPLY: starting
0709 12:58:50.566649 (+ 15498us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:50.567116 (+   467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:50.567152 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:50.734644 (+167492us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:50.734982 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:58:50.735031 (+    49us) write_op.cc:312] APPLY: finished
0709 12:58:50.735442 (+   411us) log.cc:844] Serialized 100 byte log entry
0709 12:58:50.735764 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:50.735962 (+   198us) write_op.cc:454] Released schema lock
0709 12:58:50.736023 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:50.736466 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:50.736496 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50601,"reported_tablets":40,"spinlock_wait_cycles":1140480,"child_traces":[["op",{"apply.queue_time_us":192891,"apply.run_cpu_time_us":10306,"apply.run_wall_time_us":221635,"num_ops":14,"prepare.queue_time_us":358873,"prepare.run_cpu_time_us":52459,"prepare.run_wall_time_us":1243782,"raft.queue_time_us":774034,"raft.run_cpu_time_us":16338,"raft.run_wall_time_us":158309,"replication_time_us":2206448,"spinlock_wait_cycles":189807744,"thread_start_us":1471819,"threads_started":4,"wal-append.queue_time_us":548399,"wal-append.run_cpu_time_us":140188,"wal-append.run_wall_time_us":2903596}]]}
I20260709 12:58:52.913848  4632 raft_consensus.cc:2764] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:58:52.969888  1678 raft_consensus.cc:2368] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:58:52.969655  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:52.971303  1748 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 12:58:52.975869  4647 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:58:52.975462  4597 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:52.968211  4643 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:52.934803  4644 raft_consensus.cc:2764] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:52.989995  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:52.971601  1497 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.991057  1673 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:52.992467  1497 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 6 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.946012  4588 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:53.000962  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.957623  4629 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:53.005153  1675 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 12:58:53.005790  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62213us
I20260709 12:58:53.008896  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:52.950057  4635 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:52.995163  1497 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.020098  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.021746  1497 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:52.948464  4441 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:53.016600  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:53.009181  4591 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.028491  1497 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.010689  4605 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:52.996089  4575 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:52.960539  4620 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:58:53.029805  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.036098  1497 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:53.009199  4632 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:58:53.031792  4644 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.017313  4424 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.087060  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.088757  1675 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:53.036882  4605 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:53.039178  4575 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:53.094547  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:53.033285  4591 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.099717  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:53.103271  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 121425us
I20260709 12:58:53.045593  4635 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:58:53.104436  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:53.115518  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.110731  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 94199.3us
I20260709 12:58:53.091825  4605 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:53.112762  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:53.113654  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.088549  4620 raft_consensus.cc:2764] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:53.090107  4644 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.100044  4643 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:53.121459  1675 raft_consensus.cc:2368] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:53.096413  4575 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:53.105046  4632 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:53.116429  4635 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:53.118726  4588 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:53.131256  4632 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:53.159060  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:53.160168  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:53.135118  4452 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:53.135332  4673 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:58:53.136103  4656 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:53.136716  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.123335  4429 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:53.133886  4666 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:53.140089  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.141664  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.143184  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.143908  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.146863  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:53.147209  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.148547  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.148916  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.143936  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.119459  4518 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:53.161084  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:53.136859  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.153229  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:53.169082  1669 raft_consensus.cc:2368] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:58:53.170094  1671 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:58:53.172154  1674 raft_consensus.cc:2368] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11.
I20260709 12:58:53.150434  4635 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:53.180255  1670 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:58:53.161937  4609 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:58:53.206300  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:53.229744  1677 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:58:53.219211  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.201239  4644 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:53.167016  4666 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.203961  2315 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:53.211478  4629 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:53.245188  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:53.184404  4429 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:53.176929  4677 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:53.221794  1675 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:53.216292  1676 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:53.220713  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.206120  4604 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.200647  4591 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:53.165864  4588 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:53.165490  4678 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:53.164127  4620 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:58:53.239976  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50388.9us
I20260709 12:58:53.217442  1672 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:53.243222  1673 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:58:53.264307  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.266990  1674 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:53.266990  1677 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:58:53.304949  1677 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:53.270865  1670 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:53.271238  1671 raft_consensus.cc:1217] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[9.5-9.5]   Dedup: 9.5->[]
I20260709 12:58:53.306702  1671 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:53.279603  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.278110  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:53.218055  4681 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.292603  1676 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:53.285909  1678 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:53.269553  4666 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:53.286017  4604 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.322997  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.315529  1673 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:53.316200  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:53.281172  4677 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:53.344177  1677 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:53.347667  4679 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:58:53.212390  4635 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.294442  4678 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:53.291378  4588 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.353289  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.309168  4681 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:53.243786  4632 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:53.359418  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.359258  4597 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:58:53.372627  1671 raft_consensus.cc:2368] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:53.375600  1676 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:53.380831  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:53.384511  4657 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.265s	user 0.004s	sys 0.000s
I20260709 12:58:53.402215  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.342190  4604 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.389137  4605 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.398973  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.343190  4677 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:53.445720  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:53.446522  1600 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:53.442631  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:53.449167  1597 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:53.391322  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 230271us
I20260709 12:58:53.352412  4635 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.411492  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.395795  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:53.457203  1601 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.457327  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:53.457648  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.411391  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:53.385067  4683 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:58:53.415325  1602 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:53.416164  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.418673  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.462539  1750 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.401917  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:53.462873  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.463269  1595 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:53.412101  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.398864  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:53.321931  4424 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:53.460011  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.423760  1670 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:53.464849  1598 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:53.468010  1599 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:58:53.467582  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1236854759999346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28690000000000004s for a response
I20260709 12:58:53.470000  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:53.470377  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.527s (SENT) [suppressed 42 similar messages]
I20260709 12:58:53.477914  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:53.392081  4681 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.478968  1597 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:53.484125  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:53.484838  1594 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:53.489640  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.489938  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:53.469336  4611 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.003s
I20260709 12:58:53.491822  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.493139  1601 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:53.493994  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.496960  1744 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:53.498297  1751 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:53.498927  1595 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:53.500065  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:53.500885  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.468111  4620 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.504106  1743 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:58:53.507817  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.508205  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:53.512027  1751 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:58:53.512558  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.512850  1751 pending_rounds.cc:85] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 2
I20260709 12:58:53.513201  1751 pending_rounds.cc:107] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:58:53.513530  1751 raft_consensus.cc:2889] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:53.511212  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 165656us
I20260709 12:58:53.518910  1745 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:58:53.522411  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.525398  1752 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:53.501818  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:53.540916  4629 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:53.541522  4629 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:53.542481  4629 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.548794  4605 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:53.506152  4620 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:53.549780  4620 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.438526  4429 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:53.556840  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.556720  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.561316  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.562024  1743 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.503110  4611 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:53.555847  4682 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:58:53.575034  1751 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:53.575493  1751 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:53.555866  2312 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.560254  4629 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:53.559805  4644 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.591264  1750 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:53.551369  4575 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.576440  1751 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.595813  1751 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:53.597487  1641 connection.cc:256] RPC call timeout handler was delayed by -1.6804732109999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:58:53.600145  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:53.601073  1750 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:53.560001  4605 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:58:53.480365  4678 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.628909  1748 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:53.631358  4687 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:53.634124  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1543) took 1299 ms. Trace:
I20260709 12:58:53.590966  4685 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.646085  1746 rpcz_store.cc:276] 0709 12:58:52.334907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.549000 (+214093us) service_pool.cc:224] Handling call
0709 12:58:52.549434 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:52.862700 (+313266us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800291d00. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9481485060 00007f9481485bfb 00007f948149064b
0709 12:58:52.862853 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.862888 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:52.880540 (+ 17652us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.237967 (+357427us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:53.238034 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.238149 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.633608 (+395459us) raft_consensus.cc:1685] finished
0709 12:58:53.633641 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.633957 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1085,"raft.queue_time_us":24884,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":13965,"spinlock_wait_cycles":26042624,"thread_start_us":470525,"threads_started":2,"wal-append.queue_time_us":471651}
W20260709 12:58:53.690287  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.609685  4644 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.696587  4689 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:58:53.674829  4613 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:53.675293  4637 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:53.681807  4678 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.705173  4620 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.665396  4685 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:53.733026  4644 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:53.708927  4604 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.735204  4685 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:53.710577  1751 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:53.736112  4604 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:53.739360  4620 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:53.739934  1752 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:53.768741  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 214166us
I20260709 12:58:53.770013  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:53.750262  4689 consensus_queue.cc:1243] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:53.744619  4613 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.750255  4666 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.751626  4637 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:53.803967  4632 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:53.833815  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 363398us
W20260709 12:58:53.842160  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.849227  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.823939  4575 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:53.853215  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 188008us
I20260709 12:58:53.868696  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:53.873308  1750 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:53.835935  4597 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:53.889499  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:53.862326  1566 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.699s (SENT)
W20260709 12:58:53.905093  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.897773  1743 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:58:53.900848  4613 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:53.905727  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.902293  4547 raft_consensus.cc:2764] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 12:58:53.926442  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.891531  4597 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:53.907323  4575 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:53.897245  2312 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:53.883699  4605 consensus_queue.cc:1243] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:53.896847  4666 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:53.940656  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.885151  4452 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:58:53.967163  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 104788us
W20260709 12:58:54.005760  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0507854759999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29500000000000004s for a response
W20260709 12:58:54.008095  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0318854759999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29710000000000003s for a response
W20260709 12:58:53.970044  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 200063us
I20260709 12:58:53.976250  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:53.932544  4701 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:53.998065  4629 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.954722  4709 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.029680  1602 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:53.969785  4613 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:54.031273  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 141903us
I20260709 12:58:54.040941  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:54.008993  4708 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:54.049037  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.059433  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:58:54.083503  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.037312  4613 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:54.045276  4620 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.096051  1602 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:54.061813  4702 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.036656  4701 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.062072  4547 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:54.108628  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:54.046030  4629 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.114996  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.065714  4609 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:58:54.096015  4613 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.066831  4708 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:54.137602  4677 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 12:58:54.138124  4677 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.113554  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.039606  4709 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.142218  4709 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.118484  1598 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.140381  4677 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.109490  4452 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:54.145650  4635 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:54.148182  4611 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:54.111730  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53883.2us
I20260709 12:58:54.122573  4701 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:54.128114  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.133880  4629 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.134989  1596 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:58:54.150574  1596 pending_rounds.cc:85] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
I20260709 12:58:54.150835  1596 pending_rounds.cc:107] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:58:54.099359  4637 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.151072  1596 raft_consensus.cc:2889] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:54.103766  4720 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:58:54.138396  4708 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:54.156428  1743 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:58:54.156641  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 97314.8us
I20260709 12:58:54.167029  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:54.168373  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:58:54.168740  4706 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:58:54.169773  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:54.171056  2315 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:54.172298  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:54.175923  4605 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:54.176465  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:54.103169  4620 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:54.178025  4715 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:58:54.179005  4694 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:58:54.048776  4597 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.180109  4620 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:54.180282  4597 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:54.180910  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.181595  1603 raft_consensus.cc:2376] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6. Re-sending same reply.
I20260709 12:58:54.181815  4424 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:54.182523  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.182435  4424 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.183174  1603 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.184203  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.184882  1600 raft_consensus.cc:2376] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6. Re-sending same reply.
I20260709 12:58:54.185274  4424 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:54.185844  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.186555  1600 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:58:54.114408  4724 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:58:54.189654  1672 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:54.191378  1676 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:54.191666  4712 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.088s	user 0.004s	sys 0.000s
I20260709 12:58:54.109647  4702 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.194717  4702 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.172611  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.196733  1601 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.157508  1598 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:58:54.162182  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:54.198963  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.187481  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.202179  1602 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:54.172511  4705 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:58:54.213256  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.224807  1598 raft_consensus.cc:2410] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:54.217674  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:54.218736  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.220271  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:54.222402  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.228703  1600 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:54.204152  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.222450  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:54.232560  1602 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:54.176493  4605 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:54.242725  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.243819  1598 raft_consensus.cc:2376] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9. Re-sending same reply.
I20260709 12:58:54.246764  1603 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:58:54.247953  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:54.248641  1603 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:54.249402  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.249862  1603 raft_consensus.cc:2376] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6. Re-sending same reply.
I20260709 12:58:54.250474  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.251015  1603 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:54.251765  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:54.252275  1603 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:58:54.255301  1601 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:54.206974  4670 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:58:54.221531  4575 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:54.262212  4575 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.284222  1599 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:54.285698  1599 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:54.287135  1599 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:58:54.288215  4575 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:54.244442  4681 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.003s
I20260709 12:58:54.294391  4681 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.295593  1597 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:54.296756  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:54.299177  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.301667  4681 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.241680  4703 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:54.302292  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 139815us
I20260709 12:58:54.319065  1603 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:54.320425  1603 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:54.311291  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.321624  1603 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:54.323253  1603 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:58:54.324641  1603 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:54.312394  1600 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:54.314129  1602 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:58:54.329638  1599 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:54.315670  1597 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:58:54.331205  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.316937  1598 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:54.333087  1715 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.190s (SENT)
W20260709 12:58:54.334473  1715 leader_election.cc:336] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.234s (SENT)
I20260709 12:58:54.335052  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:54.338196  1600 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:54.349449  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.326493  4637 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:54.355175  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:54.332307  4703 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.358248  4703 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:54.359634  4721 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:54.359861  4701 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:54.360698  4721 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:54.359678  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.362718  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:54.363821  4717 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:54.365609  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:54.366480  4701 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:54.372783  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:54.379473  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:54.380752  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:54.381403  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:54.354945  4637 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.381417  1751 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.382211  1750 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:54.391054  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 188693us
I20260709 12:58:54.384891  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:54.386708  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:54.386996  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:54.363087  4597 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:54.359751  4720 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:58:54.370064  4701 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:58:54.461796  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:54.605332  1745 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:54.605350  1750 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:54.470489  1676 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:54.604213  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:54.418004  1751 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:58:54.614070  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 356099us
I20260709 12:58:54.623872  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:54.382591  4703 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:54.467177  4632 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.002s
I20260709 12:58:54.614730  4724 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.644052  4726 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.644764  4726 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:54.646641  4728 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.377s	user 0.004s	sys 0.007s
I20260709 12:58:54.379953  4605 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.466862  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:54.650692  4729 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:58:54.632174  4597 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:54.650399  4613 consensus_meta.cc:287] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:58:54.622723  4547 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:58:54.598721  4604 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:58:54.660490  4604 consensus_queue.cc:1243] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:54.662575  4726 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:54.659963  4613 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:54.666391  4613 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:54.667477  4732 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.427s	user 0.009s	sys 0.004s
I20260709 12:58:54.672775  4637 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.677763  4591 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:54.678261  4591 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:54.679198  4591 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.680631  4591 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:54.685197  4643 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:54.685755  4643 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:54.686723  4643 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:54.688215  4643 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.689837  4605 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.771850  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 86) took 7917 ms. Trace:
W20260709 12:58:54.792392  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.795029  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.796933  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.797866  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.798383  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.798830  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.799736  1596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.008s
W20260709 12:58:54.800331  1596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.005s	sys 0.008s
I20260709 12:58:54.803104  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1596) took 1013 ms. Trace:
I20260709 12:58:54.811657  1596 rpcz_store.cc:276] 0709 12:58:53.790136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.293487 (+503351us) service_pool.cc:224] Handling call
0709 12:58:54.293884 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.294173 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:54.294594 (+   421us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.802002 (+507408us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.802333 (+   331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.802413 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:54.802528 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.802659 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.802992 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5320,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":8243,"thread_start_us":505847,"threads_started":1,"wal-append.queue_time_us":359104}
I20260709 12:58:54.799754  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1589) took 1238 ms. Trace:
W20260709 12:58:54.816376  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 199748us
W20260709 12:58:54.818974  1715 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.564s (SENT)
I20260709 12:58:54.836298  4632 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.849788  4632 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.858767  4746 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:54.865038  4746 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:54.869450  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:54.872033  4611 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:54.872457  4643 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:54.872918  4611 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:54.831912  1601 rpcz_store.cc:276] 0709 12:58:53.561146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.268180 (+707034us) service_pool.cc:224] Handling call
0709 12:58:54.302201 (+ 34021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.318768 (+ 16567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.318802 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.319337 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.798667 (+479330us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:54.798823 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.798987 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.799085 (+    98us) raft_consensus.cc:1685] finished
0709 12:58:54.799113 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.799404 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7700,"raft.queue_time_us":16190,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":50908,"thread_start_us":393010,"threads_started":1,"wal-append.queue_time_us":287480}
I20260709 12:58:54.873668  4643 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:54.880656  4611 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:54.773038  1501 rpcz_store.cc:276] 0709 12:58:46.854488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.856395 (+  1907us) service_pool.cc:224] Handling call
0709 12:58:54.771394 (+7914999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:52.826381 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:52.826984 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:52.827035 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:58:52.827051 (+    16us) tablet.cc:662] Decoding operations
0709 12:58:52.827504 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:52.827600 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:52.827632 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:52.827965 (+   333us) tablet.cc:701] Row locks acquired
0709 12:58:52.827982 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:58:52.828146 (+   164us) write_op.cc:270] Start()
0709 12:58:52.828280 (+   134us) write_op.cc:276] Timestamp: P: 1783601932828093 usec, L: 0
0709 12:58:52.828300 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:52.874031 (+ 45731us) log.cc:844] Serialized 918 byte log entry
0709 12:58:53.315930 (+441899us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:58:53.703487 (+387557us) op_driver.cc:464] REPLICATION: finished
0709 12:58:54.042368 (+338881us) write_op.cc:301] APPLY: starting
0709 12:58:54.049053 (+  6685us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:54.076127 (+ 27074us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:54.087109 (+ 10982us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:54.117161 (+ 30052us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:54.123474 (+  6313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:54.123583 (+   109us) write_op.cc:312] APPLY: finished
0709 12:58:54.123916 (+   333us) log.cc:844] Serialized 28 byte log entry
0709 12:58:54.124187 (+   271us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.124328 (+   141us) write_op.cc:454] Released schema lock
0709 12:58:54.124393 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:54.124981 (+   588us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.125039 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":781084,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":301776,"apply.run_cpu_time_us":3332,"apply.run_wall_time_us":94223,"num_ops":2,"prepare.queue_time_us":577145,"prepare.run_cpu_time_us":27511,"prepare.run_wall_time_us":272382,"raft.queue_time_us":629475,"raft.run_cpu_time_us":42267,"raft.run_wall_time_us":349685,"replication_time_us":874992,"spinlock_wait_cycles":6536064,"thread_start_us":992652,"threads_started":4,"wal-append.queue_time_us":392041}]]}
I20260709 12:58:54.902863  4632 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:54.905601  4746 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:54.916664  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 98065.5us
W20260709 12:58:54.920012  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.929152  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.932849  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1583) took 1453 ms. Trace:
I20260709 12:58:54.933533  1594 rpcz_store.cc:276] 0709 12:58:53.478917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.485472 (+  6555us) service_pool.cc:224] Handling call
0709 12:58:53.485761 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.496008 (+ 10247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:53.727838 (+231830us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.678551 (+950713us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b18002525e0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:54.882706 (+204155us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b18002525e0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a
0709 12:58:54.883246 (+   540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.883372 (+   126us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:54.883517 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.929884 (+ 46367us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.932598 (+  2714us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":414025,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":106,"raft.queue_time_us":17074,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":250,"spinlock_wait_cycles":24582272,"thread_start_us":440160,"threads_started":2,"wal-append.queue_time_us":221155}
I20260709 12:58:54.948228  4632 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.949296  4632 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:54.952096  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.953068  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:54.955750  4611 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:54.956423  4611 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:54.957059  4611 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:54.960806  4643 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:54.945585  1595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.008s
I20260709 12:58:54.976089  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:54.977990  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:54.992587  4685 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.993682  4685 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:54.983247  1595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.008s
I20260709 12:58:55.017300  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.020139  4605 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.026194  4605 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.030105  4605 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:55.034274  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.030879  1500 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.037559  1671 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:55.039721  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56650.3us
W20260709 12:58:55.040764  1566 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.950s (SENT)
I20260709 12:58:55.042872  4613 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:55.048085  4452 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:55.048688  4452 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:55.050544  4632 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:55.050418  4452 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.055296  4452 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:55.058142  4685 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:55.068729  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115917us
I20260709 12:58:55.102344  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.103850  1674 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:55.113436  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1225) took 1005 ms. Trace:
I20260709 12:58:55.114212  1601 rpcz_store.cc:276] 0709 12:58:54.108190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.948003 (+839813us) service_pool.cc:224] Handling call
0709 12:58:54.948735 (+   732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.949209 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.949258 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.950190 (+   932us) log.cc:844] Serialized 26 byte log entry
0709 12:58:55.076726 (+126536us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:55.076787 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.076879 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.113164 (+ 36285us) raft_consensus.cc:1685] finished
0709 12:58:55.113185 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.113355 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124668,"threads_started":1,"wal-append.queue_time_us":156076}
W20260709 12:58:55.118746  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.123118  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:55.125456  4605 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:55.123934  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:55.128487  4681 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:55.129429  4681 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.130328  1500 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.131938  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.132416  1500 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.142158  4637 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:58:55.174165  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.200381  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 165) took 3776 ms. Trace:
I20260709 12:58:55.200793  1670 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:55.200800  4756 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.208s	user 0.007s	sys 0.000s
W20260709 12:58:55.207690  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.225116  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:55.238514  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.245693  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1585) took 1738 ms. Trace:
I20260709 12:58:55.201012  1497 rpcz_store.cc:276] 0709 12:58:51.432880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.440722 (+  7842us) service_pool.cc:224] Handling call
0709 12:58:55.200099 (+3759377us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:53.145003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:53.145614 (+   611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:53.145651 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:58:53.145676 (+    25us) tablet.cc:662] Decoding operations
0709 12:58:53.146855 (+  1179us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:53.146913 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:53.146948 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:58:53.148147 (+  1199us) tablet.cc:701] Row locks acquired
0709 12:58:53.148171 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:58:53.148390 (+   219us) write_op.cc:270] Start()
0709 12:58:53.148542 (+   152us) write_op.cc:276] Timestamp: P: 1783601933148323 usec, L: 0
0709 12:58:53.148562 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:53.249239 (+100677us) log.cc:844] Serialized 4834 byte log entry
0709 12:58:53.909379 (+660140us) op_driver.cc:464] REPLICATION: finished
0709 12:58:54.125596 (+216217us) write_op.cc:301] APPLY: starting
0709 12:58:54.125710 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:54.126123 (+   413us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:54.126267 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:54.263780 (+137513us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:54.264070 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:58:54.264114 (+    44us) write_op.cc:312] APPLY: finished
0709 12:58:54.264459 (+   345us) log.cc:844] Serialized 89 byte log entry
0709 12:58:54.264675 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.272298 (+  7623us) write_op.cc:454] Released schema lock
0709 12:58:54.302334 (+ 30036us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:54.347137 (+ 44803us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.352496 (+  5359us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":756598,"reported_tablets":32,"spinlock_wait_cycles":276736,"child_traces":[["op",{"apply.queue_time_us":215962,"apply.run_cpu_time_us":4730,"apply.run_wall_time_us":201401,"num_ops":12,"prepare.queue_time_us":722,"prepare.run_cpu_time_us":5655,"prepare.run_wall_time_us":131102,"replication_time_us":760684,"thread_start_us":132157,"threads_started":1}]]}
I20260709 12:58:55.259790  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1221) took 1065 ms. Trace:
W20260709 12:58:55.260689  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 78200.4us
I20260709 12:58:55.260376  1598 rpcz_store.cc:276] 0709 12:58:54.106890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.374088 (+267198us) service_pool.cc:224] Handling call
0709 12:58:54.374469 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.379789 (+  5320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.379823 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.383843 (+  4020us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.677230 (+293387us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:58:55.021171 (+343941us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:55.062751 (+ 41580us) log.cc:844] Serialized 14 byte log entry
0709 12:58:55.121796 (+ 59045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.134524 (+ 12728us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.136857 (+  2333us) raft_consensus.cc:1685] finished
0709 12:58:55.146391 (+  9534us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.171995 (+ 25604us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55111,"prepare.queue_time_us":183,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":65259,"raft.run_cpu_time_us":10538,"raft.run_wall_time_us":290247,"spinlock_wait_cycles":4804864,"thread_start_us":482212,"threads_started":1,"wal-append.queue_time_us":514010}
I20260709 12:58:55.264676  4745 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:55.265411  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:55.257782  4746 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:55.260247  1674 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:55.267411  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 144481us
I20260709 12:58:55.169621  4613 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
W20260709 12:58:55.274298  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.249992  1595 rpcz_store.cc:276] 0709 12:58:53.507362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.507489 (+   127us) service_pool.cc:224] Handling call
0709 12:58:53.507858 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.508359 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:53.710162 (+201803us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b18002524c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 12:58:54.369508 (+659346us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b18002524c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf
0709 12:58:54.369698 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 12:58:55.111460 (+741762us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b18002524c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 12:58:55.112175 (+   715us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:55.113022 (+   847us) log.cc:844] Serialized 26 byte log entry
0709 12:58:55.119062 (+  6040us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:55.119108 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.127767 (+  8659us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.211334 (+ 83567us) raft_consensus.cc:1685] finished
0709 12:58:55.211369 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.245574 (+ 34205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36418,"prepare.queue_time_us":406601,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":92049,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":13396,"spinlock_wait_cycles":30463744,"thread_start_us":835414,"threads_started":2,"wal-append.queue_time_us":653695}
I20260709 12:58:55.288215  1674 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:55.289194  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1220) took 1037 ms. Trace:
I20260709 12:58:55.291640  1599 rpcz_store.cc:276] 0709 12:58:54.105830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.351570 (+245740us) service_pool.cc:224] Handling call
0709 12:58:54.352006 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.389637 (+ 37631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.389672 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.390226 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.964004 (+573778us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:54.995423 (+ 31419us) log.cc:844] Serialized 14 byte log entry
0709 12:58:55.084402 (+ 88979us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b1800170440. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:58:55.097964 (+ 13562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.100869 (+  2905us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.100927 (+    58us) raft_consensus.cc:1685] finished
0709 12:58:55.119883 (+ 18956us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.136065 (+ 16182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199,"prepare.queue_time_us":23150,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":21436,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":58673,"spinlock_wait_cycles":10914048,"thread_start_us":519168,"threads_started":2,"wal-append.queue_time_us":497337}
W20260709 12:58:55.329913  1566 leader_election.cc:336] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 3.192s (SENT)
I20260709 12:58:55.334535  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:55.335830  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.318030  4637 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:55.304839  4547 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.154s
I20260709 12:58:55.349983  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:55.350453  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.327690  4689 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.348021  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:55.344105  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.353333  4637 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:55.371662  1752 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:55.369725  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 105855us
I20260709 12:58:55.367792  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:55.363334  4765 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:55.348232  4709 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:58:55.380573  4605 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:55.395651  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.401492  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 84213.5us
W20260709 12:58:55.404474  1566 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 3.350s (SENT)
W20260709 12:58:55.405719  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.406291  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.406658  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.416489  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:55.423239  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.424616  4613 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:55.430145  4637 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:55.420670  4761 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260709 12:58:55.384193  4689 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.439483  4765 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:55.432577  1500 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.447292  4765 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.455622  1746 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:55.456007  4681 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:55.456089  4689 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:55.449498  4765 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:55.460608  4727 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:55.461171  4727 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:55.462329  4727 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:55.472517  4611 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.515s	user 0.015s	sys 0.002s
I20260709 12:58:55.473089  4611 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:55.476791  4727 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:55.485421  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 169924us
W20260709 12:58:55.490041  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.487897  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:55.504043  4689 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:55.503723  1500 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 5 to 3, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:55.507978  1500 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 4 to 5, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.510277  1500 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 4, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.513698  1500 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 5, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.499413  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:55.516492  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:55.517457  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 129866us
I20260709 12:58:55.516947  4611 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:55.521705  1752 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
W20260709 12:58:55.522341  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 79730.4us
I20260709 12:58:55.521881  4745 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:55.536319  1500 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.544126  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:55.548717  4681 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:55.549734  4681 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:55.551716  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.552125  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64360.3us
I20260709 12:58:55.554171  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:55.577046  4765 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.577046  4745 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:55.584652  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:55.585774  4685 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:55.585974  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:55.586431  4685 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:55.587762  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:55.587688  4685 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.589048  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:55.590283  4772 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:55.590626  4767 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:55.591197  4772 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:55.591377  4767 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:58:55.592686  4767 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.592761  4772 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.594370  4613 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:55.595316  4613 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:55.560277  4452 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:58:55.539258  4540 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:58:55.596736  4613 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:58:55.602093  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48040us
I20260709 12:58:55.601029  4643 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:55.617673  4775 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.614319  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:55.623294  1746 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:55.624922  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:55.630184  1599 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:55.631903  1595 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:58:55.632653  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.633471  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.634581  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:55.642850  1595 pending_rounds.cc:85] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
I20260709 12:58:55.551227  4681 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.648248  1595 pending_rounds.cc:107] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:58:55.652082  1595 raft_consensus.cc:2889] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:55.648582  1601 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:55.635203  4765 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:55.664647  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.667500  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.669591  1598 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:55.671941  2310 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:58:55.672667  2312 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:55.646468  4775 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.663501  4689 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:55.676205  4775 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:55.677268  4774 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:58:55.679338  1752 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:55.681989  1750 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:55.686195  4770 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:55.686915  4770 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:55.689939  4770 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:55.691872  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:55.692759  1751 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:58:55.693023  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:55.695350  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.696239  1598 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:55.699054  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:58:55.700477  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 87419.3us
I20260709 12:58:55.704042  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:55.722175  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:55.727030  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:55.732821  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.752046  1744 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:55.753566  1743 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:58:55.761029  1752 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:55.740907  4775 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.768723  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:55.782295  4778 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:58:55.809484  1744 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:55.811453  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:55.815013  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:55.815779  1595 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:55.815943  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.817203  1598 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:55.815788  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:55.820375  1599 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:55.815943  4681 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:55.776578  4685 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:55.771912  4775 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.828506  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:55.829545  1598 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:55.834218  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:55.835425  1597 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:55.861706  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:55.862643  1600 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:55.862684  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:55.863691  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.863811  1670 raft_consensus.cc:2410] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:55.866113  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.866945  1674 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:58:55.875682  4783 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:58:55.876035  4779 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:58:55.857473  4685 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:55.871209  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.880411  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.882138  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.857244  4681 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:55.892257  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:55.901889  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.869874  4709 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.897390  1596 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:55.910979  1670 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:55.922076  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.921185  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:55.916169  4709 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.930840  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.933663  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.935283  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.952742  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.939113  1669 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
W20260709 12:58:55.963402  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 117949us
I20260709 12:58:55.977118  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.982627  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:55.983243  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.985248  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:55.908473  4685 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:55.919200  4681 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:55.990756  4709 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:55.990865  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:55.991490  1603 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:55.992722  4786 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:58:55.999104  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.000262  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.000804  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.007165  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.008584  1600 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:56.014179  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:56.020051  4789 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 12:58:55.988656  1602 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:56.044600  1595 raft_consensus.cc:2410] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:56.048560  1599 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:56.054399  1743 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:56.056769  1747 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:56.061843  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.063328  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:56.065436  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61158.7us
I20260709 12:58:56.063643  1601 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:56.073364  1594 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:58:56.094403  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.082077  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.127909  1603 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:56.127609  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.067281  4775 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:56.097108  1671 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:56.067634  4767 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:56.129853  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.078186  4765 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.131078  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:56.134905  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53591.5us
I20260709 12:58:56.137455  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.134473  1600 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:56.148929  1601 raft_consensus.cc:2410] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:56.150031  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.162530  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.167166  1595 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:56.132406  4685 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:56.163702  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:56.201383  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.202744  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.203601  1752 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:56.142127  4765 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.174988  4775 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.148487  4767 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.174672  4632 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:56.198069  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:56.231794  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:56.238756  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.258301  1745 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.261152  1594 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:58:56.264372  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44376.3us
W20260709 12:58:56.290251  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.295390  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.266266  4796 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.260277  4801 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 12:58:56.312861  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.279131  4792 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:56.317534  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.301092  4767 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:56.326817  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44769us
I20260709 12:58:56.263345  4775 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:56.331341  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:56.270505  4632 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:56.352253  4797 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 12:58:56.355010  4808 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.355923  4808 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:56.358806  4808 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:56.360384  4767 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.360986  4767 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.363181  4767 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:56.363955  4775 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:56.364316  4767 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.364943  4767 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:56.366040  4803 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:58:56.333916  4605 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:58:56.368052  4632 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:56.368626  4605 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:56.369144  4605 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:56.370342  4605 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.373169  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.368780  4632 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.383811  1678 raft_consensus.cc:2368] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:58:56.386106  1745 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:58:56.398428  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.400259  4605 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.400355  4681 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:56.385610  4689 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:58:56.408919  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.409858  1673 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:58:56.412727  1597 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:56.414444  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:56.414611  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.330994  4796 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.417687  4796 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:56.338312  4792 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:56.420027  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.415362  1597 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:56.426946  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.427819  1599 raft_consensus.cc:2376] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10. Re-sending same reply.
I20260709 12:58:56.428959  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:56.428839  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.421103  4775 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:58:56.430526  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:56.431180  1599 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:58:56.432173  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:56.432691  1599 raft_consensus.cc:2376] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10. Re-sending same reply.
W20260709 12:58:56.432873  1598 consensus_meta.cc:287] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.002s
I20260709 12:58:56.433362  4765 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:56.434394  1603 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:56.433310  1598 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:56.438480  4792 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:56.439898  4452 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:56.441072  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.441937  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.450723  1678 raft_consensus.cc:2368] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7.
I20260709 12:58:56.441953  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.442889  4767 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:56.433784  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:56.444877  1598 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:58:56.463936  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 49436.9us
I20260709 12:58:56.465713  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.476440  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.477684  1599 raft_consensus.cc:2376] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6. Re-sending same reply.
I20260709 12:58:56.477871  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.488056  1671 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:56.388551  4632 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.491940  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.448369  4808 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:56.511368  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.495739  4802 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:56.520889  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.521039  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.519647  4802 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.535262  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.536415  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:56.458413  4452 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.542917  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.548202  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.540508  4767 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.540011  4802 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.557536  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.558281  1674 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:58:56.558254  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 118862us
I20260709 12:58:56.546636  2312 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:56.564731  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 67177.9us
I20260709 12:58:56.561848  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.566481  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:56.567121  2314 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:56.567251  2315 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:58:56.575717  4816 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:58:56.609709  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.616242  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.620260  1745 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:56.624223  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.627784  1743 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:56.630311  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.632745  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:56.632809  2279 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.880s (SENT)
I20260709 12:58:56.634339  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:56.643033  1566 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.527s (SENT)
I20260709 12:58:56.622833  4689 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.639840  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:56.639115  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.646863  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:56.657220  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 114542us
I20260709 12:58:56.658033  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:56.663900  1597 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:58:56.670529  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.668527  4765 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:56.676326  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:56.677246  2316 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:56.677763  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.678393  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.678778  4452 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:56.679028  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:56.622458  4767 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.679720  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.680109  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.681491  4767 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:56.682066  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:56.682797  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48712us
I20260709 12:58:56.684151  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.684618  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.686033  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.682888  1671 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:58:56.687482  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.689066  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:56.688628  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:56.691237  2316 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:56.696537  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.668814  4613 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.704470  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.689085  4804 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:56.706286  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.708554  1673 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:56.709046  1673 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:56.710994  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.709941  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:56.713442  4632 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:56.713842  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81091us
I20260709 12:58:56.705300  4613 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:56.718561  4818 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:58:56.718988  4611 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:56.720459  4613 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:56.702775  4800 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:56.668114  4689 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.726677  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.725674  1673 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.730739  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.731173  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.733259  1669 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:58:56.732088  1745 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:58:56.706874  4804 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:56.739571  1673 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:56.740720  1566 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.548s (SENT)
I20260709 12:58:56.741237  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:56.741897  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:56.731142  4540 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:56.742770  1745 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:56.743204  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:56.744863  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.746366  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.746809  4767 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:56.747370  1566 leader_election.cc:336] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.597s (SENT)
I20260709 12:58:56.747968  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:56.749614  1566 leader_election.cc:336] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.610s (SENT)
I20260709 12:58:56.752079  4767 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:56.752703  4796 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:56.753159  4796 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:56.754235  4796 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:56.755363  4689 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:56.764361  4746 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:56.756458  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:56.757510  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:56.761134  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.745280  4804 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:56.770447  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.770553  4804 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.772008  4746 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:56.772679  4746 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:58:56.773741  4746 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:56.775484  4793 consensus_queue.cc:1175] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "693257b3078444e0bd26d3e82159d452" responder_term: 9 status { last_received { term: 7 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:56.783790  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:56.819078  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.787992  1670 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:56.750123  4800 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:56.833647  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44976.6us
W20260709 12:58:56.845789  4814 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.333s	user 0.000s	sys 0.003s
W20260709 12:58:56.846794  1566 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.660s (SENT)
I20260709 12:58:56.832863  4798 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.847923  1566 leader_election.cc:336] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.663s (SENT)
I20260709 12:58:56.847527  4798 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:56.848342  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:56.849676  1566 leader_election.cc:336] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.664s (SENT)
I20260709 12:58:56.850037  4798 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:56.850487  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 93106.7us
I20260709 12:58:56.836957  4796 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:56.854857  4808 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:56.837658  4643 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:56.856211  4643 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:56.857221  4643 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.788084  4767 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:56.851437  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:56.860505  1751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:58:56.862093  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:56.863107  4793 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:56.863902  4793 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:56.864261  4793 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.864575  4793 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.866837  1673 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:56.850080  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:58:56.869076  1566 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.682s (SENT)
I20260709 12:58:56.869598  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.870471  4808 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:56.871470  4808 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:56.872138  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.882373  4802 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.869103  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:56.888875  4775 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:56.901072  1671 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:56.901778  1671 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:56.902253  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.903476  4613 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:56.903959  4613 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:56.901774  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69370730433544db93e2c777aba2b9b2"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:58:56.904477  4613 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:56.904410  4452 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:56.904927  1674 raft_consensus.cc:606] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:58:56.891188  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:56.905337  1674 raft_consensus.cc:614] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:56.905946  4775 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:56.906383  4775 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:56.903997  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.906831  4775 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.902830  1671 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.907588  1671 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.912549  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:56.913559  4794 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:56.914122  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:56.915110  4794 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:56.915696  4794 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:56.916169  4794 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:56.871402  1566 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.744s (SENT)
I20260709 12:58:56.919898  4613 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.838011  1670 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:56.924782  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.906919  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:56.920712  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49345us
I20260709 12:58:56.935745  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:56.941078  1671 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:58:56.942124  1671 pending_rounds.cc:85] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 2
I20260709 12:58:56.942579  1671 pending_rounds.cc:107] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:58:56.943193  1671 raft_consensus.cc:2889] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:56.838824  4800 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:56.934336  1497 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.905365  4802 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:56.955029  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.942641  1670 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:56.966826  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60024.1us
W20260709 12:58:56.967686  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.968016  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.950973  4800 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.970517  4792 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:56.971177  4792 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:56.972033  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:56.972249  4792 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:56.975780  1670 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:56.983103  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.951879  4452 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:56.987504  1566 leader_election.cc:336] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.769s (SENT)
I20260709 12:58:56.994318  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:56.987499  1497 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.992173  4452 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:57.010370  1497 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.021025  1751 raft_consensus.cc:606] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:58:57.021557  1751 raft_consensus.cc:614] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:57.018180  4802 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:57.024837  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 109334us
W20260709 12:58:57.029419  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50963.3us
I20260709 12:58:57.017956  4452 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:57.017035  4765 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:57.032101  1497 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 6 to 7, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:57.040395  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 183) took 3535 ms. Trace:
W20260709 12:58:57.049365  1566 leader_election.cc:336] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.771s (SENT)
I20260709 12:58:57.049835  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.054914  1678 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:57.027383  4802 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.054564  4793 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.059615  4793 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.049177  1497 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:58:57.054296  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86373us
I20260709 12:58:57.061326  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.040807  1500 rpcz_store.cc:276] 0709 12:58:53.505379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.505513 (+   134us) service_pool.cc:224] Handling call
0709 12:58:57.040313 (+3534800us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:55.644627 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:55.645760 (+  1133us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:55.645832 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:58:55.645865 (+    33us) tablet.cc:662] Decoding operations
0709 12:58:55.738587 (+ 92722us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:55.757523 (+ 18936us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:55.761981 (+  4458us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:58:55.820991 (+ 59010us) tablet.cc:701] Row locks acquired
0709 12:58:55.821058 (+    67us) write_op.cc:260] PREPARE: finished
0709 12:58:55.821267 (+   209us) write_op.cc:270] Start()
0709 12:58:55.821450 (+   183us) write_op.cc:276] Timestamp: P: 1783601935821199 usec, L: 0
0709 12:58:55.821478 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:58:55.822416 (+   938us) log.cc:844] Serialized 4727 byte log entry
0709 12:58:56.568889 (+746473us) op_driver.cc:464] REPLICATION: finished
0709 12:58:56.741670 (+172781us) write_op.cc:301] APPLY: starting
0709 12:58:56.743280 (+  1610us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:56.786119 (+ 42839us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:56.786287 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:56.853172 (+ 66885us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:56.853540 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:58:56.853591 (+    51us) write_op.cc:312] APPLY: finished
0709 12:58:56.854060 (+   469us) log.cc:844] Serialized 83 byte log entry
0709 12:58:56.855084 (+  1024us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:56.855249 (+   165us) write_op.cc:454] Released schema lock
0709 12:58:56.855323 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:56.859859 (+  4536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:56.859898 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":161643,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":170261,"apply.run_cpu_time_us":4599,"apply.run_wall_time_us":120371,"num_ops":11,"prepare.queue_time_us":97714,"prepare.run_cpu_time_us":9310,"prepare.run_wall_time_us":203872,"raft.queue_time_us":274425,"raft.run_cpu_time_us":39367,"raft.run_wall_time_us":135513,"replication_time_us":747229,"thread_start_us":343090,"threads_started":4,"wal-append.queue_time_us":37416}]]}
I20260709 12:58:57.060424  4808 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:57.066772  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:57.035511  4775 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.049018  4613 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:57.072431  1715 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.950s (SENT)
I20260709 12:58:57.075070  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:57.092890  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52408.3us
I20260709 12:58:57.095327  4775 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.107949  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:57.108575  4775 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.108757  1678 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.109184  4775 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:58:57.111186  4834 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:58:57.111476  4775 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.116748  1670 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:57.085443  4811 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:57.113190  4835 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:58:57.092609  4613 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:57.121767  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:58:57.126835  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54467.2us
I20260709 12:58:57.091997  4836 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:57.118224  4800 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.132246  4802 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.134059  4800 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.138339  4836 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:57.138994  4836 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:57.139598  1566 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.781s (SENT)
W20260709 12:58:57.140920  1566 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.818s (SENT)
W20260709 12:58:57.141620  1549 auto_rebalancer.cc:893] Removing replace marker failed: Replica fab19506de7242869c29d70c9fffb739 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:58:57.142146  1549 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:58:57.142421  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:58:57.143419  1566 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.969s (SENT)
W20260709 12:58:57.124858  4833 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 12:58:57.153879  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.117233  4794 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.162806  4843 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:57.169425  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:57.171896  4804 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:58:57.181999  1678 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:58:57.169716  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48029.9us
I20260709 12:58:57.158975  4808 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:57.197891  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.200147  1566 leader_election.cc:336] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.996s (SENT)
I20260709 12:58:57.200760  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.202951  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.203709  4808 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:57.187165  4843 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:57.206471  4843 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:57.203119  1566 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.030s (SENT)
I20260709 12:58:57.208240  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.208496  4689 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:57.209273  4808 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:57.209123  4689 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.172478  4613 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:57.212463  4613 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.205101  4836 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.186676  4801 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:57.241384  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.242218  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.230821  4452 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.247047  4836 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:57.229143  4689 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.248515  1669 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:57.238452  4794 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.237905  4837 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:57.275523  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.276809  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76212.1us
I20260709 12:58:57.280503  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:57.299127  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.302886  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.305706  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.307132  1595 raft_consensus.cc:2410] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:57.227501  4843 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.305858  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.308946  1601 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:57.311661  4843 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:57.304085  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.332244  1594 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:58:57.314821  1600 raft_consensus.cc:2410] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:57.315332  1597 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:57.298588  4452 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:57.275722  4837 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:57.335222  4837 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.297549  4792 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:57.327575  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47165.1us
I20260709 12:58:57.333906  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.347574  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:57.348918  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 146048us
I20260709 12:58:57.351603  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.356784  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:57.357002  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.357558  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.357983  1602 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.358461  1601 raft_consensus.cc:2376] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6. Re-sending same reply.
I20260709 12:58:57.387809  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.388844  1597 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:57.387373  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.390098  1603 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.362069  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.387262  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:57.391155  1600 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:58:57.362501  1594 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:57.393695  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:57.400039  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 72369us
I20260709 12:58:57.402315  1594 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.403892  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.404176  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:57.405855  4793 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:57.339166  4848 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:57.406864  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.409144  4849 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
I20260709 12:58:57.410719  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:57.416169  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.424541  1594 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:57.435328  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.437127  1601 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:57.426139  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:57.439410  1594 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 12:58:57.445600  1671 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:57.446666  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.401259  4765 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:58:57.453208  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46207.4us
W20260709 12:58:57.482136  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 71489.7us
I20260709 12:58:57.482687  1600 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:57.453352  1594 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.400797  4808 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:57.456147  1670 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.458181  1672 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:58:57.459429  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.463920  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:57.354928  4792 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:57.467456  4841 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:58:57.489549  1672 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:57.469893  1673 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:57.496480  1673 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:57.470534  4800 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:57.474514  4775 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:57.477085  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:57.483752  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:57.484613  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.508915  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 87) took 1949 ms. Trace:
I20260709 12:58:57.494076  1670 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.445317  4848 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:57.501909  1602 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:58:57.504951  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:57.505805  1673 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.435966  4796 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:58:57.435992  4793 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.516862  1600 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:57.512924  4775 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:57.515487  4827 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:58:57.494537  4808 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:57.527684  4802 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:57.488677  4765 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:57.532475  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44044.4us
I20260709 12:58:57.533542  1669 raft_consensus.cc:3055] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:58:57.534611  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.533869  4848 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.509513  1497 rpcz_store.cc:276] 0709 12:58:55.552747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.552942 (+   195us) service_pool.cc:224] Handling call
0709 12:58:57.501708 (+1948766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:57.162281 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:57.163000 (+   719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:57.163049 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:58:57.163068 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:57.163826 (+   758us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:57.174031 (+ 10205us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:57.182044 (+  8013us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:57.248761 (+ 66717us) tablet.cc:701] Row locks acquired
0709 12:58:57.248780 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:58:57.248965 (+   185us) write_op.cc:270] Start()
0709 12:58:57.249094 (+   129us) write_op.cc:276] Timestamp: P: 1783601937248901 usec, L: 0
0709 12:58:57.249120 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:58:57.249928 (+   808us) log.cc:844] Serialized 2195 byte log entry
0709 12:58:57.350718 (+100790us) op_driver.cc:464] REPLICATION: finished
0709 12:58:57.387404 (+ 36686us) write_op.cc:301] APPLY: starting
0709 12:58:57.400119 (+ 12715us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:57.452118 (+ 51999us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:57.460383 (+  8265us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:57.461256 (+   873us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:57.461523 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:57.461610 (+    87us) write_op.cc:312] APPLY: finished
0709 12:58:57.461987 (+   377us) log.cc:844] Serialized 47 byte log entry
0709 12:58:57.462227 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:57.462396 (+   169us) write_op.cc:454] Released schema lock
0709 12:58:57.462460 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:57.462960 (+   500us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:57.463002 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94269,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":2664,"apply.run_cpu_time_us":3321,"apply.run_wall_time_us":75518,"num_ops":5,"prepare.queue_time_us":43244,"prepare.run_cpu_time_us":5149,"prepare.run_wall_time_us":88035,"replication_time_us":101384,"thread_start_us":42806,"threads_started":1}]]}
I20260709 12:58:57.584383  1669 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:57.542270  4792 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.547564  1596 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:57.550658  4800 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:57.561432  1601 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:57.569183  1594 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:57.606001  1673 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.598680  1669 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:57.612846  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:57.619148  1669 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.583122  4804 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:57.623732  4863 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:57.624387  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 140675us
I20260709 12:58:57.579447  4802 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:57.578454  4794 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:58:57.605729  4857 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:57.612159  4827 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.640834  4862 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:57.644183  4802 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.645565  1673 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:57.650467  1669 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:57.625388  4804 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:57.656101  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45519.1us
I20260709 12:58:57.605948  4847 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:57.632296  1603 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:57.667469  4765 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:57.624392  4800 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.672319  4802 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:57.713056  4846 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:57.713594  4846 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:57.659794  4857 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.694932  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:57.706384  1501 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.676818  4811 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:57.675797  4746 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:58:57.711635  4800 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.720065  1501 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 10, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.673651  4808 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:57.720839  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:57.740913  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 58643.1us
I20260709 12:58:57.743345  1501 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 4 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.728893  4811 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:57.745821  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.746244  4811 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.738263  1600 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:58:57.748144  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.714375  4847 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:57.770248  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.675108  4793 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.775777  1673 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.781412  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:58:57.776914  1501 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.729740  4857 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.670563  4827 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.789542  4827 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.629473  4775 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:57.786444  1501 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.791859  4804 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.792135  1672 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.716632  4796 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:58:57.793226  4804 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:57.793375  1672 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.795450  4811 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.795184  1501 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 7, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.801474  4847 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:57.803398  4836 raft_consensus.cc:2764] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:58:57.807370  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.797102  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:57.820400  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.780500  4794 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.829782  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.831998  1501 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:57.808863  4863 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:58:57.873400  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.905834  1501 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.892103  4863 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.826252  4794 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:57.949020  4837 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.984887  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.984905  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.993927  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.983083  1501 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 10, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:58.007781  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 226423us
I20260709 12:58:58.012172  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:58.017168  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:58.028662  1672 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:58:58.029014  4794 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.029186  1672 pending_rounds.cc:85] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 3
I20260709 12:58:58.029547  1672 pending_rounds.cc:107] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:58:58.029832  1672 raft_consensus.cc:2889] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:58.002076  4837 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:58.033864  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.034225  4837 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.034890  1669 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:58.013833  4847 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.036764  4847 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.039103  4847 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.045949  4857 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:58.082365  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.094197  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 461769us
I20260709 12:58:58.095348  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:58.106472  4857 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.098688  4869 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:58.111765  4869 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:58.118108  4869 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.116004  4802 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.122437  4802 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:58.125694  4802 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:58.194466  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:58:58.196195  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 85767.8us
I20260709 12:58:58.196391  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:58.197151  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:58.198035  1599 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:58:58.198776  1603 raft_consensus.cc:2410] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:58:58.197088  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:58.193706  4802 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.202785  1598 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:58.233503  4843 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.236955  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:58.237658  4847 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:58.238758  4827 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:58.239244  4827 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.239686  4827 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:58.248845  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.199599  4842 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:58:58.251116  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:58.257402  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.264256  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:58.265195  1603 raft_consensus.cc:2376] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10. Re-sending same reply.
I20260709 12:58:58.266870  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:58.267711  1670 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:58.269146  1599 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:58.271016  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:58.276309  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:58.277236  1671 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:58.289707  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:58.297039  1750 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:58:58.276400  4870 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:58:58.226269  4802 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:58.316320  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 55504.6us
I20260709 12:58:58.319319  1748 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:58:58.323881  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.345570  1746 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:58:58.345813  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:58.355469  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.317207  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6339010270000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2699s for a response
I20260709 12:58:58.360345  4842 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:58:58.371390  4869 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.373219  1749 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:58:58.374432  4869 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.375839  4811 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:58.320967  4613 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:58:58.377236  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:58.382297  1745 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:58.361053  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:58:58.388980  1566 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.064s (SENT)
I20260709 12:58:58.389534  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:58.387256  1744 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
W20260709 12:58:58.400676  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 97130.6us
W20260709 12:58:58.428922  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92621.7us
I20260709 12:58:58.430199  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:58:58.408651  4789 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 12:58:58.433874  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:58.434407  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:58.437775  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.377013  4836 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:58:58.384765  4452 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:58:58.456880  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:58.457605  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68668.9us
W20260709 12:58:58.461071  1566 leader_election.cc:336] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.080s (SENT)
I20260709 12:58:58.461578  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:58:58.458433  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.428880  4869 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:58.469221  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:58.455287  4800 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:58.482014  1745 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
W20260709 12:58:58.485569  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.465476  4811 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.465096  4844 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.470250  4866 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:58.517848  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83534.2us
W20260709 12:58:58.515100  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56727.9us
I20260709 12:58:58.520309  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:58.485982  4796 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:58.528505  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67466.1us
I20260709 12:58:58.527101  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:58.529556  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60427us
I20260709 12:58:58.530319  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:58.535266  1566 leader_election.cc:336] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.116s (SENT)
I20260709 12:58:58.535883  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:58.502007  4643 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.519968  4847 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:58.524499  4796 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:58.546144  1566 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.153s (SENT)
I20260709 12:58:58.526445  4842 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:58:58.517307  4811 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.544082  4796 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.562788  4811 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.533881  4880 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:58.563743  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:58.559290  4862 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:58.536531  4883 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:58.547487  4871 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.228s	user 0.000s	sys 0.002s
I20260709 12:58:58.535246  4878 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:58.542102  4800 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:58.548095  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:58.583665  4452 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.585429  4775 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.541055  4643 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.580859  4866 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.547194  4846 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.589406  4869 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:58.595263  4643 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:58.595669  4877 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:58:58.570739  4878 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.596433  4878 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:58.598026  4802 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:58.602816  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.570990  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:58:58.609496  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63405.4us
I20260709 12:58:58.612123  4643 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:58.591918  4866 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:58.614463  4866 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:58:58.614490  4884 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:58:58.590924  4836 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:58.615927  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67923.5us
I20260709 12:58:58.569551  4883 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:58.620786  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:58.623677  1566 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.188s (SENT)
I20260709 12:58:58.640936  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:58.611600  4837 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:58.644057  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:58.645658  1747 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:58.615742  4643 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:58.636612  4866 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.660243  4866 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:58.660961  4890 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 12:58:58.661970  4878 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:58.662597  4866 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:58.664565  1600 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:58.666236  4643 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:58.652009  1746 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:58.648305  4794 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:58.677358  4794 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.677937  4794 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.625080  4836 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.647953  4837 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:58.680130  4837 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:58.681396  4836 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.667150  1599 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:58.667430  4846 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:58.649761  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.188s (SENT) [suppressed 51 similar messages]
I20260709 12:58:58.622589  4883 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.688203  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:58.689368  1750 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:58.691604  1747 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:58.693678  1748 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:58.695959  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:58.696841  1599 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:58.639473  4800 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:58.681918  4878 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.698733  4800 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.700004  4794 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.705519  1603 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:58.708998  4794 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.710443  1746 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:58.705519  1600 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:58:58.714506  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.718647  1599 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:58.721374  4847 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:58.651278  4827 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.733475  4827 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:58:58.740190  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99342.9us
I20260709 12:58:58.741532  1748 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:58.742867  1747 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:58.743598  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:58.745308  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:58.746980  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:58.747299  4796 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.748639  1752 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:58.751614  4796 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.752746  1746 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:58.753867  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.760747  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:58.777953  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:58.763027  4794 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:58.763763  4846 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:58.763486  4827 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:58.762425  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:58.767663  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:58.775669  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:58.776161  1603 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:58.777072  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:58.793527  1747 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:58.786439  4796 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:58.799782  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.802662  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:58.818331  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:58.789705  1599 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:58.820057  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:58.827260  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:58:58.828454  4796 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:58.828776  1746 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:58:58.829559  4796 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.820991  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:58.805039  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:58.795498  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:58.821762  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:58:58.833952  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:58:58.824331  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.825304  1743 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:58.835054  1743 pending_rounds.cc:85] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 4
I20260709 12:58:58.804718  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:58.835654  1743 pending_rounds.cc:107] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:58.835731  1600 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:58.836005  1594 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.789171  4827 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:58.836016  1743 raft_consensus.cc:2889] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:58.839764  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 314436us
I20260709 12:58:58.842624  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:58:58.842729  1746 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:58:58.843429  1746 pending_rounds.cc:85] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 5
I20260709 12:58:58.840546  4827 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:58.843910  1746 pending_rounds.cc:107] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:58:58.846774  1746 raft_consensus.cc:2889] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:58.795413  4844 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:58:58.785269  4794 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:58.846838  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 197068us
I20260709 12:58:58.844362  4811 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:58.851284  4811 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:58.854271  4811 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:58.856173  2313 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:58.856353  1671 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:58.841058  4846 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:58.861707  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:58.840631  4775 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:58.864127  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:58.867758  1675 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:58.867951  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:58:58.860248  1566 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.201s (SENT)
I20260709 12:58:58.870394  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:58.846318  4800 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:58.869271  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:58.872507  1675 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.873760  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:58.858068  4794 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.890337  4857 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.875592  4775 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:58:58.891786  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.892360  4775 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.893875  4827 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.861662  4837 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.897181  1748 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:58:58.879895  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:58.873698  4643 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.899475  4643 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.900220  1745 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:58.891005  4857 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.902745  4857 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.897399  4837 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.905295  4827 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:58.907895  1673 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:58.873117  1641 connection.cc:256] RPC call timeout handler was delayed by -1.3038725419999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 12:58:58.886258  4869 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.874755  4846 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:58.917517  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:58.917725  4846 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.918363  1598 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:58.919739  1670 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:58.920233  1598 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:58.849541  4883 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.922441  4883 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.926920  1594 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:58:58.928704  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.912042  1641 connection.cc:256] RPC call timeout handler was delayed by -1.1832725419999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 12:58:58.930511  1641 connection.cc:256] RPC call timeout handler was delayed by -1.1301725419999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:58:58.930907  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0590725419999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 12:58:58.931201  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0590725419999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 12:58:58.937582  1744 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:58:58.924073  4800 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:58.936069  4869 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:58.925416  4866 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:58.923692  1497 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.939091  1751 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:58:58.947393  1596 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:58:58.943918  1603 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:58.945236  1597 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:58.939253  1601 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:58.944792  4869 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:58.945391  4862 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.959904  4862 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:58:58.963691  1750 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:58:58.966660  1675 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:58:58.975701  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.979409  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 195) took 2988 ms. Trace:
I20260709 12:58:58.982589  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:58.988194  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 138114us
W20260709 12:58:58.989284  1566 leader_election.cc:336] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.213s (SENT)
I20260709 12:58:58.989769  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:58.991961  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:58.998996  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:58.939724  4643 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:59.005605  1603 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:58.981364  1501 rpcz_store.cc:276] 0709 12:58:55.990626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.990860 (+   234us) service_pool.cc:224] Handling call
0709 12:58:58.979315 (+2988455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:58.230768 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:58.231395 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:58.231437 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:58:58.231456 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:58.232606 (+  1150us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:58.232701 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:58.232730 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:58:58.233705 (+   975us) tablet.cc:701] Row locks acquired
0709 12:58:58.233726 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:58:58.233895 (+   169us) write_op.cc:270] Start()
0709 12:58:58.234018 (+   123us) write_op.cc:276] Timestamp: P: 1783601938233848 usec, L: 0
0709 12:58:58.234041 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:58:58.234907 (+   866us) log.cc:844] Serialized 4422 byte log entry
0709 12:58:58.768683 (+533776us) op_driver.cc:464] REPLICATION: finished
0709 12:58:58.894546 (+125863us) write_op.cc:301] APPLY: starting
0709 12:58:58.894650 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:58.894914 (+   264us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:58.895044 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:58.896361 (+  1317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:58.896621 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:58:58.896670 (+    49us) write_op.cc:312] APPLY: finished
0709 12:58:58.897017 (+   347us) log.cc:844] Serialized 83 byte log entry
0709 12:58:58.897214 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:58.897375 (+   161us) write_op.cc:454] Released schema lock
0709 12:58:58.897435 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:58.897885 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:58.897920 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11203,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":98351,"apply.run_cpu_time_us":3315,"apply.run_wall_time_us":3316,"num_ops":11,"prepare.queue_time_us":129834,"prepare.run_cpu_time_us":4490,"prepare.run_wall_time_us":4489,"replication_time_us":534461,"thread_start_us":177111,"threads_started":2}]]}
I20260709 12:58:59.002990  4801 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:59.003264  4857 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:59.032080  4847 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:58:59.000883  4827 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:59.087996  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83529.2us
I20260709 12:58:59.090550  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:58:59.124254  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 135002us
W20260709 12:58:59.125033  1566 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.223s (SENT)
I20260709 12:58:58.942078  4800 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.128021  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:58:59.111822  4801 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.103503  4775 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:58:59.109673  4796 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.119665  4827 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.148267  4866 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:59.151121  4862 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.110337  4643 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.176751  4643 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.155841  4844 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:59.119354  4869 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:58:59.159056  1566 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.662s (SENT)
W20260709 12:58:59.160171  4899 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:58:59.166138  4775 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.170619  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:59.174227  4613 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:59.144796  4801 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.179719  1603 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 12:58:59.119714  4837 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:58:59.229552  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:58:59.173197  4827 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:59.121853  4794 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:59.254817  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.230611  4866 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.263062  1603 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:59.225865  4883 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:59.230298  4844 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.269963  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.296260  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.171085  4796 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:59.271588  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 101068us
I20260709 12:58:59.235951  4869 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.226384  4836 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
W20260709 12:58:59.271011  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 180540us
I20260709 12:58:59.260615  4842 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:59.316663  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:59.269896  4847 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.317102  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.267738  4857 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:59.316378  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.763s (SENT)
I20260709 12:58:59.318733  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:58:59.328701  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:59.331616  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:59.305691  4844 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:59.366600  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 218741us
I20260709 12:58:59.368270  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:59.381136  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:59.386058  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:59.385422  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:59.326151  4881 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:59.344990  4847 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:58:59.412232  4903 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:58:59.412485  4847 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:59.423713  4836 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:59.424348  4836 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:59.425068  4869 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:59.426937  4775 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.427675  4908 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:59.427875  4862 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:59.428305  4908 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.430636  4908 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:59.343875  4907 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:58:59.432312  4907 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:59.432683  4907 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:59.433478  4842 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:59.433579  4907 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.434931  4907 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.441576  4796 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.446050  4613 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:59.446571  4613 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:59.381587  4802 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:59.470697  4802 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:59.496699  4866 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:59.493184  4613 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.508464  4794 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.510355  4802 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:58:59.503060  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 134917us
W20260709 12:58:59.532295  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 146699us
W20260709 12:58:59.546938  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.558521  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:59.583248  4613 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:59.540573  4836 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:59.596257  4836 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:59.536230  4883 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:59.597581  4883 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:58:59.558060  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 239442us
W20260709 12:58:59.599699  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 65339us
I20260709 12:58:59.531704  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 88) took 1869 ms. Trace:
I20260709 12:58:59.600678  1497 rpcz_store.cc:276] 0709 12:58:57.662611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.662827 (+   216us) service_pool.cc:224] Handling call
0709 12:58:59.531619 (+1868792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:59.152151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:59.152841 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:59.152885 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:58:59.152910 (+    25us) tablet.cc:662] Decoding operations
0709 12:58:59.153297 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:59.153362 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:59.153391 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:59.153609 (+   218us) tablet.cc:701] Row locks acquired
0709 12:58:59.153623 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:58:59.153827 (+   204us) write_op.cc:270] Start()
0709 12:58:59.153961 (+   134us) write_op.cc:276] Timestamp: P: 1783601939153750 usec, L: 0
0709 12:58:59.153987 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:58:59.154798 (+   811us) log.cc:844] Serialized 536 byte log entry
0709 12:58:59.381426 (+226628us) op_driver.cc:464] REPLICATION: finished
0709 12:58:59.431222 (+ 49796us) write_op.cc:301] APPLY: starting
0709 12:58:59.431334 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:59.431447 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:59.431564 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:59.431776 (+   212us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:59.431955 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:59.431997 (+    42us) write_op.cc:312] APPLY: finished
0709 12:58:59.432190 (+   193us) log.cc:844] Serialized 23 byte log entry
0709 12:58:59.432396 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:59.432495 (+    99us) write_op.cc:454] Released schema lock
0709 12:58:59.432539 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:59.432950 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:59.432982 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16840,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":8401,"apply.run_cpu_time_us":1681,"apply.run_wall_time_us":1682,"num_ops":1,"prepare.queue_time_us":150954,"prepare.run_cpu_time_us":3036,"prepare.run_wall_time_us":4630,"replication_time_us":171528,"thread_start_us":109651,"threads_started":1}]]}
I20260709 12:58:59.600672  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:58:59.585157  1500 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:59.608835  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:58:59.609771  1672 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:59.612896  1594 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:59.615125  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.618742  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.621701  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.623365  1500 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:58:59.624116  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.626524  1599 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:58:59.630010  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:58:59.630789  2313 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:58:59.627007  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:59.635478  1500 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.611860  4916 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:58:59.640223  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.641388  1594 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:59.639227  1500 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 4 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.640201  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:59.643435  1594 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:59.643815  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.645469  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:58:59.645442  1500 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:58:59.647964  1672 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:59.647434  1500 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 6 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.648353  1672 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:59.649528  1672 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.650573  1672 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.607975  4857 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:59.641003  4916 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:59.652901  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.523051  4827 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.656145  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.656937  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.546300  4801 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:59.660460  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.661742  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.663349  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.665299  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.672267  1596 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:59.672937  1594 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:58:59.675138  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.700651  1603 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:59.703491  1595 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:59.702904  1601 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:59.705127  1602 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:59.617583  4924 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:59.709872  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.712046  1672 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:59.716756  4801 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:59.718304  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:58:59.718791  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46325.1us
I20260709 12:58:59.720342  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:59.721899  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 100453us
I20260709 12:58:59.723363  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:58:59.634865  4917 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:59.724457  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:59.726734  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:59.727026  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.727392  1672 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.727900  1594 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:58:59.730532  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.670535  4857 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.733258  1594 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:59.734786  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:58:59.735402  2313 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.739280  1672 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:59.740269  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.742054  1595 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:58:59.742996  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:58:59.743927  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.744105  1601 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
W20260709 12:58:59.758845  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.742084  4857 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:59.741580  4800 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:59.732126  4917 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.780640  4917 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:59.630782  4883 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:59.786983  4857 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:59.789502  4907 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:59.638679  4844 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.794831  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.781982  4796 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:59.831580  4796 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:59.832019  4796 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:58:59.832906  4796 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.708334  4908 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:58:59.834554  4908 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:58:59.796234  1678 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:59.835274  4857 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:59.835708  1678 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:59.836611  1678 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.837635  1678 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.837641  1598 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:58:59.802165  4916 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:58:59.802829  4924 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.839248  4917 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.839936  4924 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.842543  4924 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:58:59.806980  4827 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.779865  4800 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.843338  4800 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.794888  1672 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:59.817672  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.844554  4917 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:58:59.818866  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.819295  4913 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:59.844648  1672 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:59.847865  1672 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.848888  1672 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:59.859836  1675 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:59.860339  1675 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:58:59.861219  1675 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.862447  1675 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:59.868146  4844 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:58:59.734354  4802 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:59.826356  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:58:59.876598  1670 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:59.829406  1602 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:59.887431  1670 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:58:59.911319  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:58:59.919746  4802 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:58:59.951028  4802 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:58:59.954157  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:58:59.955739  1596 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:58:59.955822  1599 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:59.956765  1678 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:58:59.957772  1678 pending_rounds.cc:85] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 5
I20260709 12:58:59.958232  1678 pending_rounds.cc:107] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:58:59.956800  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.958791  1678 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:59.963387  1672 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:59.963462  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.966882  1602 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.972517  1599 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:59.940513  1675 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:59.984345  4883 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:59.992110  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.993247  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:00.085037  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:00.015496  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.085897  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:00.061450  1598 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:59.993724  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:00.058956  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 65812.4us
W20260709 12:59:00.086843  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.994423  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:58:59.971211  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:58:59.994083  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:00.089394  1603 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:00.089670  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 118547us
I20260709 12:59:00.092525  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.093374  1678 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
W20260709 12:58:59.966774  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69297us
I20260709 12:58:59.998754  1602 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:59:00.005720  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.086187  1670 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:59:00.095198  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.089847  1594 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:00.083125  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:00.098526  1749 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:00.071527  4913 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:58:59.961256  4796 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:59.971104  4802 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.058126  4848 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.100461  4907 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:00.129034  1603 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:00.135021  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.137255  1747 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:00.135175  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.097656  4908 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:00.139724  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.121306  4924 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.143668  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.143918  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.144246  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.144685  1747 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:00.144982  1748 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:00.146559  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.146667  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.147372  1751 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:00.148505  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.130162  4879 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.153544  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.138861  4800 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:00.156667  1744 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:00.157895  4800 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:00.071213  4875 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:59:00.137358  4802 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.151124  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:00.169440  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.134917  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.180030  1748 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:00.146124  4907 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:00.186877  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:00.188758  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 96605.5us
I20260709 12:59:00.301029  4907 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.303329  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.303968  4643 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:00.305328  4796 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:00.305994  4643 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:00.308151  4827 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:00.308719  4827 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:00.309216  4827 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:00.150940  4924 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.314648  4924 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:00.203666  4931 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:59:00.192618  4800 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:00.239820  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.317334  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.316691  4800 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:00.176668  4879 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:00.319060  4800 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:00.320920  4879 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:00.321130  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 232337us
I20260709 12:59:00.330489  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:00.330710  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 202479us
I20260709 12:59:00.332291  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.186122  4802 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.140117  4848 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.278954  4844 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.348776  4844 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.349893  4827 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.351725  4801 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.352458  4844 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.352329  4801 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.355939  4827 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.357821  4802 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.360396  4848 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:00.333676  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4946819720000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 12:59:00.361733  1566 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.699s (SENT)
I20260709 12:59:00.362347  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:00.363571  4924 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:00.365063  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4108407399999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28690000000000004s for a response
I20260709 12:59:00.370141  4895 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.356798  4801 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.433768  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:00.423859  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3190407399999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29710000000000003s for a response
I20260709 12:59:00.435444  1749 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:59:00.438354  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1408407399999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3169s for a response
W20260709 12:59:00.439879  1566 connection.cc:256] RPC call timeout handler was delayed by -1.128240739999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3183s for a response
W20260709 12:59:00.441025  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1111407399999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32020000000000004s for a response
I20260709 12:59:00.441789  1748 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:00.453027  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:00.454172  1603 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:00.459514  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:00.462250  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:00.475273  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 172031us
I20260709 12:59:00.449169  4908 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:00.495850  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.481632  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:00.481559  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:00.490062  1678 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:00.496861  2313 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:00.497025  1678 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.437690  4895 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:00.507354  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:00.475430  4770 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:00.510293  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:00.559796  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.568787  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.585116  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 479274us
I20260709 12:59:00.513499  1678 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.506212  4908 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:00.617713  1675 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:59:00.623214  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 163812us
I20260709 12:59:00.624215  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:00.625522  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.626964  1678 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:00.593036  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:00.631608  4802 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:00.632408  4908 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:00.633450  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:00.652267  4924 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:00.653012  4924 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.656790  4895 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.660835  4924 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:00.661623  4924 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:00.662153  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.662344  4924 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:00.662751  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.663232  4924 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:00.663570  4942 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:59:00.664321  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.664947  1674 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:00.662384  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:00.666231  1671 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:00.668744  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.662845  1677 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:00.663937  4924 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.671815  4836 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:00.672916  4836 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:00.673619  4924 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:00.673789  4836 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:00.674435  1678 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:59:00.675526  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51393.1us
I20260709 12:59:00.676445  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:00.676682  1671 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:00.676779  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:00.681514  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.636631  2312 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:00.697309  2316 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:00.700903  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:00.703712  4924 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:00.635588  4801 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:59:00.706802  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:00.706513  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.705681  4919 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:00.708890  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.684573  4908 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:00.708460  4919 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.697470  4837 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:00.697715  4913 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:00.710426  4942 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:00.684459  4842 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:59:00.715246  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81930.3us
I20260709 12:59:00.679945  4836 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:00.732908  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:00.715407  4800 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.713783  4802 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:00.721433  4919 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:00.715829  4950 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:00.711063  4883 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:59:00.720013  4917 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:00.742174  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:00.715710  4837 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:00.744107  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 103039us
I20260709 12:59:00.726027  4913 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.722481  4924 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:59:00.749730  4947 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.748510  4848 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:00.746716  4800 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:00.753825  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44314.7us
I20260709 12:59:00.733323  4952 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:00.765990  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:00.770727  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.779680  1671 raft_consensus.cc:2410] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:59:00.760324  4942 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:59:00.773089  2316 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:00.728729  4908 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:59:00.777172  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:00.772950  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48497.8us
I20260709 12:59:00.784799  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:00.772091  4802 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:00.786983  4907 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:00.790643  4943 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:00.776402  4848 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.773878  4917 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.797405  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.800025  4952 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:00.803622  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.806870  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.807415  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:00.807698  1671 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:00.807721  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.795222  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.808207  1678 raft_consensus.cc:2368] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
W20260709 12:59:00.809080  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.800011  4943 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.802547  4848 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.804389  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:00.811480  1677 raft_consensus.cc:2368] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:00.797230  4801 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:00.814649  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.815450  1678 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:00.815919  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.815997  4844 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:00.814246  4801 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:00.816840  4801 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.813191  4942 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:00.818313  4942 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.816812  4844 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:00.819427  4942 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.821111  4844 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.822842  4917 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.824716  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.825202  4800 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.828028  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.828379  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.829959  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.812738  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.776247  4947 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.803896  4613 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:00.832418  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:00.832203  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.800596  4951 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:00.805850  4836 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:00.804183  4907 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:59:00.841209  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.832963  4924 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:00.844560  4924 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:00.845048  4924 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:00.844405  4947 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.837150  4943 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.846745  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.795065  4913 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.848068  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.849436  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:00.850828  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.843104  4827 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:00.848177  4913 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:00.837152  4950 raft_consensus.cc:2764] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:00.842037  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:00.856806  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:00.851163  2312 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:00.836073  4961 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:00.860550  4961 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:00.861533  4961 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.857726  1677 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:00.859925  4947 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:00.838141  4613 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.866864  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:00.874073  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:00.917541  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59101.6us
I20260709 12:59:00.871685  4936 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.906774  4801 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.932113  4936 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:00.934019  4801 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.854768  4836 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:00.934621  4936 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:00.934722  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.936128  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.937407  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.935464  4836 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.938603  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.811707  4837 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.902587  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.908953  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:00.911296  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:00.912853  1597 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:00.969098  1751 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:00.913749  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:00.914865  1594 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:00.915467  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:00.918623  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:00.921371  4963 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:00.921618  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 85178.3us
I20260709 12:59:00.976732  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.978538  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.925108  2314 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:00.925951  4827 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.981664  4908 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:00.982136  4908 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.981899  4827 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.982524  4908 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.983778  4951 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:00.984264  4951 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:00.984411  4827 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:00.984716  4951 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.925755  4800 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:00.928313  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:00.928112  4613 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.927932  4947 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:00.994927  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:00.986152  4924 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:00.941217  4959 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:59:00.879118  4907 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:59:00.946156  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.957836  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:00.959167  4842 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:01.019670  1677 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:00.964926  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:01.019629  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 53046.6us
I20260709 12:59:01.021476  1602 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:00.965546  1745 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:00.965809  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:00.980813  1752 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:00.983428  4848 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:00.989177  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:00.929848  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:00.990294  1743 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:00.990540  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:00.885936  4943 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:01.001262  4961 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:01.005976  4954 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.193s	user 0.004s	sys 0.001s
W20260709 12:59:01.010193  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.993793  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:01.001798  2312 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:01.025393  1678 raft_consensus.cc:2368] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
W20260709 12:59:01.025826  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 96056us
I20260709 12:59:00.941273  4919 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.031620  1747 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:01.201853  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.185393  4951 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:01.202371  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:01.202831  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.032454  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:01.031033  1749 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:01.032323  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:01.057457  1748 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:01.112372  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:01.207950  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:01.208729  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.209663  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:01.208729  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.213608  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:01.188306  1674 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
W20260709 12:59:01.227334  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:01.230293  4966 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:59:01.240499  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:01.200536  4837 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.241441  1672 raft_consensus.cc:606] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.245868  1672 raft_consensus.cc:614] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:01.019819  4842 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:01.252556  1676 raft_consensus.cc:2368] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
W20260709 12:59:01.252910  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.003149  4963 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:01.037218  4800 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:01.255471  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.255731  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.053957  4961 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.237869  4643 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:01.301362  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:01.305516  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.273483  4924 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.275314  4913 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:01.311174  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82681us
I20260709 12:59:01.279950  4844 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.313020  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:01.299340  4800 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:01.304391  4951 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.277911  4883 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:01.282577  4936 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:59:01.279670  4836 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:59:01.303210  4613 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:01.380625  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:01.318511  4848 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:01.317524  4924 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:01.366004  4827 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:01.377183  4613 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:01.341348  4844 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:01.440878  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 121639us
I20260709 12:59:01.415570  4951 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:01.320307  4842 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.428015  4827 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.433961  4924 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.430853  4977 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:01.466892  4977 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.467293  4977 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.468087  4924 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.440393  4643 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:01.442619  4613 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:01.514995  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 172888us
I20260709 12:59:01.475301  4827 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.465766  4919 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.501073  4643 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.521708  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.495955  4913 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:01.533126  4961 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.534195  4936 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:01.535702  4936 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:01.536084  4936 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:01.536976  4936 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.464989  4951 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.510253  4842 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:01.552270  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 171773us
W20260709 12:59:01.538316  4908 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.001s
I20260709 12:59:01.525871  4643 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.553978  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:01.474951  4800 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:01.576637  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 582822us
I20260709 12:59:01.538712  4913 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.558292  4936 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:01.555338  4963 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:01.551455  4836 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:59:01.553514  4883 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:59:01.606684  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.556911  4908 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:01.606765  4943 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.618641  4977 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.626092  4951 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.585717  4974 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:01.582998  4982 raft_consensus.cc:2764] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:01.633836  1670 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:59:01.634203  4996 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:01.583909  4981 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:59:01.663565  1752 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:59:01.637567  4976 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:59:01.664415  4844 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:01.589639  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:01.681196  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91597.6us
I20260709 12:59:01.689075  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:01.671897  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 117992us
I20260709 12:59:01.664985  4908 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:01.707329  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:01.708369  1747 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:01.711372  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:01.712479  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6679982729999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:59:01.712940  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5392982729999289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 12:59:01.713009  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:01.713472  1566 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.541s (SENT)
I20260709 12:59:01.713755  1748 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:01.714175  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5365982729999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 12:59:01.714715  1566 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.731s (SENT)
I20260709 12:59:01.715106  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.722849  1751 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:01.714918  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:01.724568  1747 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:01.726181  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:01.727017  1748 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:01.732949  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:01.736536  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 175009us
I20260709 12:59:01.737437  1744 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:01.740679  1750 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:01.742843  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:01.743734  2316 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 12:59:01.745921  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.717931  4951 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:01.668718  4943 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.757341  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:01.763780  1744 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:01.751153  4908 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:01.767347  4943 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.761848  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:01.728030  4996 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:01.770933  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:01.768900  2313 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 6: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:01.676024  4974 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:01.779683  4974 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:01.780321  4977 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.781886  4643 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.770462  4951 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:01.783914  1746 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
W20260709 12:59:01.785132  4980 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.361s	user 0.002s	sys 0.002s
I20260709 12:59:01.784845  4951 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.788215  4996 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.791222  4913 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:01.803740  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71770us
I20260709 12:59:01.814589  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:01.832433  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 61677.4us
I20260709 12:59:01.835310  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:01.836144  1602 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:01.845584  4643 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:01.820636  4613 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.817421  4827 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:01.850644  4613 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:01.854692  4827 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:01.858908  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:01.859566  1675 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:01.861510  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:01.862931  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:01.864110  1674 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:01.865226  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:01.876507  1750 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:01.881368  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 132852us
W20260709 12:59:01.882333  1566 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.839s (SENT)
I20260709 12:59:01.882702  1744 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:01.882789  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.899879  4908 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:01.899693  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:01.901355  2313 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
W20260709 12:59:01.911520  1566 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.897s (SENT)
I20260709 12:59:01.916638  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:01.917506  1602 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:01.924104  1750 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:01.927838  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:01.928660  1750 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:01.929534  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1755) took 1060 ms. Trace:
I20260709 12:59:01.937986  1594 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:01.930079  1676 rpcz_store.cc:276] 0709 12:59:00.846225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.846430 (+   205us) service_pool.cc:224] Handling call
0709 12:59:01.906681 (+1060251us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540036f6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:01.906891 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911655296}
I20260709 12:59:01.940956  1600 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:01.942865  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:01.943609  1594 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.945997  1603 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:01.947731  1602 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:59:01.955576  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47680.3us
W20260709 12:59:01.956831  1566 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.933s (SENT)
I20260709 12:59:01.957310  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:01.978497  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4951982729999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 12:59:01.979081  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0451982729999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2676s for a response
I20260709 12:59:01.979686  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:01.983333  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.984680  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:01.985282  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.985562  1674 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.990401  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:01.948091  4977 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:01.997537  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:01.998471  1676 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.001983  1603 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:01.992563  1747 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:01.978269  4974 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:01.992344  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:01.982703  4908 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:01.991361  4950 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:01.988766  4961 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:02.027915  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.000089  4924 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:02.014595  4965 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:02.005431  4977 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:02.035100  4924 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:01.994226  4963 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:02.036413  4963 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.036890  4963 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:02.036309  4924 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:01.992146  4801 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.021188  1595 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:02.022758  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1627) took 1004 ms. Trace:
I20260709 12:59:02.026470  1745 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:59:02.013346  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.030007  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.032769  1672 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:02.039038  1749 rpcz_store.cc:276] 0709 12:59:01.018401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.205163 (+186762us) service_pool.cc:224] Handling call
0709 12:59:01.661236 (+456073us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:59:01.661483 (+   247us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:01.666207 (+  4724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.666241 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:01.671613 (+  5372us) log.cc:844] Serialized 52 byte log entry
0709 12:59:01.758852 (+ 87239us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:01.758896 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.758966 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:02.012591 (+253625us) raft_consensus.cc:1685] finished
0709 12:59:02.012647 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.022669 (+ 10022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4225,"raft.queue_time_us":4511,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":59650,"spinlock_wait_cycles":12992768,"thread_start_us":55726,"threads_started":1,"wal-append.queue_time_us":122534}
I20260709 12:59:02.064278  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1623) took 1067 ms. Trace:
I20260709 12:59:02.038060  4961 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.028398  4908 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.087901  1598 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:02.088234  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 89) took 2446 ms. Trace:
I20260709 12:59:02.088686  1497 rpcz_store.cc:276] 0709 12:58:59.641383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.702749 (+ 61366us) service_pool.cc:224] Handling call
0709 12:58:59.800210 (+ 97461us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:59:02.088162 (+2287952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411431,"reported_tablets":1,"spinlock_wait_cycles":23429888}
I20260709 12:59:02.064877  1745 rpcz_store.cc:276] 0709 12:59:00.997316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.038259 (+ 40943us) service_pool.cc:224] Handling call
0709 12:59:02.025958 (+987699us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:59:02.026172 (+   214us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:02.040065 (+ 13893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.064176 (+ 24111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16356736}
I20260709 12:59:02.004611  4996 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:02.117995  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:02.122887  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.119961  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.123977  1599 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:02.126186  1674 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:02.134262  1601 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:02.135735  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.137588  4977 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:02.129817  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:02.130975  1745 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:02.131064  1747 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:02.141368  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.146476  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.146453  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.150519  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.150775  1749 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:59:02.161573  4973 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.789s	user 0.006s	sys 0.000s
I20260709 12:59:02.161849  1594 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:02.149602  1601 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:59:02.163972  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 184402us
I20260709 12:59:02.164052  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.164342  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:02.164517  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.150285  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.168669  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.170332  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.172207  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.172996  1677 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:02.173969  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 1750) took 1349 ms. Trace:
I20260709 12:59:02.184195  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.190457  1750 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:02.174329  1671 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:02.193758  1671 pending_rounds.cc:85] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 5
I20260709 12:59:02.194132  1671 pending_rounds.cc:107] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:02.194474  1671 raft_consensus.cc:2889] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:02.142658  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.175271  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.196957  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.175496  4961 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:02.146374  4936 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:02.171172  1672 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:02.180063  4908 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:02.191290  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.191212  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:02.192327  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:02.162703  4965 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.198177  1601 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:02.199755  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.201625  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.208060  1672 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:02.208391  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.208998  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:02.184619  1670 rpcz_store.cc:276] 0709 12:59:00.824264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.824424 (+   160us) service_pool.cc:224] Handling call
0709 12:59:02.173746 (+1349322us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540036ecd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:02.173907 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858209536}
I20260709 12:59:02.202826  1673 raft_consensus.cc:2368] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:02.140182  4613 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:59:02.216348  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:02.210103  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.174117  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:02.306906  4998 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:02.308949  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.203725  4936 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.310261  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:02.310766  1601 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:02.334956  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.336019  1601 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:02.307561  4984 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.300053  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.331190  1672 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:02.307245  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:02.331379  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 157314us
I20260709 12:59:02.346127  1670 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:02.346244  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:02.348671  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:02.349431  1677 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:02.350683  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:02.352389  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.356189  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.356225  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.357057  1670 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
W20260709 12:59:02.364567  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 54401.1us
I20260709 12:59:02.366017  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.337268  4936 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:02.377053  1678 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:02.380765  1673 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:02.384140  1675 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:02.357249  4996 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:02.350518  4800 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.380766  4961 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.399972  1601 raft_consensus.cc:2410] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:02.383388  4907 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:02.429188  4961 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.435637  4800 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:02.436698  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:02.437572  1597 raft_consensus.cc:2410] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:59:02.438416  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:02.403070  4996 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:02.441010  4996 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.441462  4936 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:02.443858  4936 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:02.447158  4848 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:02.455828  4995 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:02.459462  1674 raft_consensus.cc:2368] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:02.460260  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:02.461961  1676 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:02.464401  1597 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:02.465824  1597 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:02.466387  1597 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:02.467952  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.472824  1678 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:02.478430  4997 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.482203  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.467684  1597 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.493079  1597 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.494613  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:02.505561  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.468708  4613 raft_consensus.cc:2764] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:02.479040  4997 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.205689  5018 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.297s
I20260709 12:59:02.335734  4998 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.569469  4998 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:02.486397  4952 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:02.574216  5021 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:59:02.354815  4984 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:02.585866  4961 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:02.588035  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.600486  4842 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:02.601187  4842 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:02.487196  4800 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:02.309854  4965 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.547624  4907 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:02.559463  1597 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:02.469072  4844 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:59:02.603499  4997 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:02.637040  4997 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.637665  4997 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.604100  4800 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:02.641618  4800 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.614171  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1624) took 1610 ms. Trace:
I20260709 12:59:02.644328  1743 rpcz_store.cc:276] 0709 12:59:01.003922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.025518 (+ 21596us) service_pool.cc:224] Handling call
0709 12:59:01.798341 (+772823us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:59:01.798591 (+   250us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:01.816638 (+ 18047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.816671 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:01.817337 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 12:59:01.913068 (+ 95731us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:01.984504 (+ 71436us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.992305 (+  7801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.992455 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:02.053327 (+ 60872us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b1800327fa0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:02.580755 (+527428us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b1800327fa0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:02.613779 (+ 33024us) raft_consensus.cc:1685] finished
0709 12:59:02.613815 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.614035 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24520,"prepare.queue_time_us":59264,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":27957,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":9250,"spinlock_wait_cycles":20880256,"thread_start_us":95244,"threads_started":1,"wal-append.queue_time_us":186080}
W20260709 12:59:02.620451  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 125962us
I20260709 12:59:02.608561  1597 pending_rounds.cc:85] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
I20260709 12:59:02.656852  1597 pending_rounds.cc:107] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:02.657159  1597 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:02.628046  1677 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:59:02.664798  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 159331us
I20260709 12:59:02.665987  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.699174  4801 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:02.700053  4908 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:02.700204  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:02.700466  4801 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:02.700836  4801 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:02.701524  4961 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.701761  4801 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.703171  4801 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:02.608669  4907 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.707463  4907 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:02.707607  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.720378  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:02.721282  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 355751us
I20260709 12:59:02.620728  4827 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:02.613444  4965 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:02.730741  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.742781  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.651749  4842 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:02.744545  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:02.745968  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:02.711877  4908 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.747388  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:02.762831  4998 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.768325  4997 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:02.768587  4998 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:02.769114  4984 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:02.770004  4908 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.770526  4908 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.764501  4936 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:59:02.748039  4827 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:02.777582  4827 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.763299  4952 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:02.741590  4917 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:59:02.783592  4919 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:02.744313  4965 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:02.772650  4908 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:02.769176  4998 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:02.790647  4848 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:02.825150  2313 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:02.817198  4963 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.780s	user 0.015s	sys 0.000s
I20260709 12:59:02.809676  4842 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.843437  4998 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.814661  4961 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:02.853545  4613 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:02.854095  4613 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:02.858059  4994 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.871774  1670 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 12:59:02.880096  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.883946  1670 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:02.858927  4994 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.896965  4996 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.898598  4994 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:02.886016  5021 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:02.854959  4613 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:02.905110  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 1760) took 2000 ms. Trace:
I20260709 12:59:02.899344  4996 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:02.905772  1671 rpcz_store.cc:276] 0709 12:59:00.901709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.901964 (+   255us) service_pool.cc:224] Handling call
0709 12:59:02.173889 (+1271925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.201787 (+ 27898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.901896 (+700109us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540036ecd0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:02.902071 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923785984}
I20260709 12:59:02.911064  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.837649  4848 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:02.874574  4963 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:02.965265  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 268157us
I20260709 12:59:02.970882  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:02.971668  1674 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:02.981170  1595 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:02.975440  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 210741us
I20260709 12:59:02.983333  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:02.998106  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 255367us
I20260709 12:59:02.999675  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:02.981431  4986 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:03.061977  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.101790  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 356694us
W20260709 12:59:03.102861  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.065s (SENT)
I20260709 12:59:03.103375  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:03.117174  1566 leader_election.cc:400] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
W20260709 12:59:03.118124  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 102221us
W20260709 12:59:03.121902  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.122807  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:03.125939  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.136731  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:03.138053  1673 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:03.079434  4924 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.016597  4919 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:03.150121  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.155705  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1325) took 1125 ms. Trace:
I20260709 12:59:03.156234  1595 rpcz_store.cc:276] 0709 12:59:02.123427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.141046 (+ 17619us) service_pool.cc:224] Handling call
0709 12:59:03.155437 (+1014391us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54001b3d54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:03.155625 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902658944}
I20260709 12:59:03.160252  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:03.134886  5000 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.133551  4977 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:03.191793  2281 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.054s	sys 0.117s
W20260709 12:59:03.201047  2281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.054s	sys 0.117s
I20260709 12:59:03.168033  4924 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.120635  4986 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:03.204980  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:03.174507  4953 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.211933  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:03.211961  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.216318  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 220896us
I20260709 12:59:03.226722  5030 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:03.226958  1566 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.676s (SENT)
I20260709 12:59:03.228569  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.232610  5039 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.233412  4613 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:03.234210  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.236007  4965 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.236523  4965 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.238739  4917 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:03.239357  4917 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:03.215281  4940 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:03.241876  4917 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.242367  4924 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:03.244069  4924 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.245127  4924 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:03.213135  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:03.238886  4965 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.248178  4965 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:03.248584  4965 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:03.249776  1715 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.186s (SENT)
I20260709 12:59:03.250267  4917 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:03.249428  4965 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.252178  4965 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.252344  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1337) took 1091 ms. Trace:
W20260709 12:59:03.252521  5027 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:59:03.252805  1601 rpcz_store.cc:276] 0709 12:59:02.160862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.463128 (+302266us) service_pool.cc:224] Handling call
0709 12:59:02.463639 (+   511us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:02.464871 (+  1232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:02.479988 (+ 15117us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.929626 (+449638us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:02.947529 (+ 17903us) log.cc:844] Serialized 52 byte log entry
0709 12:59:02.947781 (+   252us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:03.251386 (+303605us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b1800319a20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 12:59:03.251662 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.251914 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.251996 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.252101 (+   105us) raft_consensus.cc:1685] finished
0709 12:59:03.252118 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.252280 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133350,"prepare.queue_time_us":1803,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3166,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":7726,"spinlock_wait_cycles":44147712,"thread_start_us":445647,"threads_started":1,"wal-append.queue_time_us":599260}
I20260709 12:59:03.202131  4936 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:59:03.250322  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:03.220144  4953 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:03.215379  4913 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:03.277743  5000 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.278553  4986 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.259442  4919 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.281659  5000 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:03.282472  4953 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.283751  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1344) took 1097 ms. Trace:
I20260709 12:59:03.284411  4848 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:03.284184  1603 rpcz_store.cc:276] 0709 12:59:02.186590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.691063 (+504473us) service_pool.cc:224] Handling call
0709 12:59:02.691638 (+   575us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:59:02.701172 (+  9534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.701208 (+    36us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:59:02.706360 (+  5152us) log.cc:844] Serialized 104 byte log entry
0709 12:59:02.935557 (+229197us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:02.971393 (+ 35836us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.971889 (+   496us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.980866 (+  8977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.980998 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.243257 (+262259us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b18002c3e60. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:03.283295 (+ 40038us) raft_consensus.cc:1685] finished
0709 12:59:03.283326 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.283518 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21191,"prepare.queue_time_us":56996,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2024,"raft.queue_time_us":11176,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2402,"spinlock_wait_cycles":116269824,"thread_start_us":228498,"threads_started":1,"wal-append.queue_time_us":470407}
I20260709 12:59:03.285651  4936 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:03.271951  4913 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.287010  4936 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:03.288012  5042 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:03.288439  5042 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:03.294701  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.295804  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.297045  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.298678  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.297916  1745 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:03.304939  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.310401  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.308188  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.287413  4936 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:03.332373  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.332795  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:03.334026  1749 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:03.271919  4924 consensus_queue.cc:1243] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:03.308012  4976 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.360567  4848 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:03.385821  4917 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:03.342945  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:03.387428  4917 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:03.368727  4976 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:03.390633  4976 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:03.309441  5043 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:03.395723  4952 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.393760  5032 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:03.289275  5042 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.400233  4952 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.401010  5042 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.401789  4936 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:03.404577  4842 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.003s
W20260709 12:59:03.409655  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.412833  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:03.413784  1678 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:59:03.420117  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 181483us
I20260709 12:59:03.422676  1603 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:03.422395  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.427253  1603 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:03.427695  1603 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:03.424896  1744 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:03.431252  1600 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:03.431484  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.432945  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.403429  4936 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.403466  4952 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.440783  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.442224  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:03.442996  1597 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:03.441850  1601 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:03.416937  4842 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:03.447664  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.459744  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.455750  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.457057  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.463425  1601 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:03.464972  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.430104  4963 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:03.428673  1603 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:03.468788  5041 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.232s	user 0.000s	sys 0.004s
I20260709 12:59:03.472121  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:03.472863  1603 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.474431  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.475057  1749 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:03.476027  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:03.476969  2316 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:03.477664  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.478516  1597 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:03.471365  1744 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:03.480798  1747 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:03.487644  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:03.489084  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.494011  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.496387  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:03.473239  4919 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:03.509936  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 218893us
W20260709 12:59:03.511457  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.463943  4842 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:03.517213  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.520792  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 208348us
I20260709 12:59:03.505430  5044 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:03.531342  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1342) took 1345 ms. Trace:
I20260709 12:59:03.523216  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:03.534492  1603 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:03.507841  4940 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:03.505155  5032 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:03.533298  1598 rpcz_store.cc:276] 0709 12:59:02.186022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.588909 (+402887us) service_pool.cc:224] Handling call
0709 12:59:02.589360 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.685734 (+ 96374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.685793 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.696014 (+ 10221us) log.cc:844] Serialized 26 byte log entry
0709 12:59:02.919304 (+223290us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:59:03.131499 (+212195us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:03.131588 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.131705 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.425849 (+294144us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:03.531083 (+105234us) raft_consensus.cc:1685] finished
0709 12:59:03.531107 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.531264 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95833,"raft.queue_time_us":101108,"raft.run_cpu_time_us":4204,"raft.run_wall_time_us":231673,"spinlock_wait_cycles":50551808,"thread_start_us":386710,"threads_started":1,"wal-append.queue_time_us":515760}
I20260709 12:59:03.537572  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:03.537724  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:03.541937  1598 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.549193  1599 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:03.553984  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:03.554745  2316 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.510672  4919 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.536453  4940 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:03.574491  1744 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:03.539711  4998 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:03.562493  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:03.577412  1603 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.577870  1750 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:03.578423  2316 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:03.572798  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:03.581701  1597 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:03.588048  5046 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.350s	user 0.000s	sys 0.002s
I20260709 12:59:03.591171  4998 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:03.592195  4998 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.598068  4919 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.545287  5032 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.587869  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:03.606297  1597 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:03.583122  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:03.627774  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.613859  1603 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:59:03.624271  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.629767  1598 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:03.567268  4940 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:03.639405  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 162948us
I20260709 12:59:03.639921  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1333) took 1513 ms. Trace:
I20260709 12:59:03.640406  1594 rpcz_store.cc:276] 0709 12:59:02.126675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.306887 (+180212us) service_pool.cc:224] Handling call
0709 12:59:02.307380 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.307901 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:02.796748 (+488847us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.503674 (+706926us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:03.507241 (+  3567us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.507491 (+   250us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:03.507989 (+   498us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.508272 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.508379 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.587416 (+ 79037us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:03.639653 (+ 52237us) raft_consensus.cc:1685] finished
0709 12:59:03.639683 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.639849 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149067,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":56481,"raft.run_cpu_time_us":664,"raft.run_wall_time_us":38709,"spinlock_wait_cycles":42082560,"thread_start_us":1115302,"threads_started":3,"wal-append.queue_time_us":422785}
I20260709 12:59:03.655669  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:03.658361  1566 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.567s (SENT)
I20260709 12:59:03.581241  2312 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:03.659708  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:03.663643  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.618s (SENT) [suppressed 25 similar messages]
I20260709 12:59:03.608824  5059 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:03.633427  4963 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.633695  4952 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:03.687736  4963 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.676064  5059 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.673072  4965 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.690675  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:03.693687  5059 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:03.698966  4961 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:59:03.699508  1566 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.639s (SENT)
I20260709 12:59:03.706728  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:03.749228  1674 raft_consensus.cc:606] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
W20260709 12:59:03.733382  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.733860  4996 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.734004  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:03.734328  4907 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.734650  5063 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:03.735216  5065 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:03.728928  4801 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.737355  4963 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.739176  5054 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:03.740057  4999 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:03.741642  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.742383  5062 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:03.727281  5040 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:03.746205  5068 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:03.704296  5032 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.728116  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:03.787245  1677 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:03.678108  1676 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:03.708482  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.753620  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:03.756705  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 166) took 5479 ms. Trace:
W20260709 12:59:03.785578  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44008.7us
I20260709 12:59:03.789731  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.764094  4800 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:03.793635  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:03.788816  1500 rpcz_store.cc:276] 0709 12:58:58.276871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.283717 (+  6846us) service_pool.cc:224] Handling call
0709 12:59:03.756635 (+5472918us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:00.159040 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:00.159846 (+   806us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:00.159903 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:59:00.159931 (+    28us) tablet.cc:662] Decoding operations
0709 12:59:00.161036 (+  1105us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:00.161154 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:00.161197 (+    43us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:59:00.161968 (+   771us) tablet.cc:701] Row locks acquired
0709 12:59:00.162002 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:59:00.162241 (+   239us) write_op.cc:270] Start()
0709 12:59:00.162404 (+   163us) write_op.cc:276] Timestamp: P: 1783601940162160 usec, L: 0
0709 12:59:00.162438 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:59:00.163462 (+  1024us) log.cc:844] Serialized 2477 byte log entry
0709 12:59:00.676916 (+513454us) op_driver.cc:464] REPLICATION: finished
0709 12:59:00.818498 (+141582us) write_op.cc:301] APPLY: starting
0709 12:59:00.818617 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:00.818834 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:00.818989 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:00.819858 (+   869us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:00.820122 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:59:00.820177 (+    55us) write_op.cc:312] APPLY: finished
0709 12:59:00.820481 (+   304us) log.cc:844] Serialized 53 byte log entry
0709 12:59:00.820697 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:00.820828 (+   131us) write_op.cc:454] Released schema lock
0709 12:59:00.820888 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:00.821324 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:00.821354 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":730553,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":141251,"apply.run_cpu_time_us":2850,"apply.run_wall_time_us":2850,"num_ops":6,"prepare.queue_time_us":453135,"prepare.run_cpu_time_us":5099,"prepare.run_wall_time_us":136795,"replication_time_us":514294,"thread_start_us":472856,"threads_started":2}]]}
I20260709 12:59:03.803205  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:03.794525  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 86127.9us
I20260709 12:59:03.811208  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:03.808267  5062 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:03.763006  4996 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.766347  4952 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.769699  4907 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.807446  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:03.869184  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61856.9us
I20260709 12:59:03.804350  4919 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:03.781059  4801 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.872520  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:03.814817  4827 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:03.804847  4963 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:03.888137  5063 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:03.796283  5040 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:03.869905  4961 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:03.814833  4844 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:03.821470  5062 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:03.888321  4919 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:03.906464  5057 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:59:03.917086  4952 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.917440  4907 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:03.822508  4994 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:03.821555  5042 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:03.817034  5058 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:03.866367  4842 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:03.893653  5059 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:03.929817  5068 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:59:03.918408  4961 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:03.821004  5043 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:59:03.923770  4844 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:03.955616  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 132456us
I20260709 12:59:03.893326  4965 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:59:03.963049  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:03.944926  5057 consensus_queue.cc:1243] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:59:03.963286  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 83939.1us
I20260709 12:59:03.946090  5059 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.943630  5042 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:03.970042  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.942698  5058 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:03.956470  4961 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:03.972138  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 142817us
I20260709 12:59:03.963918  4844 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.984858  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:03.970808  4842 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:03.970914  4976 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:03.977536  5042 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.972847  5057 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.972875  5059 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.005537  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:04.005923  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.007629  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.007769  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:04.008960  1676 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:04.009902  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.009974  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:03.991140  5077 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:59:04.024037  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.025084  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.030526  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.030004  1669 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:03.932890  4940 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:04.027251  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.031301  1603 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:04.026000  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.032583  1598 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:03.968906  5062 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:04.034382  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 52201.9us
I20260709 12:59:04.043023  1603 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.998433  4996 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:04.035058  1671 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:04.055706  1603 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:04.067349  5096 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.068358  5096 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.070956  5062 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:04.072206  5050 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.840s	user 0.009s	sys 0.000s
I20260709 12:59:04.075718   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:04.075906  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.078461   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:04.029237  5057 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.079300  1501 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.037892  4842 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:04.065794  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.066881  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.003515  4827 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:59:04.032317  5032 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:04.037384  5058 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:04.130645  1598 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:04.292687  1677 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:59:04.290984  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:04.117025  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1419) took 1250 ms. Trace:
I20260709 12:59:04.213562  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:04.103211  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.168362  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 109535us
I20260709 12:59:04.131417  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:59:04.311762  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.164048  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.229854  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:04.084432  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.382368  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 12:59:04.282758  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.215267  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:04.241729  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:04.222489  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:04.387929  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:04.378474  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.390007  1748 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:04.393345  1749 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:04.377410  1744 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
W20260709 12:59:04.137559  5079 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:59:04.139010  5080 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:59:04.139719  4936 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.198360  4952 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:04.136572  5082 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:59:04.326556  4940 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:04.138309  5081 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:59:04.350402  4613 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.191772  4540 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:04.426654  4540 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.427269  4540 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:04.405009  1566 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.780s (SENT)
I20260709 12:59:04.191681  4913 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:04.132375  5077 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:04.318089  5040 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.163816  5065 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:04.433228  5065 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.190513  5090 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:04.410209  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.410172  4952 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:04.379000  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 247658us
I20260709 12:59:04.359823  4844 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.448529  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.057548  5088 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.376s
I20260709 12:59:04.084808  4801 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:04.465131  4952 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.388190  4919 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:04.352823  4994 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:04.466490  4952 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:04.085513  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.377054  1672 rpcz_store.cc:276] 0709 12:59:02.866788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.882147 (+ 15359us) service_pool.cc:224] Handling call
0709 12:59:02.882628 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.889673 (+  7045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.889719 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.890219 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.155183 (+264964us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:03.155408 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.155486 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.003077 (+847591us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:04.082398 (+ 79321us) raft_consensus.cc:1685] finished
0709 12:59:04.082422 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.116913 (+ 34491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6519,"raft.queue_time_us":24139,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":55,"spinlock_wait_cycles":64944384,"thread_start_us":246474,"threads_started":1,"wal-append.queue_time_us":332088}
I20260709 12:59:04.387763  5096 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:04.397951  5054 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.402369  5094 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.402705  5062 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.369586  5042 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.422118  1748 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:04.427942  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:04.473039  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68093.6us
I20260709 12:59:04.440402  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:04.370095  5059 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.202229  5085 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.274s
I20260709 12:59:04.388991  4961 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:04.410177  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 366703us
I20260709 12:59:04.455215  4842 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:04.412321  4936 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.456296  5090 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.445923  4613 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.470062  1501 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.484723  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:04.470476  5096 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:04.493260  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:04.498044  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:04.504771  1501 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.467795  4994 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.503144  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.467722  4844 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:04.513113  1595 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:04.511220  1501 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:04.485743  4950 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.467491  4919 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:04.468344  5065 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:04.518013  5090 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.518424  4936 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.518632  5043 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:04.520081  4613 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.520831  5086 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:04.521799  4940 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.470819  5094 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.470557  5054 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.524900  1501 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.527784  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:04.597837  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70182.4us
I20260709 12:59:04.598688  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:04.497566  4801 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:04.471079  5062 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.601014  4844 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:04.604163  4848 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:04.605052  5062 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:04.555370  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51758.6us
I20260709 12:59:04.605711  5097 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:04.536545  4965 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.606410  4965 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.614319  5058 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:04.609673  4965 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:04.594123  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 120401us
I20260709 12:59:04.520825  4961 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:04.628511  1566 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.909s (SENT)
I20260709 12:59:04.531631  5088 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.463299  4540 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:04.529184  4924 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:04.600221  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:04.653126  1501 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.594965  4976 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:04.629683  1566 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.969s (SENT)
W20260709 12:59:04.567071  5100 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
I20260709 12:59:04.635902  5096 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:04.655913  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.644420  5097 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.656430  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.662689  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:04.668242  1501 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.600548  4827 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.680861  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.683293  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.683660  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.684270  1603 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:04.685482  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:04.686178  1602 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:04.671521  1672 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 12:59:04.676846  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:04.677798  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.687840  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.678517  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.688701  1672 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:04.688810  1597 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:04.679221  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:04.638747  5059 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.673553  1501 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.689931  1601 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:04.694270  1501 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.700081  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.701452  1597 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:04.708544  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.709425  1596 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:04.710465  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.711118  1596 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:04.713910  5057 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.715791  5107 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.716681  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.681648  4965 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:04.717969  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:04.717640  4965 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.719094  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.720937  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.721398  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.722410  5059 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:04.723721  5103 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 12:59:04.723831  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.724709  5059 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:04.726313  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.727088  5059 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.728302  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.649586  5085 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.729058  5059 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.729504  5085 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.732036  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:04.732434  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.716437  5107 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.735431  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:04.751309  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:04.751976  1597 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:04.746089  1601 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:04.735049  1566 leader_election.cc:400] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:04.756263  1566 leader_election.cc:403] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:04.761294  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:04.686686  4961 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.798884  1597 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:59:04.771574  1595 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:04.680522  4802 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.670042  4986 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.808782  4986 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:04.812817  4986 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.814908  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:04.747639  5059 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.664500  4976 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:04.664948  4924 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.837958  4950 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:04.762593  4963 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:04.875905  1602 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:59:04.910521  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 396580us
I20260709 12:59:04.731274  4919 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.848709  4961 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.686553  5097 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:04.972908  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.964195  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 294603us
I20260709 12:59:04.950860  5096 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.961818  5059 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.962970  4963 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.997181  1743 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:04.960533  5093 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:04.963326  4961 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:04.999307  5065 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:59:05.002297  4965 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:04.997735  5096 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.003873  4961 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.005722  5096 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.009042  5093 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:05.013218  4924 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:05.015591  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.019829  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:05.022296  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:05.025490  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:05.036917  5093 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:05.037967  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:05.039067  5097 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.040117  4976 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.043375  5094 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.040122  5107 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.049576  5054 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.025714  5085 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.060424  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:05.064929  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:05.065944  1743 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:05.070819  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:05.072175  1743 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:04.974270  4994 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.086753  5087 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:05.088804  4994 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:05.090111  4952 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:59:05.026345  4963 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.019322  5059 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.092128  4827 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:05.092692  5087 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:05.096503  4940 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.108317  5087 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.121388  5087 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.127019  5042 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:05.117981  5058 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.008s
W20260709 12:59:05.196944  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 437171us
I20260709 12:59:05.200209  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.201999  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:05.204892  1598 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:59:05.205694  1598 pending_rounds.cc:85] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 4
I20260709 12:59:05.206116  1598 pending_rounds.cc:107] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:59:05.206547  1598 raft_consensus.cc:2889] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.207175  1598 pending_rounds.cc:107] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:05.214255  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:05.217787  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:05.211055  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:05.218590  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.216187  1598 raft_consensus.cc:2889] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.221791  1566 leader_election.cc:400] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:05.223421  1597 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:05.224546  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.224875  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:05.237201  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.249042  5144 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:05.282855  5144 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:05.252116  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 157308us
I20260709 12:59:05.259425  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:05.296152  4613 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.102878  4827 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.304302  4800 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:05.305454  4800 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.308997  4842 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.309921  4842 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.310918  4802 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:05.321296  4936 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.321942  4913 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.322162  4924 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:05.322381  4936 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.323127  4917 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.324476  4917 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:05.237286  1597 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:59:05.326905  4924 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.367799  4540 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.369020  4917 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:05.370332  5059 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:05.372279  5040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.016s
W20260709 12:59:05.372921  5040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.013s	sys 0.017s
I20260709 12:59:05.374078  4963 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.375025  4924 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.375890  4913 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.377286  4999 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:05.377600  5054 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:05.378221  4999 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.378417  5054 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:05.378669  5042 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.378896  4913 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.380205  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:05.297262  4613 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.409179  4940 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:05.387647  4842 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.414263  5030 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.415480  5030 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:05.429118  4998 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:05.429836  4998 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:05.430179  4999 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.430335  4998 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:05.433604   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:05.434789  5143 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
W20260709 12:59:05.424641  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 187930us
I20260709 12:59:05.435926  5042 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.418866  5030 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.491034  1750 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:05.490247  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.529498  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 305110us
I20260709 12:59:05.536958  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.542331  1675 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:59:05.493101  4800 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.552261  1677 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:05.555824  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 89611.7us
I20260709 12:59:05.561744  5054 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:05.476204  5043 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.571672  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.579953  5042 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:05.586077  5132 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 12:59:05.587721  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.588928  1672 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:05.589812  2316 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:05.590687  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.591928  4917 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:05.594760  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.597883  5054 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:05.598412  5054 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:05.598940  5054 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:05.572995  4999 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:59:05.604087  4919 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:05.569897  4940 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.612191  5089 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:05.615908  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 178819us
I20260709 12:59:05.619168  4917 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:05.623318  2316 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:05.623971  1743 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:05.615347  5089 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:05.626202  5089 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.638085  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:05.639816  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:05.640205  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.641140  1670 raft_consensus.cc:2410] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:05.617758  4936 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.648168  4924 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.649324  5043 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.651842  4613 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.651772  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.652426  5043 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.653156  4827 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:05.660367  5089 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:05.677587  5054 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.680938  4936 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:05.681604  4936 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.682030  4936 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:05.684206  4827 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.684924  4827 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.688107  4827 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:05.691522  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 126132us
I20260709 12:59:05.692689  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.694367  4924 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:05.696383  4999 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:05.702804  4998 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.707083  4998 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:05.749748  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47386.4us
I20260709 12:59:05.752714  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:05.753755  1674 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:05.754191  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.754937  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:05.772993  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.774088  1669 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:05.775704  5043 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:05.779567  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.785390  5040 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.787984  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.823072  5040 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:05.825042  4998 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:05.825870  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.601s (SENT)
I20260709 12:59:05.825827  4998 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:05.826558  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:05.826786  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:05.831888  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 139323us
I20260709 12:59:05.827497  4827 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:05.826236  5054 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.844024  4998 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:05.849623  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:05.853312  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:05.854614  4924 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:05.965397  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.028954  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.058490  4924 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.070819  4924 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.138419  4827 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.204588  4827 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.345731  4827 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:06.405694  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.454476  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 441681us
I20260709 12:59:06.465226  4827 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:06.459779  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 671820us
I20260709 12:59:06.469017  4827 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.470692  4998 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:06.477375  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 629687us
I20260709 12:59:06.475728  4827 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:06.488111  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:06.489234  4924 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.479101  4998 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.503938  5054 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:06.508283  4924 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:06.529151  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45434.4us
I20260709 12:59:06.529799  5158 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:06.530625  5158 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:06.535741  5159 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:06.536204  4936 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.854s	user 0.008s	sys 0.007s
I20260709 12:59:06.536860  5158 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:06.536589  5159 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.536743  4936 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.539381  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:06.547776  5159 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.542304  5158 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:06.550200  5159 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:06.556450  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.538229  4924 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:06.548192  4917 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:06.545889  4936 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.551034  5159 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:06.593891  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 54600.7us
I20260709 12:59:06.573025  4917 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:06.621002  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 149050us
W20260709 12:59:06.707324  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 241004us
I20260709 12:59:06.613947  4917 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:06.710414  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 220067us
I20260709 12:59:06.613970  4998 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.730365  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:06.742281  1669 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:06.743906  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:06.619891  4936 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:06.760936  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:06.747939  4540 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.747676  5160 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.768549  4540 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:06.778601  5160 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.771759  5163 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:59:06.791894  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:06.791492  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:06.797600  5163 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:59:06.801810  5158 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:06.762729  4936 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:06.793040  4827 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.794476  4999 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:06.820621  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:06.818048  5158 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.821466  1676 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:59:06.818075  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63790.6us
I20260709 12:59:06.834398  5159 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:06.837381  4924 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:06.843698  5165 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:06.857741  5159 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:06.863839  4540 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.866262  4924 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:06.849279  4827 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.864679  4999 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:59:06.905794  4827 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:06.878695  5158 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.876633  4936 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:06.910485  4998 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:06.935956  4998 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:06.937371  4998 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.914113  5054 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:06.914440  5160 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:06.939214  4998 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:06.877996  5159 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:06.879705  5165 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:06.898628  4924 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:06.988108  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 272178us
W20260709 12:59:06.975307  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 246187us
W20260709 12:59:06.995707  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 238321us
I20260709 12:59:06.970409  4827 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:06.971962  5160 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.027397  5167 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:07.028102  5167 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:07.027611  5160 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.029969  5167 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:07.030889  5160 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.012427  5170 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.032303  5170 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.035772  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 90) took 4882 ms. Trace:
I20260709 12:59:07.036319  1497 rpcz_store.cc:276] 0709 12:59:02.123037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.142442 (+ 19405us) service_pool.cc:224] Handling call
0709 12:59:02.633016 (+490574us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b5400002438. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f948724c173 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:06.999881 (+4366865us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":308,"mutex_wait_us":116506,"reported_tablets":2,"spinlock_wait_cycles":21095168}
I20260709 12:59:07.016404  5165 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:07.024058  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:07.025770  4924 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.026660  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:07.035225  5170 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.026715  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:07.002295  4827 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:07.050604  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.070219  5163 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.072705  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.079995  1596 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:07.080356  4917 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.083107  4917 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.084052  5043 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:07.084743  5043 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:07.086771  5043 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.088332  5043 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:07.108848  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.108592  5168 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:07.115764  4827 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:07.117266  4827 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.109638  5167 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:07.120052  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 96247.7us
I20260709 12:59:07.123766  5159 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.132653  1751 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:07.132969  1596 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:59:07.133077  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.071192  5163 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.152104  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:07.152915  1747 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:07.159727  5169 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:07.160414  5169 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.160780  5169 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:07.149451  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 122906us
I20260709 12:59:07.174058  2316 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:59:07.180608  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.183761  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.184643  1596 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:07.189913  5163 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:07.193414  1747 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
W20260709 12:59:07.195115  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.194850  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.196650  5158 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.197292  5158 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.199860  5158 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.200650  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:07.203300  1744 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:07.203809  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.205336  1752 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:59:07.206096  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:07.213492  1746 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.218333  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.223963  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.218463  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.224785  1596 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:59:07.225144  1594 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:07.236145  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.238023  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.238915  1595 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:07.243451  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.244063  1746 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:07.246047  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.247951  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.248848  1752 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:07.250481  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.250767  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.251257  1594 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:07.251526  1603 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:07.246735  1751 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:59:07.260242  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.258049  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.261358  1596 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:07.265216  1750 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:07.266232  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:07.266279  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.267064  1598 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:07.268412  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.268565  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.269234  1747 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:07.270371  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.270593  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.271250  1603 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:07.271662  1749 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:07.276084  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:07.276201  1745 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:07.276765  1749 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:07.283358  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.284026  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:07.284379  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:07.284668  1596 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.279577  5183 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:59:07.285869  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.286585  1597 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:07.279095  5167 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:59:07.293846  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.293001  1752 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:07.289110  4827 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:07.288074  4998 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.295035  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:07.300390  1600 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.305042  1750 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:07.294592  5158 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.323478  5169 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:07.299134  4827 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:07.315770  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:07.327519  1597 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:07.330495  5054 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.331341  5054 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.332226  4936 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.333153  4936 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:07.334373  5054 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.335274  5054 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.336030  5054 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.337180  4936 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:07.339078  5054 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.341441  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:07.342558  5189 raft_consensus.cc:2764] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:07.349421  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.307443  4998 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:07.358987  5169 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:07.327201  5158 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.377101  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.377954  2316 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:07.369990  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.393649  1600 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:07.377935  4999 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:07.351845  4827 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.396823  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.406471  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.409646  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.408211  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.418349  5043 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:07.377554  5054 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:59:07.433125  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.408389  4999 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.431836  5043 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.416464  4917 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:07.441867  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.442499  5158 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.442871  4827 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.443166  1496 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.452411  1749 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:07.455039  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.451529  1597 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:07.456698   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:07.498550  4998 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.498674  2313 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:07.449159  5043 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.499716  4998 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.500380  4998 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:07.502815  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 139663us
I20260709 12:59:07.440590  4999 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.448805  5054 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:07.519932  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:07.526476  1675 raft_consensus.cc:2410] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:59:07.520763  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:07.521165  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:07.523247  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:07.523200  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.455695  4917 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:07.528692  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 119100us
I20260709 12:59:07.532095  1671 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:07.532107  1672 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:07.531513  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.534474  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.535358  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.545243  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:07.525956  5054 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.530174  5158 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:07.560863  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 112307us
I20260709 12:59:07.532246  4917 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:07.569257  2316 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:07.544274  5159 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.561939  5054 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.576377  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:07.547741  1496 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 5 to 3, term changed from 6 to 8, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:07.582468  1599 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:07.586675  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 196) took 6516 ms. Trace:
W20260709 12:59:07.603955  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.611629  1676 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
W20260709 12:59:07.613327  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.579002  5199 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:07.582240  5159 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:07.641718  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49138.4us
I20260709 12:59:07.579877  5158 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:07.634506  5199 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.657514  1596 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:07.639678  5203 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.660004  1496 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.648237  4998 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:07.671480  5191 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
W20260709 12:59:07.677069  5193 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:59:07.677459  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:07.670157  5206 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:59:07.676501  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.074s (SENT)
W20260709 12:59:07.686133  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49448.1us
I20260709 12:59:07.660508  5199 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.725767  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:07.695868  1496 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.686903  4998 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:07.732882  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 197561us
W20260709 12:59:07.735494  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.587217  1501 rpcz_store.cc:276] 0709 12:59:00.921017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.921186 (+   169us) service_pool.cc:224] Handling call
0709 12:59:07.429147 (+6507961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:05.086910 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:05.087591 (+   681us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:05.087636 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:59:05.087653 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:05.088871 (+  1218us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:05.088944 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:05.088977 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:59:05.092519 (+  3542us) tablet.cc:701] Row locks acquired
0709 12:59:05.092547 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:59:05.092743 (+   196us) write_op.cc:270] Start()
0709 12:59:05.092875 (+   132us) write_op.cc:276] Timestamp: P: 1783601945092671 usec, L: 0
0709 12:59:05.092902 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:59:05.093854 (+   952us) log.cc:844] Serialized 5256 byte log entry
0709 12:59:05.668130 (+574276us) op_driver.cc:464] REPLICATION: finished
0709 12:59:05.855039 (+186909us) write_op.cc:301] APPLY: starting
0709 12:59:05.855192 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:05.855648 (+   456us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:05.855817 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:05.857868 (+  2051us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:05.858256 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:59:05.858301 (+    45us) write_op.cc:312] APPLY: finished
0709 12:59:05.858844 (+   543us) log.cc:844] Serialized 95 byte log entry
0709 12:59:05.859091 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:05.859430 (+   339us) write_op.cc:454] Released schema lock
0709 12:59:05.859505 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:05.868698 (+  9193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:05.868743 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1161256,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":183121,"apply.run_cpu_time_us":5235,"apply.run_wall_time_us":13662,"num_ops":13,"prepare.queue_time_us":265949,"prepare.run_cpu_time_us":7935,"prepare.run_wall_time_us":329056,"raft.queue_time_us":121421,"raft.run_cpu_time_us":7660,"raft.run_wall_time_us":82443,"replication_time_us":536994,"thread_start_us":746377,"threads_started":4,"wal-append.queue_time_us":56483,"wal-append.run_cpu_time_us":16244,"wal-append.run_wall_time_us":1713592}]]}
W20260709 12:59:07.731209  5190 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 12:59:07.735365  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.735031  4998 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.751009  4998 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:07.676071  5203 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.753659  5203 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:07.734128  5213 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:07.754424  5213 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.754802  5213 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:07.746948  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 87688.2us
W20260709 12:59:07.756418  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.091s (SENT)
W20260709 12:59:07.757495  1715 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.143s (SENT)
W20260709 12:59:07.758543  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.147s (SENT)
I20260709 12:59:07.746908  5198 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:07.748088  5219 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.748775  5159 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:07.749651  5202 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:59:07.748138  5158 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:07.781497  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.779325  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.779652  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:07.759390  1715 connection.cc:256] RPC call timeout handler was delayed by -1.4520380889999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
I20260709 12:59:07.789361  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.790553  1749 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:07.790256  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:07.792754  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0605380889999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:59:07.793123  1747 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:07.795073  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.796496  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.773197  5219 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.798400  1496 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.809769  4998 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.778064  5192 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:07.811959  5192 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.822340  4827 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.822705  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:07.823024  4827 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.825421  4827 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:07.800431  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:07.812511  4998 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.827955  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.805526  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.771417  5043 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.831429  5043 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.832433  1670 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:07.806631  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.807646  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:07.799067  4999 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.799193  5219 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.808311  2312 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:07.825218  5197 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.383s	user 0.003s	sys 0.000s
I20260709 12:59:07.841998  5181 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:07.842605  5181 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:07.844120  5181 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.812446  5192 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.839049  5194 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:07.840433  5196 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.234s	user 0.004s	sys 0.000s
W20260709 12:59:07.845285  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 110005us
I20260709 12:59:07.837164  2314 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:07.847961  5194 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.849524  5194 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.851933  5159 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:07.852415  4999 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.852530  5159 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:07.856292  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:07.857190  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6805325209999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 12:59:07.857298  5163 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:07.857789  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6220325209999373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:59:07.858135  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6013325209999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:59:07.858417  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6013325209999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:59:07.858704  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2917325209999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:59:07.858970  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2917325209999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:59:07.859306  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1072325209999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:59:07.864205  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1072325209999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 12:59:07.865140  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:07.859658  5158 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.866004  5158 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.868166  5158 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.868942  5171 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:07.869410  5171 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.869773  5171 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.875929  5159 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:07.860127  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:07.876796  5159 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.877364  5163 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:07.878258  5207 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
I20260709 12:59:07.879316  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:07.863775  5181 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:07.882629  5213 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.885056  5213 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.885639  4917 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.887811  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.888816  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.889693  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.890761  5219 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:07.891162  5219 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.891574  5219 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:07.892143  4999 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:07.892740  4999 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.893211  4999 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.893662  5194 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:07.894975  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.891527  5221 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:07.896113  5221 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.896500  5221 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.897873  5054 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:07.899989  5163 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:07.814818  1496 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.901257  5163 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.900393  4917 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.918059  5163 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:07.924710  5192 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.925359  1496 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.927093  5192 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.918761  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.933518  5054 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:07.934696  5219 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.935698  5199 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:07.936643  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57450.3us
I20260709 12:59:07.937523  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:07.938081  5199 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.938385  5203 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:07.938989  5203 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.938544  5171 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.939471  5203 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.929690  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.927155  1496 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.951676  5222 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:07.954437  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:07.955328  5181 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:07.943518  5174 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:07.955825  5181 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:07.956337  5181 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.957080  5219 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.958014  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:07.961941  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89673us
I20260709 12:59:07.959692  5222 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:07.964733  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:07.966068  4917 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:07.958055  5171 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.966538  4917 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:07.966459  5222 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.969658  4999 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.989207  4917 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.990978  4999 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:07.995863  5194 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:08.007028  1678 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:07.974687  5163 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.961547  5174 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:08.019241  1672 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:07.979646  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.980593  5213 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:07.978796  5181 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:07.983836  5198 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:07.999729  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.009757  1670 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:08.013829  4917 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.035432  1674 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:08.036907  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.038386  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:08.043745  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.044405  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.037949  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.048085  1749 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:08.050562  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.050915  4917 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:08.053169  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.054838  5163 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:08.056017  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:08.056973  2312 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:08.057916  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.058590  1601 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:08.059605  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.060220  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.059937  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.061048  1594 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:08.061519  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:08.062310  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 98259.1us
I20260709 12:59:08.060220  1751 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:08.067389  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.073666  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.074707  1749 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.075721  1743 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:08.077706  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.078526  1672 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:08.079288  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.081423  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.076104  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.082221  1744 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:08.080174  1743 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:08.085925  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.086102  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.086650  1744 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:08.061439  5171 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:08.087570  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.088510  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.095196  1746 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:08.095209  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.088986  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.090440  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.096093  1597 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.096551  1599 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.095834  1749 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:08.097136  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.096452  1748 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:08.098320  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.061902  5213 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:08.105299  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.105916  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.107613  1598 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.107960  1603 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:08.109205  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.109941  1596 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:08.109104  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.051198  5221 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.114671  1602 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:08.115379  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:08.111925  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.116734  1752 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:08.116087  1594 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:08.125833  5203 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.126634  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.123297  4917 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:59:08.128010  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:08.128772  2312 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.130816  5169 raft_consensus.cc:2764] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:08.132203  1600 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:08.132668  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.133304  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.133891  5181 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:08.135016  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.133591  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:08.135778  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.135778  1596 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:08.133322  1602 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.133922  1600 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.144502  1597 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:08.117431  5223 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:08.146420  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:08.146898  5194 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:08.176672  1603 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:08.176683  5223 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:08.177754  5194 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:08.147665  5174 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.178138  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.179054  1603 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.153821  5181 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:08.156289  5189 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:08.187383  5189 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:08.187868  5189 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:08.188869  5189 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.157012  5221 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:08.164557  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.165275  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.165481  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.166064  5163 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:08.191458  1748 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:08.191377  1749 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.192294  5163 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:08.192747  5163 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:08.193881  5176 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:08.167313  5213 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.168376  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.169632  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.178812  5194 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:08.197568  1594 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.147194  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.178136  5223 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.199709  1745 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.204331  5176 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:08.205790  5176 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.208195  5176 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:08.184933  5203 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:08.193724  5163 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.210253  5163 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.167482  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.216706  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:08.221843  1598 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:08.222244  1599 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:08.241132  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:08.241693  1603 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:08.244479  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 127634us
I20260709 12:59:08.224120  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:08.272514  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:08.272933  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 148448us
I20260709 12:59:08.214525  5189 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.272526  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.281960  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.311821  1744 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.294549  1596 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:08.312186  1597 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.293936  1745 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:08.314651  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.296411  1749 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:08.223096  5171 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:08.315331  1752 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.288525  1600 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:08.319694  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.317772  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.328328  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.326543  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:08.329303  1749 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:08.340984  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.361644  1597 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:08.336894  5159 raft_consensus.cc:2764] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:59:08.357954  5225 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:59:08.385183  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.380030  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.390867  1749 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:08.393044  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:08.397930  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 80294.5us
I20260709 12:59:08.399533  2312 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:08.400599  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.402156  5199 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.392338  1602 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:08.407522  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.410188  1744 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:08.375968  5221 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:08.417595  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.364634  4540 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:59:08.418248  5231 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:08.412917  5159 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:08.430367  5158 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:08.442193  5221 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:08.442515  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.419270  5216 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:08.473285  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 126606us
I20260709 12:59:08.422220  4917 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:08.414403  4936 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:59:08.422892  5231 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:08.480813  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:08.516821  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.518445  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:08.520097  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 48570us
I20260709 12:59:08.420567  5171 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.456367  5159 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:08.519340  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.497502  5054 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:08.546432  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.554950  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:08.544941  5219 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:08.547060  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.550704  5221 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:08.521787  5231 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:08.514060  4998 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:08.549655  5159 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:08.544622  4917 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:08.579777  5192 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:08.558271  5054 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.620291  1677 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:08.620483  1594 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:08.594666  5222 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:08.615331  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 174208us
I20260709 12:59:08.598129  4998 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:08.611621  5221 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:08.626349  5054 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:08.640401  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 120922us
I20260709 12:59:08.662617  1748 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:08.679474  1674 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:08.627308  4917 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:08.632597  5192 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:08.681391  5232 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.257s	user 0.002s	sys 0.000s
W20260709 12:59:08.700260  2279 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.589s (SENT)
I20260709 12:59:08.709064  5054 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:08.711593  5054 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:08.627393  1744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27da507a1bb04525952847c678820e4e"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:08.715448  1744 raft_consensus.cc:606] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:08.715881  1744 raft_consensus.cc:614] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:08.699790  5219 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:08.712905  5158 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:08.723127  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 197787us
I20260709 12:59:08.732486  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.742707  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.745422  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:08.747476  5239 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:59:08.749190  5234 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:59:08.750766  5245 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:08.758286  1752 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:08.693807  4998 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:08.765616  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.766016  5245 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:08.740815  5233 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:59:08.772832  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.773964  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.777292  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.778177  1597 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:08.779304  1598 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:59:08.764369  5198 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:08.757647  5222 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:08.783610  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83387.2us
W20260709 12:59:08.785466  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.803000  5228 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:08.777324  5192 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.805498  5228 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:08.806039  5228 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:08.803181  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.807381  1597 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:08.722604  5221 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.733757  5231 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:08.828047  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 273187us
I20260709 12:59:08.829661  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:08.830495  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.832939  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:08.833217  5235 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:59:08.834254  5194 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.836243  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.845650  1597 raft_consensus.cc:2376] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9. Re-sending same reply.
I20260709 12:59:08.836576  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.837028  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.846206  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.769002  4917 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.821184  5198 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:08.843192  1675 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.844009  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.846714  1598 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
W20260709 12:59:08.836244  5242 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:59:08.841571  5250 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.856560  1678 raft_consensus.cc:2368] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7.
I20260709 12:59:08.857939  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.861995  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.862830  1676 raft_consensus.cc:2368] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:08.866564  5194 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:08.866796  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.868690  1670 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:08.870898  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.872434  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:08.867093  5194 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:08.855897  5213 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.876408  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.876662  1744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:08.880654  1744 raft_consensus.cc:606] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:08.881098  1744 raft_consensus.cc:614] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:08.877270  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.878017  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.849094  5181 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:08.887213  1672 raft_consensus.cc:2368] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:59:08.883436  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.813452  5219 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.884971  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.892320  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.883386  5213 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:08.902573  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77334.6us
I20260709 12:59:08.906615  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.869942  5250 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.907503  1671 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:08.898455  5169 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.913017  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.920789  5194 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.923938  5213 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:08.924901  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.925742  1748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:08.926340  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:08.928210  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.931164  5198 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:08.921118  5169 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:08.943378  5163 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 12:59:08.897668  5181 consensus_queue.cc:1243] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:08.890311  5244 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:59:08.935144  1675 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:08.981508  5198 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:08.982012  5198 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:08.982048  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.983323  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.984501  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.985195  1675 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:08.935992  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.936754  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.936972  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.988523  1676 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:59:08.939656  5189 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.003s
I20260709 12:59:08.939445  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.879998  5222 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:08.991083  5159 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:08.992679  1594 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:08.993641  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.939883  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.940201  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.941293  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:08.994475  1599 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.994848  1749 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.995023  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:08.942368  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.943898  1598 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.946638  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:08.998808  1597 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.946533  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:08.948958  5176 consensus_meta.cc:287] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.005s
I20260709 12:59:08.950726  4998 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.951637  1600 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:08.952244  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.954704  1596 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:08.955813  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:08.956280  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.956646  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.019949  1601 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:09.019770  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:08.957746  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:08.931479  5250 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:08.967299  1674 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:08.932042  5231 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:08.975988  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.033222  1602 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.977056  5169 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:08.977485  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:08.941892  1743 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.021386  1603 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:09.030328  1749 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:09.034358  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.035275  1595 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:09.037338  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:09.042752  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:09.041177  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.052202  1596 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:09.041903  1673 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:09.039851  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:09.044299  1677 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:59:09.053637  1752 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:09.056118  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:09.062132  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:09.063010  1749 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:08.983016  5198 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:09.066726  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.067409  1603 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:09.070641  1752 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:09.072224  5243 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:09.072849  5243 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.040436  5213 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:09.039714  5255 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:09.078743  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.089871  1602 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:09.081776  1599 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:09.092767  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.093232  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.099706  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.069075  5192 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:09.051023  2312 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:09.113876  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.122125  1746 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 12:59:09.130481  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74461.1us
I20260709 12:59:09.132918  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.134779  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.135646  1602 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:09.136333  1597 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:09.137339  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.145128  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.147809  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.146029  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.088340  5255 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:09.093650  5198 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:09.153977  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.169049  1596 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:09.107909  5250 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.164412  1598 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:09.154909  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.155212  5221 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:59:09.172449  5054 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:09.152046  5181 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:09.173287  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.201529  1602 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:09.176453  1743 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:09.177304  5249 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:09.179855  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.112329  5192 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:09.189069  1597 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:09.188856  1752 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:09.207901  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.192339  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.171566  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.203773  1599 raft_consensus.cc:2376] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:59:09.208098  1752 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:09.198554  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.213629  1751 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:09.220247  1596 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:09.163261  5219 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:09.164588  5159 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:09.225384  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.169687  5255 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:09.226413  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54936us
I20260709 12:59:09.230151  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.156340  5259 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:09.233457  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.236096  1602 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:09.200453  5250 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:09.296239  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:09.290933  5269 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:09.230682  5054 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:09.215273  5192 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:09.207908  5181 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.281028  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.197685  5243 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:09.260692  1752 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.293164  1595 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:09.294516  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.234620  5221 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:09.242345  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.312016  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.293989  5219 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:09.307282  2279 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.299s (SENT) [suppressed 17 similar messages]
I20260709 12:59:09.356671  5219 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:09.321441  5266 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
I20260709 12:59:09.359230  5054 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.362941  1752 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:09.363957  1602 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:09.379303  1598 pending_rounds.cc:85] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 2
I20260709 12:59:09.380656  1598 pending_rounds.cc:107] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.3
I20260709 12:59:09.382277  1598 raft_consensus.cc:2889] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.380412  1601 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:09.303723  5250 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.296559  5169 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.408366  1752 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:09.416906  1749 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:09.424302  5194 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:09.428208  5183 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 12:59:09.438807  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.447166  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1706) took 1285 ms. Trace:
I20260709 12:59:09.447717  1751 rpcz_store.cc:276] 0709 12:59:08.162124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.168092 (+  5968us) service_pool.cc:224] Handling call
0709 12:59:09.446910 (+1278818us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540013b354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:09.447041 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832529664}
W20260709 12:59:09.449491  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.449553  1751 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:59:09.454926  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.463223  4917 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:09.463830  4917 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:09.467446  1743 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:59:09.439489  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.470793  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.435456  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:09.480654  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 186187us
I20260709 12:59:09.481879  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:09.490284  4998 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:09.491029  4998 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:09.492151  4998 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:09.498450  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.481213  5269 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:59:09.504869  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.404915  5169 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:09.522868  1746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1708) took 1358 ms (client timeout 1682 ms). Trace:
I20260709 12:59:09.483335  5181 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:09.526268  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 219051us
I20260709 12:59:09.518577  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:09.523442  1746 rpcz_store.cc:269] 0709 12:59:08.164395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.164526 (+   131us) service_pool.cc:224] Handling call
0709 12:59:09.522660 (+1358134us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540040a6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:09.522791 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904606080}
I20260709 12:59:09.536278  1603 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.514578  5199 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:09.538743  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.533445  4936 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:09.541643  5221 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:09.591563  5228 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.784s	user 0.005s	sys 0.011s
I20260709 12:59:09.600159  4917 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.604017  4917 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:09.608244  5250 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.609594  1673 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:09.565896  5199 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:09.613090  5199 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.613727  5192 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.593987  4936 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:09.616050  5221 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.616382  4936 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:09.618327  5255 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.619791  1677 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:09.626638  5192 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:09.628820  1750 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:59:09.664045  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.689292  5250 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:09.690968  5169 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:09.696614  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:09.697922  1600 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:09.700624  5255 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:09.702310  5213 consensus_meta.cc:287] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.003s
I20260709 12:59:09.702948  5213 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:09.705497  1603 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.622262  5228 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.708462  5228 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:09.708890  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.709656  1594 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:09.708492  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:09.711138  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:09.726487  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.984s (SENT)
I20260709 12:59:09.727263  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:09.728125  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 248977us
I20260709 12:59:09.732967  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:09.768172  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 238124us
I20260709 12:59:09.778012  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:09.798491  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 72039.2us
W20260709 12:59:09.799853  2279 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.183s (SENT)
I20260709 12:59:09.804378  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.811923  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:09.828400  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 55410.5us
I20260709 12:59:09.743709  5205 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:09.743649  5198 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:09.845768  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.847946  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:09.785660  5290 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 12:59:09.850785  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:09.850919  1670 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.872263  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:09.893887  1603 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:09.885177  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73361.4us
I20260709 12:59:09.897298  1678 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:09.903612  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:09.788627  5244 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.897547  5273 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.855691  5221 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:09.925247  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:09.833650  5213 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:09.902145  4936 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:09.929870  5273 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:09.854547  5198 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:09.919696  5054 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 12:59:09.922996  5249 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.001s
I20260709 12:59:09.936276  5279 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:09.936810  1744 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:09.923661  5222 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:09.921833  5205 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:09.912878  5250 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:59:09.861922  5181 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:59:09.945293  1748 raft_consensus.cc:606] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:09.960662  1748 raft_consensus.cc:614] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:09.912513  5174 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:59:09.966740  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 166914us
I20260709 12:59:09.932737  5213 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.937522  5176 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.942312  5169 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:09.938282  5198 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:09.941570  4936 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:09.925534  5244 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.938446  5221 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:09.973644  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.944854  5279 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:10.002668  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.935001  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.549s (SENT)
I20260709 12:59:09.981315  5222 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:10.011629  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.026706  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.038718  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.016891  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:09.991803  5213 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:09.994026  5279 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:10.072747  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 124106us
I20260709 12:59:09.986366  5169 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:09.982796  5176 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:10.095237  5273 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:10.077961  5293 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:59:10.090788  5221 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.105948  5244 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:10.102979  5176 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:10.103003  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 91) took 2853 ms. Trace:
I20260709 12:59:10.091099  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:10.108790  1497 rpcz_store.cc:276] 0709 12:59:07.249263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.253208 (+  3945us) service_pool.cc:224] Handling call
0709 12:59:07.290292 (+ 37084us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5400002490. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e3690b2 00007f94872e2a89 00007f948727ada6 00007f948724c088 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc
0709 12:59:10.102891 (+2812599us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":698483,"reported_tablets":3,"spinlock_wait_cycles":3147008}
W20260709 12:59:10.088435  5289 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:59:10.123899  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:10.127291  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 192290us
I20260709 12:59:10.131850  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.112171  5285 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.132558  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:10.133770  2313 raft_consensus.cc:2410] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:10.134310  1678 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:10.077495  5219 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:59:10.143105  1715 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.974s (SENT)
W20260709 12:59:10.126955  5253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.015s	sys 0.010s
I20260709 12:59:10.143309  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:10.160105  5253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.015s	sys 0.010s
I20260709 12:59:10.161548  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:10.160977  5222 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:10.162266  2315 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:10.132197  4936 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.126680  5273 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:10.183332  1715 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.919s (SENT)
I20260709 12:59:10.166005  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:10.187904  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:10.209199  5294 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:10.210279  5169 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:10.177879  5205 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.163187  5285 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.212284  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:10.207132  1566 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.553s (SENT)
I20260709 12:59:10.215796  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:10.202919  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.218003  1678 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:10.213757  2313 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:10.221436  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:10.125080  5250 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:59:10.224401  5228 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:10.224409  5273 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:10.223649  5169 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.183530  4827 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.227460  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56774 (request call id 4) took 1302 ms. Trace:
W20260709 12:59:10.214630  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 88655.2us
I20260709 12:59:10.227648  5273 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:59:10.239161  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115344us
I20260709 12:59:10.233747  1748 rpcz_store.cc:276] 0709 12:59:08.925087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.925604 (+   517us) service_pool.cc:224] Handling call
0709 12:59:10.227141 (+1301537us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481487853 00007f948645560a 00007f947f9db7d4 00007f947f9db762 00007f947f9db691 00007f947f9db60c 00007f947f9da8c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:10.227336 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342992256}
I20260709 12:59:10.249295  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1713) took 1310 ms. Trace:
I20260709 12:59:10.233477  5181 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:10.224483  5259 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:10.239452  5273 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:10.249786  1744 rpcz_store.cc:276] 0709 12:59:08.938996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.939170 (+   174us) service_pool.cc:224] Handling call
0709 12:59:10.249093 (+1309923us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:10.249225 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098311936}
I20260709 12:59:10.244904  5249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51110 (request call id 0) took 2462 ms. Trace:
W20260709 12:59:10.266383  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59299.3us
I20260709 12:59:10.278319  5286 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:10.279770  5255 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:10.242429  5176 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:59:10.285336  5176 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:10.285770  5176 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:10.286727  5176 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.255177  5181 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.288033  5181 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.240279  4827 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.304117  1597 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:10.301782  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:10.314157  1598 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:59:10.314716  1566 leader_election.cc:336] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.618s (SENT)
I20260709 12:59:10.315204  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:10.317655  1603 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:10.319525  1599 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:10.324883  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:10.325152  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:10.330281  1600 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:10.332219  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:10.333091  2313 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:10.335654  1599 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:10.331002  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 92631us
I20260709 12:59:10.337229  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.348572  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:10.349293  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.349149  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.349556  1674 raft_consensus.cc:2410] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:10.340942  1677 pending_rounds.cc:85] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 7
I20260709 12:59:10.350857  1677 pending_rounds.cc:107] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:59:10.351238  1677 raft_consensus.cc:2889] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.352615  5285 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.352993  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:10.353533  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.354314  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:10.355862  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.356630  1670 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:10.318817  5279 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.357455  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.355420  1672 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:10.362422  1674 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
W20260709 12:59:10.364892  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.365319  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.364624  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.322309  5228 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:10.356014  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47870.2us
I20260709 12:59:10.366961  1674 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:10.369859  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.371385  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.373442  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.375772  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.335474  5176 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.387053  1750 raft_consensus.cc:2410] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:10.388343  1745 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 12:59:10.388967  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.391901  1674 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:10.392313  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.392933  1600 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:10.393182  1747 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:10.394137  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.395852  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:10.273629  5249 rpcz_store.cc:276] 0709 12:59:07.770985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.771155 (+   170us) service_pool.cc:224] Handling call
0709 12:59:07.804200 (+ 33045us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b2c00012f58. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd95a0a 00007f947fd95693 00007f947fd95631 00007f94814c8902 00007f94814c86dd 00007f9481493f3f 00007f94814936b3 00007f948148b9fa 00007f94864534c9 00007f947f9cfc54
0709 12:59:07.922908 (+118708us) log.cc:844] Serialized 501 byte log entry
0709 12:59:10.229587 (+2306679us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43644,"raft.run_cpu_time_us":1630,"raft.run_wall_time_us":1631,"spinlock_wait_cycles":10548608,"thread_start_us":35682,"threads_started":1,"wal-append.queue_time_us":44399,"wal-append.run_cpu_time_us":1932,"wal-append.run_wall_time_us":1002223}
I20260709 12:59:10.398057  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 516703d5c9f14537854665616191b5aa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:10.345990  5273 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.400494  5273 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:10.403472  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.405817  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.406180  5231 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:10.406766  5231 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:10.407502  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.408625  5300 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.409005  5231 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:10.409174  5300 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.409523  5231 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:10.410014  5231 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:10.412472  5231 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:10.414294  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77146.2us
I20260709 12:59:10.343084  4917 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:10.415956  4917 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:10.417090  5301 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:10.418769  4917 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:10.418959  5279 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.419591  1746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:10.420260  1746 raft_consensus.cc:606] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.420670  1746 raft_consensus.cc:614] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:10.421012  5305 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:59:10.419732  1673 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
W20260709 12:59:10.422917  1715 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.965s (SENT)
I20260709 12:59:10.423594  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:10.425172  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.986s (SENT)
W20260709 12:59:10.426852  1715 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.089s (SENT)
I20260709 12:59:10.454820  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:10.455664  1601 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:10.455443  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:10.440902  5297 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:59:10.463335  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:10.463414  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:10.467267  1603 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:10.467579  1598 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:10.468565  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47190.7us
I20260709 12:59:10.439093  5306 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:10.411202  5198 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:10.479343  1746 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:10.446465  5300 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:10.494055  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.480846  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:10.480906  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.484534  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.498131  1750 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:10.386637  5248 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:59:10.498497  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:10.499325  1744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:10.500463  1744 raft_consensus.cc:606] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.500994  1744 raft_consensus.cc:614] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:10.446219  4917 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:59:10.502923  5287 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:10.505493  2312 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:10.479252  5255 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:10.502825  5228 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.507283  5228 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.508754  5181 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.509377  4827 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:10.509938  5228 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.511023  1745 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:10.511157  5181 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:10.511273   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:10.512614  5194 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:10.513051  5194 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:10.513475  5198 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:10.513923  5194 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.515039  5194 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:10.490561  5244 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:10.516109  5244 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.516476  5244 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.521790  1743 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:10.525046  5300 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.525650  5300 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.528162  5300 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:10.460753  5199 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:59:10.529264  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 89821.5us
I20260709 12:59:10.530589  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 184) took 6957 ms. Trace:
I20260709 12:59:10.529836   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:10.530169  5054 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:59:10.531883  1744 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:10.535439  1748 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:10.538331  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.540350  1752 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:10.545980  1751 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
W20260709 12:59:10.547101  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 63165.8us
I20260709 12:59:10.544183  1598 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:10.555786  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.523339  1750 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:10.554625  1747 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:10.559654  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.560571  1744 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:10.561151  1747 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:59:10.561915  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5488977130000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 12:59:10.562357  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5407977130000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:59:10.562665  1566 connection.cc:256] RPC call timeout handler was delayed by -1.320297713000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 12:59:10.562961  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3175977130000547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:59:10.563282  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3130977130000474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 12:59:10.563583  1748 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:10.563611  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3112977130000445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 12:59:10.564443  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3085977130000401s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:59:10.564749  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3049977130000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 12:59:10.565490  1566 connection.cc:256] RPC call timeout handler was delayed by -1.277097713000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 12:59:10.566995  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2536977130000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:59:10.567523  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2509977130000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:59:10.568178  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2509977130000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:59:10.568970  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2203977130000681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 12:59:10.569106  1746 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:10.544555  5219 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:10.569485  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1546977130000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:59:10.574236  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1366977130000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 12:59:10.574824  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1186977130000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
I20260709 12:59:10.539856  1496 rpcz_store.cc:276] 0709 12:59:03.566327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.580517 (+ 14190us) service_pool.cc:224] Handling call
0709 12:59:03.683577 (+103060us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:59:10.523473 (+6839896us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:08.149003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:08.151369 (+  2366us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:08.151437 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:59:08.151457 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:08.152672 (+  1215us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:08.152762 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:08.152801 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:59:08.154656 (+  1855us) tablet.cc:701] Row locks acquired
0709 12:59:08.154716 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:59:08.154922 (+   206us) write_op.cc:270] Start()
0709 12:59:08.155096 (+   174us) write_op.cc:276] Timestamp: P: 1783601948154846 usec, L: 0
0709 12:59:08.155118 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:08.175739 (+ 20621us) log.cc:844] Serialized 3563 byte log entry
0709 12:59:08.837778 (+662039us) op_driver.cc:464] REPLICATION: finished
0709 12:59:09.074775 (+236997us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b18002d27a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:09.075001 (+   226us) write_op.cc:301] APPLY: starting
0709 12:59:09.075117 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:09.075418 (+   301us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:09.075450 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:09.202863 (+127413us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:09.291389 (+ 88526us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:59:09.296119 (+  4730us) write_op.cc:312] APPLY: finished
0709 12:59:09.303102 (+  6983us) log.cc:844] Serialized 65 byte log entry
0709 12:59:09.323234 (+ 20132us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.323400 (+   166us) write_op.cc:454] Released schema lock
0709 12:59:09.323468 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:09.324030 (+   562us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.324068 (+    38us) write_op.cc:454] Released schema lock
0709 12:59:09.349411 (+ 25343us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b18002d27a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0557 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
Metrics: {"mutex_wait_us":70821,"reported_tablets":45,"spinlock_wait_cycles":39057664,"child_traces":[["op",{"apply.queue_time_us":76927,"apply.run_cpu_time_us":5146,"apply.run_wall_time_us":248983,"num_ops":8,"prepare.queue_time_us":99006,"prepare.run_cpu_time_us":65937,"prepare.run_wall_time_us":168701,"raft.queue_time_us":71111,"raft.run_cpu_time_us":13885,"raft.run_wall_time_us":95924,"replication_time_us":682463,"spinlock_wait_cycles":124478592,"thread_start_us":224335,"threads_started":4,"wal-append.queue_time_us":217146,"wal-append.run_cpu_time_us":18784,"wal-append.run_wall_time_us":1919221}]]}
W20260709 12:59:10.575250  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0799977130000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:59:10.576853  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0556977130000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 12:59:10.577477  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0484977130000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:59:10.578711  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0439977130000671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:59:10.561779  5181 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:10.566013  5228 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:10.591423  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94334.6us
I20260709 12:59:10.625098  4917 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:10.625255  5228 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.628295  5228 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.577131  5219 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:10.587684  5213 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 12:59:10.652745  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:10.654358  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52970.3us
I20260709 12:59:10.667034  5228 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:10.670554  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:10.669451  1749 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:10.683605  1595 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:59:10.688261  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 104438us
I20260709 12:59:10.688319  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.690522  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.689479  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:10.692217  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.690183  1747 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:10.699314  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.701983  5300 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:10.697062  5273 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:10.671657  5312 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:10.686847  5228 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:10.705827  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.706444  5228 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:10.682292  4917 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:10.710968  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:10.713491  1600 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:10.713585  5273 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:10.670390  5213 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.713079  5219 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.710701  5199 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.717065  5199 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.714823  5310 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.720170  5213 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.713517  4917 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.721411  4917 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.729288  1501 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:10.749899  4917 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.714401  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.756173  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.758175  1751 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:10.764530  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 50258us
I20260709 12:59:10.767601  5231 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:10.770232  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59359.5us
I20260709 12:59:10.771872  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:10.773438  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.774389  1743 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:10.775220  1752 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:10.701124  5244 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:10.773102  5176 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:10.785243  4917 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.791805  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:10.793015  1600 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.804692  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.813153  1599 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:10.819967  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:10.822090  1601 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:59:10.822861  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51157.1us
I20260709 12:59:10.822088  1750 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:59:10.810137  5273 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:10.824024  1750 pending_rounds.cc:85] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 7
I20260709 12:59:10.824334  1750 pending_rounds.cc:107] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:59:10.826766  1599 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:10.828621  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:10.829435  1601 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:10.830466  1600 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:10.808374  4917 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:10.824604  1750 raft_consensus.cc:2889] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.832401  1566 leader_election.cc:400] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:10.834443  1566 leader_election.cc:403] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:10.836894  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.837862  1750 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.821723  5199 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:10.843823  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:10.823392  5176 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.850690  5228 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:10.865485  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:10.865697  1750 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:10.866283  1600 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.883510  1600 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:10.886148  1743 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:10.886904  1750 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:10.890393  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:10.893541  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 65461us
I20260709 12:59:10.892516  5176 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:10.900378  1599 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:10.907346  1750 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:10.909863  5181 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.907626  1600 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:10.910512  5181 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:10.915279  1600 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:10.918308  1600 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:10.918934  5219 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.924216  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:10.886901  5194 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:10.929359  5299 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.607s	user 0.007s	sys 0.014s
I20260709 12:59:10.933455  1678 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:10.936817  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:10.937817  1751 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.946458  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:10.948536  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:10.953379  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:10.954495  1752 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:10.957633  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:10.957873  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.958374  1673 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.962296  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.960988  1600 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:10.968464  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:10.969961  1676 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:10.970593  1600 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:10.944344  5194 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:10.977504  1752 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:10.978859  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:10.979986  1676 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:10.980614  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56541.5us
I20260709 12:59:10.960215  5327 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:10.980151  1751 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:10.983762  1600 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:59:10.983871  1566 leader_election.cc:400] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7.
I20260709 12:59:10.984285  1600 pending_rounds.cc:85] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
I20260709 12:59:10.984658  1566 leader_election.cc:403] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:10.984798  1600 pending_rounds.cc:107] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:59:10.985397  1600 raft_consensus.cc:2889] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.975070  5194 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:10.980254  5231 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:10.988579  5244 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:10.997427  1595 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:11.008267  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:11.009143  2313 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.011022  1752 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:11.012542  1750 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:11.013681  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:11.031437  4827 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:11.032229  4827 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:11.035117  4827 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:11.035990  5244 raft_consensus.cc:2764] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:11.012487  4998 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:11.056190  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:11.058531  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:11.066123  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 84529.1us
I20260709 12:59:11.067830  1751 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:11.071981  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.038254  5327 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 6. Current term is 7.
I20260709 12:59:11.073791  1676 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:11.068567  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:11.066577  4998 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:11.083050  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:11.071628  5300 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.093900  1673 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:11.095250  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:11.072767  4827 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:11.099658  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.091027  5228 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.115635  4917 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:59:11.119108  5325 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 12:59:11.098853  5255 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:11.130595  5255 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:11.131655  5255 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.132943  5255 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.099478  4827 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.136147  4827 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.137295  5199 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:11.127300  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:11.140532  5320 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.143779  5222 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.144515  5300 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:11.145151  5300 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:11.101392  4936 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:11.145921  4936 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:11.146236  5300 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.146468  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:11.146862  4936 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:11.148695  5336 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:11.153450  5332 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:11.154300  5332 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.154785  5332 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:11.160693  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:11.163733  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91879.9us
I20260709 12:59:11.164923  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.166203  5228 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.167917  5222 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:11.170115  5222 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:11.171964  5222 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.143034  5320 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:59:11.176976  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:11.178864  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.179032  5199 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:11.181020  5199 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:11.182662  5199 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.185966  5194 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.231873  5219 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:11.190080  5181 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:11.248929  5181 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:11.182862  4998 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:11.217170  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 121997us
I20260709 12:59:11.250229  4998 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.252938  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:11.254918  5273 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:11.255638  5273 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:11.256719  5273 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:11.222649  5286 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:11.265103  5286 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.258167  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:11.167985  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.266512  2313 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:11.267011  5228 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:11.268159  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 100275us
I20260709 12:59:11.269071  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.269920  5228 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.271489  1566 leader_election.cc:400] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:59:11.271888  1566 leader_election.cc:403] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.272563  5228 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 5. Current term is 6.
I20260709 12:59:11.273905  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.275808  5228 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.278378  5194 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:11.279783  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:11.288347  4827 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.289170  2313 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:11.291030  4827 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:11.291049  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:11.296078  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:11.303028  1677 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.316639  5198 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.319074  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45257.4us
I20260709 12:59:11.320034  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.321174  5231 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:11.329073  1597 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:11.322954  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.317365  5198 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.319852  5332 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.309748  5181 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:11.351853  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.325085  5340 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.359112  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.337047  4827 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.433863  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61287.5us
W20260709 12:59:11.421550  5351 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:59:11.435012  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.443990  1749 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:11.458973  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.535509  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 92) took 1190 ms. Trace:
W20260709 12:59:11.533668  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 210777us
I20260709 12:59:11.536909  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.544027  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.536164  1501 rpcz_store.cc:276] 0709 12:59:10.247909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.253569 (+  5660us) service_pool.cc:224] Handling call
0709 12:59:11.438517 (+1184948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:10.780836 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:10.781811 (+   975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:10.781867 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:59:10.781898 (+    31us) tablet.cc:662] Decoding operations
0709 12:59:10.782427 (+   529us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:10.782542 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:10.782598 (+    56us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:10.814517 (+ 31919us) tablet.cc:701] Row locks acquired
0709 12:59:10.817936 (+  3419us) write_op.cc:260] PREPARE: finished
0709 12:59:10.822832 (+  4896us) write_op.cc:270] Start()
0709 12:59:10.827883 (+  5051us) write_op.cc:276] Timestamp: P: 1783601950822201 usec, L: 0
0709 12:59:10.832064 (+  4181us) op_driver.cc:348] REPLICATION: starting
0709 12:59:10.874040 (+ 41976us) log.cc:844] Serialized 536 byte log entry
0709 12:59:11.333872 (+459832us) op_driver.cc:464] REPLICATION: finished
0709 12:59:11.415974 (+ 82102us) write_op.cc:301] APPLY: starting
0709 12:59:11.416119 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:11.416280 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:11.416477 (+   197us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:11.416858 (+   381us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:11.417148 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:11.417228 (+    80us) write_op.cc:312] APPLY: finished
0709 12:59:11.417547 (+   319us) log.cc:844] Serialized 23 byte log entry
0709 12:59:11.417810 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.417941 (+   131us) write_op.cc:454] Released schema lock
0709 12:59:11.418001 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:11.432652 (+ 14651us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.447468 (+ 14816us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":274847,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":81728,"apply.run_cpu_time_us":2579,"apply.run_wall_time_us":2589,"num_ops":1,"prepare.queue_time_us":22345,"prepare.run_cpu_time_us":32040,"prepare.run_wall_time_us":207580,"raft.queue_time_us":135175,"replication_time_us":501579,"thread_start_us":332926,"threads_started":4,"wal-append.queue_time_us":166025}]]}
I20260709 12:59:11.369408  4827 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:11.615525  4827 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:11.396126  5255 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 12:59:11.395653  5213 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 12:59:11.367657  5340 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.634450   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:11.425370  5222 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:59:11.425613  5219 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 12:59:11.395969  4936 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 12:59:11.562690  5181 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:11.647759  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 212852us
W20260709 12:59:11.610792  5328 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:11.433313  5285 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.188s
I20260709 12:59:11.563216  5228 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:11.666375  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.429186  5320 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.182s
W20260709 12:59:11.625523  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 80188us
I20260709 12:59:11.692715  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.568467  5360 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.622208  5231 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:11.690418  5331 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:11.699947  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:11.697031  5349 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
I20260709 12:59:11.727108  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:11.699877  5253 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:11.730926  1597 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:11.704624  5228 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:11.736213  5327 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.732601  5360 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:11.805899  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58733.1us
W20260709 12:59:11.807201  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 126941us
I20260709 12:59:11.807928  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:11.750249  5198 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:11.835243  1677 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:59:11.837203  1677 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:59:11.851670  5353 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:59:11.852792  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:11.853549  5347 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:59:11.854744  5287 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:11.855556  5287 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.858572  5287 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:11.827447  5327 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:11.828495  5320 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:11.841250  5205 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:11.744696  5181 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:11.898346  5287 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.927754  5377 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:11.928859  5377 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:11.930169  5377 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:11.931643  5359 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:59:11.902930  4936 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:11.911589  5228 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:11.939941  4936 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:11.941859  5362 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:59:11.942512  5374 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:59:11.897064  5320 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:11.945647  5320 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:11.949436  5246 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:11.950727  5366 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.078s	user 0.000s	sys 0.002s
I20260709 12:59:11.950232  5246 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:11.909968  5205 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:11.954885  5205 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:11.956748  5340 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:11.907100  5250 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:59:11.967679  2279 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.299s (SENT)
I20260709 12:59:11.968626  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:11.968716  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:11.969970  1746 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:11.974946  1715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.036s	sys 0.038s
W20260709 12:59:11.975579  1715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.036s	sys 0.038s
W20260709 12:59:11.976002  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 616025us
I20260709 12:59:11.980408  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:11.983248  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:11.987602  1677 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:12.002506  1676 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:11.872611  5360 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:12.014683  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:12.015799  1602 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.000s	sys 0.017s
W20260709 12:59:12.017131  1602 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.017s
W20260709 12:59:12.018244  1600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.010s	sys 0.007s
W20260709 12:59:12.018805  1600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.011s	sys 0.007s
W20260709 12:59:12.019218  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 155672us
I20260709 12:59:12.020088  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:12.021770  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:12.044740  5250 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:12.048791  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 188087us
I20260709 12:59:12.053866  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.054802  1601 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
W20260709 12:59:12.056783  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 72409.5us
I20260709 12:59:12.060410  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.060705  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.061494  1594 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:12.063825  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.065958  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.066723  1601 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:12.048030  5320 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:12.051671  5246 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.069108  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.079022  1601 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:12.072373  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:12.048447  5250 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:12.073613  5379 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.074270  5371 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:12.057480  5375 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:12.084288  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.081256  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.084823  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.083527  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.085793  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:12.092089  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:12.092604  5354 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.093132  5354 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.093997  5356 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.094177  5176 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:12.094794  5176 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:12.094640  5356 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.096213  1751 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:59:12.080103  4917 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:59:12.097148  5356 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.097910  5373 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:12.098548  5373 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:12.088734  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.099632  5373 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.100409  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.101065  1595 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:12.101858  5337 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.572s	user 0.005s	sys 0.006s
I20260709 12:59:12.103497  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:12.087327  4936 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:12.068557  5374 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:12.105930  5354 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.092170  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.107729  1743 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:12.092970  5250 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.079366  5320 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:12.115525  1746 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:12.117596  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.118413  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:12.118855  1748 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:12.119061  1745 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.123183  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:12.124161  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:12.124727  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:12.125765  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.125808  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:12.128571  5387 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:12.130008  5332 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:12.131275  5320 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.090050  5379 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.140012  5379 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.127075  5370 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:12.141160  5370 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.141522  5370 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:12.153549  1745 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:12.156545  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.172631  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.175839  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:12.179839  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58992.2us
I20260709 12:59:12.184929  5365 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.185714  5365 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.187909  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.188685  1599 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:12.170938  5340 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.200799  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.201853  1673 raft_consensus.cc:2368] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11.
I20260709 12:59:12.208097  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.210808  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.213186  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.215986  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.218825  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.219616  1677 raft_consensus.cc:2376] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12. Re-sending same reply.
I20260709 12:59:12.221638  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.224885  1678 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 12:59:12.229164  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.235071  1674 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:12.211198  1603 raft_consensus.cc:2955] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:12.240494  2312 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:12.216089  5379 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:59:12.206833  5340 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.226971  5354 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:59:12.246726  5340 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.171833  5176 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.248359  5387 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:12.250735  2313 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:12.257496  1595 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:12.259210  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.268674  1599 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:12.272043  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.201629  5370 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:12.273345  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.294094  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.298058  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.301950  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.302958  1599 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:12.310930  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.313604  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:12.276624  5181 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:59:12.320910  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.298405  5285 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:12.344776  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.345899  1595 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.330552  1497 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.371155  1497 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.373246  1497 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.394532  1595 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:12.407651  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.409786  1595 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:12.375497  1497 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193), pending config changed. New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:59:12.417317  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 120708us
I20260709 12:59:12.422539  1497 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.417196  5379 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.465839  5379 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.469817  5379 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.470655  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:12.445891  5400 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:59:12.479302  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.481191  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.482225  1746 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:12.461782  5370 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.483258  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:12.303646  5388 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 12:59:12.507491  1746 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:12.487402  1497 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:12.532461  1497 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.535220  1497 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.544543  1497 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.551234  1744 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:12.571966  5356 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.584654  5356 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.583639  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 6 to 7, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.610293  1497 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:12.619900  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1816) took 1292 ms. Trace:
I20260709 12:59:12.620573  1596 rpcz_store.cc:276] 0709 12:59:11.323821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.447191 (+123370us) service_pool.cc:224] Handling call
0709 12:59:11.531502 (+ 84311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:11.531986 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.532013 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:11.562844 (+ 30831us) log.cc:844] Serialized 52 byte log entry
0709 12:59:12.012961 (+450117us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:12.036771 (+ 23810us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.596182 (+559411us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180034fe40. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 12:59:12.596425 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.596547 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.596606 (+    59us) raft_consensus.cc:1685] finished
0709 12:59:12.615905 (+ 19299us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.616162 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10025,"prepare.queue_time_us":29651,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":4413,"raft.queue_time_us":572836,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":85128,"spinlock_wait_cycles":7207680,"thread_start_us":391343,"threads_started":1,"wal-append.queue_time_us":557043}
I20260709 12:59:12.626029  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.627583  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.641577  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.643247  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.646147  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.647207  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:12.649677  1594 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:12.652408  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.654001  5332 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:12.654225  5287 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:12.649523  5255 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:59:12.652434  5219 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:12.658732  5219 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:12.649714  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.661500  1603 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:12.663306  1595 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:12.664009  5219 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.666136  1595 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:12.666639  1595 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:12.667742  1595 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.669071  1595 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:12.674714  1603 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:12.696453  1595 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:59:12.697075  1595 pending_rounds.cc:85] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
I20260709 12:59:12.697395  1595 pending_rounds.cc:107] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:59:12.697716  1595 raft_consensus.cc:2889] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:12.699695  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:12.701838  1599 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.710875  1595 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:12.711877  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.713872  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.715467  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1805) took 1408 ms. Trace:
I20260709 12:59:12.643991  5326 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.726468  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:12.715986  1602 rpcz_store.cc:276] 0709 12:59:11.306988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.307120 (+   132us) service_pool.cc:224] Handling call
0709 12:59:11.335595 (+ 28475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.335796 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:12.018504 (+682708us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.714225 (+695721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:12.714428 (+   203us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:12.714576 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.714850 (+   274us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.715355 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":550862,"prepare.queue_time_us":346812,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":577129,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10189,"thread_start_us":812119,"threads_started":3,"wal-append.queue_time_us":87701}
W20260709 12:59:12.722570  5386 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:59:12.713052  5244 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:12.741339  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.687348  4936 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:59:12.753808  1602 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:12.731266  5176 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:12.791222  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 100794us
I20260709 12:59:12.755434  5405 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.736289  5326 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.741417  5356 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.773324  5379 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.836755  1599 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:12.756568  5244 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.840217  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1819) took 1502 ms. Trace:
I20260709 12:59:12.850855  1597 rpcz_store.cc:276] 0709 12:59:11.337568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.737897 (+400329us) service_pool.cc:224] Handling call
0709 12:59:11.738450 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.879028 (+140578us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:11.880280 (+  1252us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.598915 (+718635us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.599646 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.599845 (+   199us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:12.599893 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.599995 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.839954 (+239959us) raft_consensus.cc:1685] finished
0709 12:59:12.839983 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.840149 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529088,"prepare.queue_time_us":284,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":653453,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":52410,"thread_start_us":315625,"threads_started":2,"wal-append.queue_time_us":278099}
I20260709 12:59:12.813120  5387 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.892441  2312 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:12.906090  5411 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:59:12.913694  5397 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.492s	user 0.004s	sys 0.000s
W20260709 12:59:12.915963  5410 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:12.901903  4936 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:12.916126  5365 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.918008  5326 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:12.927268  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1808) took 1614 ms. Trace:
I20260709 12:59:12.816027  5176 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:12.962756  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67051.6us
I20260709 12:59:12.850273  5379 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.952711  1600 rpcz_store.cc:276] 0709 12:59:11.313223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.313367 (+   144us) service_pool.cc:224] Handling call
0709 12:59:11.313638 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.313860 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:12.019399 (+705539us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.926723 (+907324us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:12.926813 (+    90us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:12.926884 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.926985 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.927172 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520646,"prepare.queue_time_us":118624,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":11986,"raft.queue_time_us":574248,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3687,"thread_start_us":1074406,"threads_started":3,"wal-append.queue_time_us":170383}
I20260709 12:59:12.902879  5354 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.818173  5405 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:12.945446  5356 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.894068  4998 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:12.952597  5259 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:12.979573  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:12.962365  5365 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:12.903014  5387 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.015483  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.017581  5255 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:13.017982  5375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.011s	sys 0.018s
W20260709 12:59:13.018422  5375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.018s
I20260709 12:59:13.018020  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:12.956881  4936 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.028792  5387 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:13.029646  4936 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:12.994174  5259 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.030473  5176 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:13.031984  5421 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:59:13.032377  5259 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:13.033084  5418 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:59:13.039386  5405 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:12.984525  5354 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.040437  5244 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:13.041947  5354 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:13.042414  5379 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:12.991791  5356 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.024868  5253 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.983572  5250 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:59:13.072496  5356 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:13.073778  5231 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:13.074065  5380 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:13.015090  5365 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:13.076689  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 953430us
I20260709 12:59:13.100355  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.077911  5327 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:13.056484  5405 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:13.101703  5358 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:13.101938  5231 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.102568  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:13.116341  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:13.104135  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:13.098824  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:13.097610  5259 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:13.120048  1601 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:13.111672  5255 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.989229  4998 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.140316  1597 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:13.145388  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45158.5us
I20260709 12:59:13.146770  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.111445  5250 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.111155  5385 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.174811  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.142521  5356 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.179014  5356 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.193569  1601 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:13.179193  5365 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:13.205756  5228 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:13.149137  5380 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:13.213577  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.217154  5228 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:13.217617  5396 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.894s	user 0.000s	sys 0.003s
I20260709 12:59:13.219038  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1765) took 1101 ms. Trace:
I20260709 12:59:13.219491  1752 rpcz_store.cc:276] 0709 12:59:12.117397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.119162 (+  1765us) service_pool.cc:224] Handling call
0709 12:59:12.119641 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.148150 (+ 28509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.148185 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.148828 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.269860 (+121032us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:12.367859 (+ 97999us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.442392 (+ 74533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.442508 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.079487 (+636979us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:13.218635 (+139148us) raft_consensus.cc:1685] finished
0709 12:59:13.218757 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.218939 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158723,"prepare.queue_time_us":54787,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":103702,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":246,"spinlock_wait_cycles":223678976,"thread_start_us":177632,"threads_started":2,"wal-append.queue_time_us":174012}
I20260709 12:59:13.222774  1752 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:13.223594  5365 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.224574  5365 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:13.225946  5394 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.809s	user 0.000s	sys 0.002s
I20260709 12:59:13.181974  5385 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.230556  5385 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.232664  5356 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.117710  5358 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:13.235437  5358 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:13.112582  5327 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.238534  5327 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.211838  5422 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 12:59:13.241091  5422 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:13.291086  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77626.1us
I20260709 12:59:13.292434  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.241662  5422 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:13.296151  5228 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:13.297856  5419 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:13.144294  5255 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.299162  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:13.300940  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.299896  1749 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:13.301690  5358 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.302309  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:13.303371  5358 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.310111  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:13.311367  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.312383  5358 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.174012  5250 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.312400  5228 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:13.297744  5422 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.344386  5422 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:13.340925  1603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.032s
I20260709 12:59:13.308769  5327 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:13.345999  1603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.005s	sys 0.032s
I20260709 12:59:13.339857  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:13.369758  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:13.391386  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.383534  5380 raft_consensus.cc:2764] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:59:13.393313  5377 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:13.367914  5327 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:13.407232  5320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.016s	sys 0.022s
W20260709 12:59:13.436300  5320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.016s	sys 0.023s
I20260709 12:59:13.400200  5231 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.443890  5255 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.444397  5417 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:13.515200  5417 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.516044  5250 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.517050  5327 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.517970  5417 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:13.519586  5440 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:13.521780  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1782) took 1093 ms. Trace:
I20260709 12:59:13.522635  5434 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.524895  5423 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.525511  5216 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:13.525561  5423 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.526161  5216 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.411849  5356 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.528347  5356 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.395220  5360 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:59:13.525039  5222 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.533886  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1783) took 1105 ms. Trace:
I20260709 12:59:13.522199  1746 rpcz_store.cc:276] 0709 12:59:12.428348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.956713 (+528365us) service_pool.cc:224] Handling call
0709 12:59:12.974823 (+ 18110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.975200 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.975238 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.981214 (+  5976us) log.cc:844] Serialized 26 byte log entry
0709 12:59:13.153870 (+172656us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:13.153932 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.154010 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.521536 (+367526us) raft_consensus.cc:1685] finished
0709 12:59:13.521559 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.521704 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":376,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11003,"thread_start_us":171117,"threads_started":1,"wal-append.queue_time_us":411739}
I20260709 12:59:13.534447  1751 rpcz_store.cc:276] 0709 12:59:12.428695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.991399 (+562704us) service_pool.cc:224] Handling call
0709 12:59:12.991874 (+   475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:12.992396 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.992442 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:13.025589 (+ 33147us) log.cc:844] Serialized 52 byte log entry
0709 12:59:13.397932 (+372343us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:13.427617 (+ 29685us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.431117 (+  3500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.431243 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.533235 (+101992us) raft_consensus.cc:1685] finished
0709 12:59:13.533309 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.533822 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1248,"prepare.queue_time_us":32967,"raft.queue_time_us":9504,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":16232,"spinlock_wait_cycles":6414208,"thread_start_us":324574,"threads_started":1,"wal-append.queue_time_us":462872}
W20260709 12:59:13.548844  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 435516us
I20260709 12:59:13.549465  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:13.527293  5405 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:13.523308  5437 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:59:13.440845  4998 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.554612  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:13.561053  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:13.445581  5377 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:13.564947  5423 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:13.567384  5401 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.150s	user 0.002s	sys 0.000s
I20260709 12:59:13.567750  5211 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:13.523308  5434 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.558537  5327 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.598577  5327 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.569315  5216 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.551117  5222 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.606770  5222 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.606923  5423 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:13.557000  5375 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:13.572563  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:13.607856  5375 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:13.573402  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:13.574220  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1768) took 1454 ms. Trace:
I20260709 12:59:13.609393  5375 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.610052  1747 rpcz_store.cc:276] 0709 12:59:12.120155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.120289 (+   134us) service_pool.cc:224] Handling call
0709 12:59:12.124431 (+  4142us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:12.149704 (+ 25273us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:12.265397 (+115693us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.619980 (+354583us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:13.569078 (+949098us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b2c0013d8c8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 12:59:13.569715 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:59:13.569888 (+   173us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:13.569925 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.569997 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.573866 (+  3869us) raft_consensus.cc:1685] finished
0709 12:59:13.573986 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.574151 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63345,"prepare.queue_time_us":173806,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":26681,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":29424,"spinlock_wait_cycles":13566720,"thread_start_us":185354,"threads_started":2,"wal-append.queue_time_us":575855}
I20260709 12:59:13.575222  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:13.555853  5384 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:13.524832  5253 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.595243  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:13.597128  5434 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.595271  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:13.579449  1676 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:13.634969  5287 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.636969  5287 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.640841  5287 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.607398  5222 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.611532  5375 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:13.613029  5327 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.589969  5360 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:13.595956  5211 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.673736  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:13.607795  5423 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.684785  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:13.686353  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:13.687409  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 296055us
I20260709 12:59:13.684633  5424 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:13.701237  5424 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.701709  5424 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:13.702662  5377 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.674011  5222 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:13.709760  2313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 235) took 1547 ms (client timeout 1786 ms). Trace:
I20260709 12:59:13.710809  5222 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:13.712404  5408 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.701s	user 0.009s	sys 0.003s
I20260709 12:59:13.717175  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.719311  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:13.723186  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:13.710415  2313 rpcz_store.cc:269] 0709 12:59:12.162277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.162412 (+   135us) service_pool.cc:224] Handling call
0709 12:59:13.709469 (+1547057us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b540069e6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:13.709645 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170335104}
I20260709 12:59:13.743003  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1821) took 1134 ms. Trace:
I20260709 12:59:13.743213  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.715356  1594 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 12:59:13.745604  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46532.7us
I20260709 12:59:13.671473  5374 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:59:13.764595  1594 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:13.770524  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1769) took 1649 ms. Trace:
W20260709 12:59:13.771232  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.771847  1669 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:13.713025  5211 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.772547  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1572) took 1492 ms. Trace:
I20260709 12:59:13.773988  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:13.772991  1673 rpcz_store.cc:276] 0709 12:59:12.271945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.272121 (+   176us) service_pool.cc:224] Handling call
0709 12:59:12.293744 (+ 21623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.294134 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.294163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.305892 (+ 11729us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.433616 (+127724us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:12.433685 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.433803 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.711751 (+1277948us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:13.745244 (+ 33493us) raft_consensus.cc:1685] finished
0709 12:59:13.745270 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.764512 (+ 19242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1645,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4290,"spinlock_wait_cycles":7069568,"thread_start_us":127315,"threads_started":1,"wal-append.queue_time_us":644459}
I20260709 12:59:13.778159  1747 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:59:13.744021  5380 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:13.685915  5360 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.771188  1743 rpcz_store.cc:276] 0709 12:59:12.120814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.143837 (+ 23023us) service_pool.cc:224] Handling call
0709 12:59:12.144452 (+   615us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:12.164483 (+ 20031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.164535 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:12.170611 (+  6076us) log.cc:844] Serialized 52 byte log entry
0709 12:59:12.238088 (+ 67477us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:12.310089 (+ 72001us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.330080 (+ 19991us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.330640 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.330734 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.566593 (+1235859us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:13.770205 (+203612us) raft_consensus.cc:1685] finished
0709 12:59:13.770235 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.770435 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76366,"prepare.queue_time_us":119472,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":83,"raft.queue_time_us":23550,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":79666,"spinlock_wait_cycles":34182784,"thread_start_us":72376,"threads_started":2,"wal-append.queue_time_us":119215}
W20260709 12:59:13.782979  5449 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:59:13.784010  5445 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:59:13.839274  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:13.840430  1747 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:13.744277  5327 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:13.789105  5332 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:13.667953  5253 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:13.769134  5358 raft_consensus.cc:2764] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:59:13.764974  5417 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:13.886735  1598 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:59:13.849782  1566 leader_election.cc:400] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11.
I20260709 12:59:13.934131  1566 leader_election.cc:403] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:13.847239  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91274us
I20260709 12:59:13.946444  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:13.952443  5423 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:13.953123  5360 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.955983  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:13.957492  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:13.962404  5450 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:59:13.964534  5447 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:59:13.966234  5451 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:13.968992  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 583) took 1156 ms. Trace:
I20260709 12:59:13.969713  1747 rpcz_store.cc:276] 0709 12:59:12.812333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.853237 (+1040904us) service_pool.cc:224] Handling call
0709 12:59:13.968125 (+114888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.968437 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.968494 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.968563 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:13.968622 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.968710 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.968892 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.980266  5356 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:13.845360  5332 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:13.988575  5332 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:13.990295  5332 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:13.996912  5401 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:59:14.000620  5253 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:14.021880  1749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.012s	sys 0.026s
W20260709 12:59:14.030696  1749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.013s	sys 0.026s
W20260709 12:59:14.037508  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.043s	sys 0.067s
W20260709 12:59:14.039244  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.043s	sys 0.067s
I20260709 12:59:14.041886  1747 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:59:14.044831  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 195205us
I20260709 12:59:14.046132  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:14.047115  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.064522  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 118173us
I20260709 12:59:14.066026  5327 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:14.078986  1595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.027s
W20260709 12:59:14.080988  1595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.002s	sys 0.027s
I20260709 12:59:14.049029  5384 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11.
I20260709 12:59:14.087384  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:14.088675  5457 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:14.089257  5380 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.089458  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:14.089859  5250 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:14.090267  5380 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:14.090508  5457 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:14.090726  5380 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:14.084513  5327 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.092123  5380 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.093470  5380 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.093972  5327 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.094029  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:14.096174  5425 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.181s	user 0.001s	sys 0.023s
I20260709 12:59:14.096354  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.097033  1596 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:14.098310  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.078876  5417 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:14.098902  1596 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
W20260709 12:59:14.069370  5174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.011s	sys 0.026s
I20260709 12:59:14.066211  5374 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:14.100867  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.101672  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.107326  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.108060  1601 raft_consensus.cc:2376] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10. Re-sending same reply.
I20260709 12:59:14.110306  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.111033  1600 raft_consensus.cc:2376] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13. Re-sending same reply.
W20260709 12:59:14.102309  5174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.012s	sys 0.026s
I20260709 12:59:14.113221  5424 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.085256  5198 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.115703  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.118655  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:14.108855  5286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.657s	user 0.020s	sys 0.029s
I20260709 12:59:14.121781  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.126761  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:14.130843  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.144419  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.145496  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.145846  1597 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:14.120404  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.140416  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.142006  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.149772  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:14.150163  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.023s	sys 0.023s
I20260709 12:59:14.149071  1601 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:14.150355  1596 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:14.157827  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:14.157454  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.023s	sys 0.023s
I20260709 12:59:14.161409  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:14.159588  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:14.162098  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 580413us
I20260709 12:59:14.163926  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1837) took 1333 ms. Trace:
I20260709 12:59:14.165968  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.164887  1599 rpcz_store.cc:276] 0709 12:59:12.830921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.848937 (+ 18016us) service_pool.cc:224] Handling call
0709 12:59:12.849431 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.076128 (+226697us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:13.076458 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.565103 (+488645us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:59:14.040720 (+475617us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.049502 (+  8782us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.049718 (+   216us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:14.050038 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.075748 (+ 25710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.075851 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.163660 (+ 87809us) raft_consensus.cc:1685] finished
0709 12:59:14.163692 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.163850 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268593,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":101,"raft.queue_time_us":282172,"raft.run_cpu_time_us":1237,"raft.run_wall_time_us":146405,"spinlock_wait_cycles":5891456,"thread_start_us":963669,"threads_started":2,"wal-append.queue_time_us":691881}
I20260709 12:59:14.169016  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.139338  5198 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.212253  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.215713  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:14.216753  5463 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:59:14.218921  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.168933  5250 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:14.219995  5250 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.220498  5250 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:14.222887  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1789) took 1515 ms. Trace:
I20260709 12:59:14.223331  1749 rpcz_store.cc:276] 0709 12:59:12.707366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.304297 (+596931us) service_pool.cc:224] Handling call
0709 12:59:13.304592 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.305090 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.305131 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.308062 (+  2931us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.031454 (+723392us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:14.083944 (+ 52490us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.085940 (+  1996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.086211 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.222639 (+136428us) raft_consensus.cc:1685] finished
0709 12:59:14.222673 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.222822 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25101,"prepare.run_cpu_time_us":535,"prepare.run_wall_time_us":4107,"raft.queue_time_us":3930,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3092,"spinlock_wait_cycles":17131776,"thread_start_us":722838,"threads_started":1,"wal-append.queue_time_us":846356}
I20260709 12:59:14.225696  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.226450  1676 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:14.227591  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.228493  1597 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:14.229171  5198 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:14.229954  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.167045  5375 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.231308  5375 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:14.220108  5455 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:59:14.152719  5286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.691s	user 0.021s	sys 0.030s
W20260709 12:59:14.245288  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75648.2us
I20260709 12:59:14.168715  5458 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:14.247362  5377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.016s
I20260709 12:59:14.210438  5360 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.286815  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.288409  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.171937  5219 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 12:59:14.302105  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 55005.1us
W20260709 12:59:14.290035  5377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.008s	sys 0.016s
I20260709 12:59:14.293651  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.292073  1749 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:14.313275  1599 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:59:14.318787  1749 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:14.323228   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:14.336493  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.314213  5456 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.343308  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:14.303110  5360 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.294739  5458 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.365226  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1795) took 1130 ms. Trace:
I20260709 12:59:14.347998  5253 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:14.346740  5424 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.389020  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.394515  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.400394  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.401206  1676 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:14.403535  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.346143  5456 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.414521  1670 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:14.414740  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.418973  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:14.418915  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.420555  5377 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:14.421137  5377 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.422022  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:14.424878  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 140764us
I20260709 12:59:14.404294  5434 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.425371  5377 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.430553  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1764) took 2309 ms. Trace:
I20260709 12:59:14.395705  4998 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.409466  5332 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.409047  5221 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.443610  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.433760  1750 rpcz_store.cc:276] 0709 12:59:12.115966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.116130 (+   164us) service_pool.cc:224] Handling call
0709 12:59:12.150365 (+ 34235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.173112 (+ 22747us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:12.984930 (+811818us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18004423c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 12:59:13.113563 (+128633us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.414559 (+300996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.494074 (+ 79515us) log.cc:844] Serialized 26 byte log entry
0709 12:59:13.494254 (+   180us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:13.494296 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.494383 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.107185 (+612802us) raft_consensus.cc:1685] finished
0709 12:59:14.110641 (+  3456us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.424984 (+314343us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000b5ed0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:14.425113 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39386,"prepare.queue_time_us":150718,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":23147,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":12762,"spinlock_wait_cycles":85199872,"thread_start_us":389737,"threads_started":2,"wal-append.queue_time_us":544919}
W20260709 12:59:14.452772  5470 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:59:14.433611  5375 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.456064  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1793) took 1559 ms. Trace:
W20260709 12:59:14.461927  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 207667us
I20260709 12:59:14.468019  1748 rpcz_store.cc:276] 0709 12:59:12.896278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.857399 (+961121us) service_pool.cc:224] Handling call
0709 12:59:13.857793 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:13.957250 (+ 99457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.957293 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:13.958047 (+   754us) log.cc:844] Serialized 52 byte log entry
0709 12:59:14.244636 (+286589us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:14.244678 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.244750 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.455666 (+210916us) raft_consensus.cc:1685] finished
0709 12:59:14.455703 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.455943 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27987,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":78334,"thread_start_us":283842,"threads_started":1,"wal-append.queue_time_us":389058}
I20260709 12:59:14.443171  5417 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.438819  5434 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.476962  5211 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.483404  5458 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.483870  5211 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:14.486483  5211 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.476682  5465 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.488512  5434 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.488204  5465 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:14.489483  5360 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.494160  5456 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.508883  5365 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:14.509829  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.511086  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.451191  4998 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.512627  1669 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:14.513903  4998 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.450699  5332 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.516290  5332 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.517941  5456 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.518404  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:14.457414  5221 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.518612  5456 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:14.518426  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:14.520645  5221 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.520936  5456 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:14.521507  5456 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:14.521607  1674 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:14.523327  5417 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.525622  5417 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.525939  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.527086  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.527208  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.496219  5354 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:14.499078  5469 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:59:14.480513  5467 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:59:14.366036  1747 rpcz_store.cc:276] 0709 12:59:13.234924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.050768 (+815844us) service_pool.cc:224] Handling call
0709 12:59:14.077826 (+ 27058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.078195 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:14.107869 (+ 29674us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.364655 (+256786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.364755 (+   100us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:14.364841 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.364944 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.365131 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4925,"prepare.queue_time_us":30252,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":135,"thread_start_us":256266,"threads_started":1}
I20260709 12:59:14.528887  5354 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.530702  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1791) took 1820 ms. Trace:
I20260709 12:59:14.530809  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 581) took 1824 ms. Trace:
I20260709 12:59:14.533658  2312 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:14.537518  1752 rpcz_store.cc:276] 0709 12:59:12.706179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.229488 (+523309us) service_pool.cc:224] Handling call
0709 12:59:14.530070 (+1300582us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:59:14.530288 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.530475 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.530502 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.530549 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:14.530580 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.530650 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.530754 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84143488}
I20260709 12:59:14.532323  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:14.536346  1743 rpcz_store.cc:276] 0709 12:59:12.710572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.811048 (+1100476us) service_pool.cc:224] Handling call
0709 12:59:13.951865 (+140817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.953047 (+  1182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.953089 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.953707 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.294369 (+340662us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:14.294418 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.294507 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.530473 (+235966us) raft_consensus.cc:1685] finished
0709 12:59:14.530496 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.530639 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":271,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"thread_start_us":340143,"threads_started":1,"wal-append.queue_time_us":442541}
I20260709 12:59:14.539908  5285 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:14.529485  5465 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.541481  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:13.767035  1603 rpcz_store.cc:276] 0709 12:59:12.608713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.680521 (+ 71808us) service_pool.cc:224] Handling call
0709 12:59:12.682899 (+  2378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.809788 (+126889us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:13.347321 (+537533us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.742598 (+395277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.742662 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:13.742717 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.742792 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.742932 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103074,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":24,"raft.queue_time_us":1359,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10012,"thread_start_us":932069,"threads_started":2}
I20260709 12:59:14.542873  5419 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.543481  5419 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.546185  5419 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.536981  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.547022  1747 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:14.542038  5354 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:14.539995  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:14.552518  5174 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:14.553001  5174 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:14.553400  5174 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.554270  5424 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:14.554996  5422 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:14.558395  5250 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.560969  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:14.567732  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:14.568580  2314 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:14.569738  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:14.575009  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.589617  1743 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:59:14.576514  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.576838  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:14.575439  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.577258  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.581285  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:14.581601  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 147576us
I20260709 12:59:14.583772  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.578954  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1784) took 1959 ms. Trace:
I20260709 12:59:14.579936  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.599925  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.592549  1752 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:14.586292  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.599009  1745 rpcz_store.cc:276] 0709 12:59:12.619202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.037649 (+418447us) service_pool.cc:224] Handling call
0709 12:59:13.038018 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.134430 (+ 96412us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:13.149704 (+ 15274us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.410704 (+261000us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.410781 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:13.410846 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.568230 (+1157384us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b18002ff500. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e36e2a6 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419
0709 12:59:14.578690 (+ 10460us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b54000d4b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:14.578747 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.578891 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17615,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":77,"raft.queue_time_us":110,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":20484,"spinlock_wait_cycles":223581184,"thread_start_us":260582,"threads_started":1,"wal-append.queue_time_us":614333}
I20260709 12:59:14.610024  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.610785  1669 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:14.616245  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.617178  1669 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
W20260709 12:59:14.572799  5468 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.228s	user 0.000s	sys 0.002s
I20260709 12:59:14.570731  2312 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:14.647797  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.648877  1594 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:14.649454  1747 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:14.650475  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.650862  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:14.652287  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 71066.7us
I20260709 12:59:14.652549  1748 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:59:14.577579  5466 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 12:59:14.570178  5250 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.639953  5358 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.640143  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.640578  5326 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:14.677380  5326 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.655001  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:14.678691  1745 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:14.578881  5462 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.278s	user 0.003s	sys 0.002s
I20260709 12:59:14.659127  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.663740  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.665000  5417 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.665220  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1790) took 1957 ms. Trace:
I20260709 12:59:14.665524  5419 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.665707  5358 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.666467  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.668032  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.672981  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:14.658581  5360 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.622198  5174 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:14.682123  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:14.688179  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.689875  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.691089  1600 raft_consensus.cc:1813] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Handling vote request from an unknown peer 1a40ab12c220464db732562e88c32c11
I20260709 12:59:14.695412  1600 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:14.691529  1752 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:14.690922  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.685489  1746 rpcz_store.cc:276] 0709 12:59:12.710216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.582462 (+872246us) service_pool.cc:224] Handling call
0709 12:59:13.623479 (+ 41017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.624546 (+  1067us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:13.670121 (+ 45575us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.141891 (+471770us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.162896 (+ 21005us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.163096 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:14.163135 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.163497 (+   362us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.572067 (+408570us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:14.664870 (+ 92803us) raft_consensus.cc:1685] finished
0709 12:59:14.664990 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.665141 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45139,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":221,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":26594,"spinlock_wait_cycles":4385664,"thread_start_us":388617,"threads_started":1,"wal-append.queue_time_us":608129}
I20260709 12:59:14.706727  1600 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:14.707018  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.699390  1745 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:14.661564  5458 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.720677  1598 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:14.722539  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:14.717777  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.678499  5456 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:14.729075  5456 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.730036  5456 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.733165  5456 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.689121  5380 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:59:14.742724  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1850) took 1190 ms. Trace:
I20260709 12:59:14.743011  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.740638  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.741113  1596 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:14.743175  1595 rpcz_store.cc:276] 0709 12:59:13.552514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.552840 (+   326us) service_pool.cc:224] Handling call
0709 12:59:13.553242 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.554120 (+   878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.554151 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.554673 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.081454 (+526781us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:14.081509 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.081611 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.571007 (+489396us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:14.737881 (+166874us) raft_consensus.cc:1685] finished
0709 12:59:14.737903 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.742644 (+  4741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14642,"raft.queue_time_us":3650,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7951,"spinlock_wait_cycles":3734272,"thread_start_us":526419,"threads_started":1,"wal-append.queue_time_us":679234}
I20260709 12:59:14.703373  5375 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:14.742363  5380 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:59:14.779673  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 96227.8us
I20260709 12:59:14.760543  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:14.701134  5419 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.703052  5360 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:14.832520  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.834080  5360 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:14.787920  1752 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:14.693369  5417 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.800663  5419 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.837975  1598 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:14.838994  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:14.839402  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 359856us
I20260709 12:59:14.839834  1594 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:14.801026  5174 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:14.756104  5375 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.740622  5458 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.809996  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:14.856653  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.868734  1594 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:14.817567  5326 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.768407  5380 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:14.835199  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.871469  1599 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:14.835199  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:14.858062  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.858600  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:14.840212  5356 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.812865  5377 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.843660  5375 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.859668  5286 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:14.815785  5358 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.875036  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:14.866613  5417 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:14.905946  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.906587  1673 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:59:14.898541  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1779) took 2733 ms. Trace:
I20260709 12:59:14.903967  1669 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:14.904608  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.905311  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.923055  1744 rpcz_store.cc:276] 0709 12:59:12.165270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.581247 (+415977us) service_pool.cc:224] Handling call
0709 12:59:12.619116 (+ 37869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.620792 (+  1676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.620824 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.104669 (+1483845us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b1800432ac0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e36e2a6 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a
0709 12:59:14.505375 (+400706us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b2c0013d8c8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 12:59:14.506083 (+   708us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.840009 (+333926us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:14.840061 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.840453 (+   392us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.898255 (+ 57802us) raft_consensus.cc:1685] finished
0709 12:59:14.898277 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.898453 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25261,"raft.queue_time_us":3549,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":43950,"spinlock_wait_cycles":53380224,"thread_start_us":333479,"threads_started":1,"wal-append.queue_time_us":332853}
W20260709 12:59:14.934128  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59167.4us
I20260709 12:59:14.934137  1601 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:14.936249  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:14.891887  5419 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:14.945714  1744 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:14.953979  1744 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 12:59:14.966904  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:14.897782  5286 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:14.978495  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.979496  1672 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
W20260709 12:59:14.975427  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 368412us
I20260709 12:59:14.988724  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.989950  1598 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:14.992874  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.993893  1672 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:14.897194  2312 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:14.940214  5465 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:14.997169  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.001964  1669 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:14.998950  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:14.953509  5417 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.946879  5419 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:14.898296  5356 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:14.946417  5332 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:15.035066  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:14.982731  5286 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.043651  1599 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:15.037989  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:15.040934  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:15.045657  1669 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:15.048507  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.051723  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:14.998683  5205 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:15.038074  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:15.067181  1598 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:14.997188  5478 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:15.033954  5358 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:15.078395  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:15.042281  5419 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:14.982343  5380 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.095621  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:15.060861  5205 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:15.136088  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:15.137439  1750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.031s	sys 0.047s
I20260709 12:59:15.090551  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:15.083461  5358 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:15.141681  1750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.031s	sys 0.047s
I20260709 12:59:15.042002  5417 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.063316  5332 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:15.320519  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.640221  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1811) took 1056 ms. Trace:
I20260709 12:59:15.641557  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:15.641894  1751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.006s
W20260709 12:59:15.642365  1751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.008s	sys 0.006s
I20260709 12:59:15.642998  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.643833  5250 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:15.644680  5250 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.645272  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.647119  5250 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:15.643636  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1819) took 1024 ms. Trace:
I20260709 12:59:15.648166  1751 rpcz_store.cc:276] 0709 12:59:14.619208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.619850 (+   642us) service_pool.cc:224] Handling call
0709 12:59:14.620303 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.620595 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:15.093528 (+472933us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.643255 (+549727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.643318 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:15.643369 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.643442 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.643580 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54159,"prepare.queue_time_us":54985,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":120,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":961290,"threads_started":2}
I20260709 12:59:15.171298  5377 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:15.656489  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.021s	sys 0.010s
W20260709 12:59:15.657162  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.021s	sys 0.010s
W20260709 12:59:15.657826  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 601473us
I20260709 12:59:15.131865  5205 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:15.664067  5250 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:15.641796  5380 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:15.176414  5358 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:15.168488  5470 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:59:15.652909  1595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.008s	sys 0.014s
I20260709 12:59:15.654577  5332 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:15.310657  1598 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:15.523445  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.667861  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:15.646955  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:15.668502  1743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.002s	sys 0.014s
I20260709 12:59:15.668272  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:15.678972  1743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.002s	sys 0.014s
W20260709 12:59:15.668788  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.709s (SENT)
I20260709 12:59:15.668380  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:15.320008  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.680137  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:15.679841  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1814) took 1093 ms. Trace:
W20260709 12:59:15.639187  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.680840  1743 rpcz_store.cc:276] 0709 12:59:14.586507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.593404 (+  6897us) service_pool.cc:224] Handling call
0709 12:59:14.593742 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.594006 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:14.675047 (+ 81041us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.679370 (+1004323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.679441 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:15.679500 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.679624 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.679777 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63899,"prepare.queue_time_us":81240,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":75412,"spinlock_wait_cycles":26404608,"thread_start_us":968729,"threads_started":2,"wal-append.queue_time_us":810217}
I20260709 12:59:15.650395  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.673416  1747 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:15.636312  5492 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:59:15.677090  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.682083  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.682930  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.640904  1750 rpcz_store.cc:276] 0709 12:59:14.584257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.584424 (+   167us) service_pool.cc:224] Handling call
0709 12:59:14.584841 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.585158 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:14.610152 (+ 24994us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.639822 (+1029670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.639881 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:15.639947 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.640021 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.640155 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34682,"prepare.queue_time_us":24873,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":88,"thread_start_us":1029203,"threads_started":1}
W20260709 12:59:15.682322  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.742s (SENT) [suppressed 19 similar messages]
I20260709 12:59:15.688390  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:15.689410  1599 raft_consensus.cc:2376] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10. Re-sending same reply.
I20260709 12:59:15.683235  1749 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:59:15.657202  5458 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:15.693965  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:15.695852  5491 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:59:15.679883  5488 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:15.710948  5458 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:15.665251  5250 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.796518  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1872) took 1080 ms. Trace:
I20260709 12:59:15.793622  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1875) took 1041 ms. Trace:
I20260709 12:59:15.804623  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1876) took 1035 ms. Trace:
I20260709 12:59:15.718957  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.842607  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1833) took 1196 ms. Trace:
I20260709 12:59:15.844435  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.737897  5417 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:15.731061  5419 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
I20260709 12:59:15.738718  5458 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:15.730062  5488 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.933274  5419 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.927228  1746 rpcz_store.cc:276] 0709 12:59:14.646433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.749272 (+102839us) service_pool.cc:224] Handling call
0709 12:59:14.798957 (+ 49685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.799384 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.799416 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.800023 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:59:15.000168 (+200145us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:15.000230 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.000343 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.841922 (+841579us) raft_consensus.cc:1685] finished
0709 12:59:15.841968 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.842348 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8384,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":15104,"thread_start_us":199716,"threads_started":1,"wal-append.queue_time_us":657500}
I20260709 12:59:15.936364  5488 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:15.738088  5489 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:59:15.937994  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:15.709532  5502 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:15.933292  5458 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:15.944038  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 325) took 1409 ms. Trace:
I20260709 12:59:15.946604  1749 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 12:59:15.946632  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 229118us
I20260709 12:59:15.927073  1595 rpcz_store.cc:276] 0709 12:59:14.768955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.769259 (+   304us) service_pool.cc:224] Handling call
0709 12:59:14.769701 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.843748 (+ 74047us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:15.143530 (+299782us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.673257 (+529727us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.673698 (+   441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.673778 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:15.673830 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.803983 (+130153us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b5400025dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:15.804074 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.804395 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7396,"prepare.queue_time_us":1331193,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":88,"raft.queue_time_us":3459,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":21131,"spinlock_wait_cycles":189793280,"thread_start_us":811018,"threads_started":2,"wal-append.queue_time_us":568230}
I20260709 12:59:15.926103  1600 rpcz_store.cc:276] 0709 12:59:14.716024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.716349 (+   325us) service_pool.cc:224] Handling call
0709 12:59:14.716756 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.981921 (+265165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.981959 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.999085 (+ 17126us) log.cc:844] Serialized 26 byte log entry
0709 12:59:15.510826 (+511741us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:15.510972 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.511073 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.795755 (+284682us) raft_consensus.cc:1685] finished
0709 12:59:15.795813 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.796196 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16724,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":729407,"threads_started":2,"wal-append.queue_time_us":697282}
W20260709 12:59:15.896679  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 228301us
W20260709 12:59:15.905267  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 234714us
I20260709 12:59:15.906323  5477 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:15.926761  1596 rpcz_store.cc:276] 0709 12:59:14.751867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.752135 (+   268us) service_pool.cc:224] Handling call
0709 12:59:14.752589 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.753073 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.753112 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.753734 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:59:15.097824 (+344090us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:15.097884 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.097989 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.792706 (+694717us) raft_consensus.cc:1685] finished
0709 12:59:15.792804 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.793274 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5037,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":17019,"thread_start_us":343564,"threads_started":1,"wal-append.queue_time_us":716932}
I20260709 12:59:15.954792  5477 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:15.956477  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:15.908358  5332 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.957513  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:15.958077  5332 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:15.931843  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:15.925028  5500 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:15.965592  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:15.965960  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:15.967836  5500 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:15.968663  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:15.971130  5500 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:15.972646  5477 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:15.944592  2313 rpcz_store.cc:276] 0709 12:59:14.534045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.534490 (+   445us) service_pool.cc:224] Handling call
0709 12:59:14.534823 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.535445 (+   622us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:14.913851 (+378406us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.473588 (+559737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.499117 (+ 25529us) log.cc:844] Serialized 26 byte log entry
0709 12:59:15.499345 (+   228us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:15.499398 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.499502 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.898489 (+398987us) raft_consensus.cc:1685] finished
0709 12:59:15.900519 (+  2030us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.943722 (+ 43203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":602737,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":1914,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":15262,"thread_start_us":864778,"threads_started":2,"wal-append.queue_time_us":763233}
I20260709 12:59:15.978972  5250 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:15.982056  5507 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:15.996258  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1830) took 1344 ms. Trace:
I20260709 12:59:16.007937  5332 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.010594  5508 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:16.013141  5508 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.013758  5508 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:16.015354  5508 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.015924  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:16.017221  5508 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.017875  5356 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:16.024711  5488 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:16.052488  5488 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:16.053134  5488 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:16.044011  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.058200  5249 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:16.059353  5249 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.064124  5249 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.056007  5419 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:16.071748  5365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.003s	sys 0.018s
W20260709 12:59:16.072340  5365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.003s	sys 0.018s
I20260709 12:59:16.075192  5221 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:16.075901  5221 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.076673  5221 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:16.077172  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46460.2us
I20260709 12:59:16.000976  1745 rpcz_store.cc:276] 0709 12:59:14.645556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.713681 (+ 68125us) service_pool.cc:224] Handling call
0709 12:59:14.714032 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.714340 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:14.735405 (+ 21065us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.077369 (+341964us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.853152 (+775783us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b180037c900. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 12:59:15.927836 (+ 74684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.961829 (+ 33993us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:15.977675 (+ 15846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.981358 (+  3683us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.989682 (+  8324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68684,"prepare.queue_time_us":35585,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":186063,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":30271,"spinlock_wait_cycles":77751936,"thread_start_us":314007,"threads_started":2,"wal-append.queue_time_us":797851}
W20260709 12:59:16.096704  5485 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.587s	user 0.017s	sys 0.000s
W20260709 12:59:16.120854  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 344186us
I20260709 12:59:16.121935  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.126685  5174 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:16.127277  5174 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:16.127853  5174 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.139423  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.152801  5253 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:16.153394  5253 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.154119  5253 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:16.156235  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.158938  5174 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.162554  5452 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:16.165853  5365 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:16.147342  5375 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.248s	user 0.018s	sys 0.004s
I20260709 12:59:16.148842  5358 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.177453  5365 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.178525  1599 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:16.179651  5358 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.180332  5365 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:16.177517  5375 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.181849  5250 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:16.183898  5380 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:16.184291  5419 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.183653  1496 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:16.184857  5380 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:16.125288  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1707276530000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:59:16.187901  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1703135079999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
I20260709 12:59:16.185045  5419 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.188508  5375 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.190843  5419 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.149416  5205 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:16.150993  5286 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.078s	user 0.007s	sys 0.015s
I20260709 12:59:16.192497  5286 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.193698  5205 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.194049  1677 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.187976  5380 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.195973  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 637) took 1204 ms. Trace:
I20260709 12:59:16.196421  1677 rpcz_store.cc:276] 0709 12:59:14.991825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.992012 (+   187us) service_pool.cc:224] Handling call
0709 12:59:14.992391 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:16.194575 (+1202184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.195581 (+  1006us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400194454. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:16.195883 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762230656}
I20260709 12:59:16.197273  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.200489  5286 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:16.182962  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:16.209555  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1685135079999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
I20260709 12:59:16.217589  5510 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:16.219930  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1390964409999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:59:16.220639  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1351929730000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 12:59:16.222729  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:16.223440  5510 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:16.224072  1677 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:16.224988  5510 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.230293  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.230587  5380 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.231288  1744 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:16.231279  5380 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.233569  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.233898  5380 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.241806  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.243227  1751 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:16.243770  5253 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.245316  5174 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.245471  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.246515  1677 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.249408  5174 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:16.250252  5174 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:16.250700  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:16.251461  5174 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.252135  5253 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.253067  5205 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:16.254624  5205 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.255067  5205 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.263689  5221 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.265404  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:16.266599  5221 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.266700  5516 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:16.267505  5516 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.268021  5516 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:16.271198  5380 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.271946  5380 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:16.275941  1715 connection.cc:256] RPC call timeout handler was delayed by -2.1010135079999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 12:59:16.284485  1715 connection.cc:256] RPC call timeout handler was delayed by -2.0947135079999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 12:59:16.299157  1715 connection.cc:256] RPC call timeout handler was delayed by -1.9680659709999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 12:59:16.305626  5358 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.309026  5358 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.292562  5375 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.320197  5375 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.294816  5419 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.324474  5419 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.325205  5205 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.328670  5205 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.330972  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 167) took 6146 ms. Trace:
I20260709 12:59:16.307026  5365 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.323205  5375 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.333832  5358 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.293913  5380 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.334743  5419 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.291126  5488 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.374890  5488 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.187233  1496 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 3 to 5, term changed from 9 to 10, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to <none>, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:59:16.341260  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.364670  5507 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:16.376509  5507 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.365144  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:16.367388  1715 connection.cc:256] RPC call timeout handler was delayed by -1.7293135080000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2562s for a response
I20260709 12:59:16.370718  5365 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.379498  5507 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.383340  5365 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:16.383050  1496 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:59:16.384690  1715 connection.cc:256] RPC call timeout handler was delayed by -1.6409727189999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 12:59:16.385619  5365 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.385279  1496 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:16.386363  5365 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.387328  1496 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 4 to 8, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:16.389081  5365 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:16.389814  5458 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:16.390893  1715 connection.cc:256] RPC call timeout handler was delayed by -1.4373447140000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 12:59:16.400781  1715 connection.cc:256] RPC call timeout handler was delayed by -1.3691727190000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:59:16.401300  1715 connection.cc:256] RPC call timeout handler was delayed by -1.329572718999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:59:16.401708  1715 connection.cc:256] RPC call timeout handler was delayed by -1.3221447139999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 12:59:16.402081  1715 connection.cc:256] RPC call timeout handler was delayed by -1.1926364160000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 12:59:16.402596  1715 connection.cc:256] RPC call timeout handler was delayed by -1.1188364160000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:59:16.403093  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0914617370000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.40080000000000005s for a response
I20260709 12:59:16.367641  1497 rpcz_store.cc:276] 0709 12:59:10.184362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.184674 (+   312us) service_pool.cc:224] Handling call
0709 12:59:16.330655 (+6145981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:13.300669 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:13.301385 (+   716us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:13.301428 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:59:13.301442 (+    14us) tablet.cc:662] Decoding operations
0709 12:59:13.303700 (+  2258us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:13.303755 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:13.303786 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:59:13.395300 (+ 91514us) tablet.cc:701] Row locks acquired
0709 12:59:13.395327 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:59:13.410016 (+ 14689us) write_op.cc:270] Start()
0709 12:59:13.429356 (+ 19340us) write_op.cc:276] Timestamp: P: 1783601953407069 usec, L: 0
0709 12:59:13.429387 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:59:13.568194 (+138807us) log.cc:844] Serialized 4726 byte log entry
0709 12:59:14.215481 (+647287us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:14.526188 (+310707us) op_driver.cc:464] REPLICATION: finished
0709 12:59:15.087507 (+561319us) write_op.cc:301] APPLY: starting
0709 12:59:15.096465 (+  8958us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:15.236506 (+140041us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:15.242502 (+  5996us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:15.272702 (+ 30200us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:15.272970 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:59:15.273032 (+    62us) write_op.cc:312] APPLY: finished
0709 12:59:15.273398 (+   366us) log.cc:844] Serialized 83 byte log entry
0709 12:59:15.273612 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.273777 (+   165us) write_op.cc:454] Released schema lock
0709 12:59:15.273852 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:16.074662 (+800810us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b540036d180. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9484df7161 00007f9484ecc33d 00007f9484ec53c2 00007f9484ec4b53 00007f9484ec8d61 00007f9484ec8d19 00007f9484ec8ca9 00007f9484ec8c71 00007f9484ec7e9d 000000000038f354 000000000038f199
0709 12:59:16.075311 (+   649us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.075365 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":278423,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":535762,"apply.run_cpu_time_us":27829,"apply.run_wall_time_us":990650,"num_ops":11,"prepare.queue_time_us":542622,"prepare.run_cpu_time_us":32188,"prepare.run_wall_time_us":575682,"raft.queue_time_us":222146,"raft.run_cpu_time_us":25763,"raft.run_wall_time_us":488902,"replication_time_us":1040019,"spinlock_wait_cycles":33559680,"thread_start_us":997658,"threads_started":4,"wal-append.queue_time_us":571911,"wal-append.run_cpu_time_us":14036,"wal-append.run_wall_time_us":2132262}]]}
I20260709 12:59:16.398892  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:16.403532  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0728447139999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 12:59:16.404831  5507 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:16.406597  5458 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.406929  5488 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:16.409768  5221 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.409485  5488 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.410369  5221 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.412114  5488 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:16.404413  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0139487250000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:59:16.404045  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 109560us
I20260709 12:59:16.414470  5365 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:16.416601  5516 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.419201  5516 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.412593  5221 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.417122  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:16.425282  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:16.427783  1751 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.429687  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:16.432296  1677 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.435815  5365 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.437019  5478 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:16.445298  5508 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.445925  5508 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:16.435042  5205 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:59:16.447443  5508 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.449407  5508 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.451483  5205 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.451954  5205 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 12:59:16.445284  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 80317.6us
I20260709 12:59:16.453184  5205 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.454739  5205 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.455372  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.461551  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:16.468308  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:16.469077  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:16.470065  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:16.470769  1672 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:16.472657  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 55710us
I20260709 12:59:16.474010  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:16.475266  5365 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.482964  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:16.485558  1672 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:16.488224  5488 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:16.489261  5488 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.489907  5488 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.492522  1669 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:59:16.497958  1751 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:16.504004  1677 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:16.506875  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.496904  5458 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:16.507180  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:16.520881  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:16.521654  5365 raft_consensus.cc:2764] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:59:16.509126  5478 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:16.528996  5478 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:16.531517  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:16.533203  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.532295  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:16.535949  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.539399  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.540526  5488 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.540678  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.544374  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:16.540957  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:16.545953  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 90789.8us
I20260709 12:59:16.543903  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:16.548035  1596 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:16.544911  1595 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:16.551832  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:16.552870  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:16.553735  1599 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:16.554105  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:16.554970  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:16.556172  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:16.556342  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:16.556939  1743 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.557039  1750 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:16.559173  1597 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:16.524698  5458 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.586040  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:16.587345  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:16.589682  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:16.591821  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.593103  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:16.590586  1600 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:16.604540  1595 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.608660  1599 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:16.610785  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.626993  1669 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:16.635942  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:16.638420  1750 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:16.634222  5488 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:16.664994  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 101051us
I20260709 12:59:16.584380  5478 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.676242  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.651824  5507 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:16.668169  1745 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
W20260709 12:59:16.693073  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 104342us
I20260709 12:59:16.696074  5458 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.698220  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.699821  5221 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.710227  1743 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:59:16.718943  5527 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:16.734827  1599 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
W20260709 12:59:16.739785  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 76830us
I20260709 12:59:16.741074  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.742676  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.748905  1595 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:59:16.717021  5458 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:16.757570  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 59490.5us
I20260709 12:59:16.758875  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.761837  5423 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.763638  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:16.772466  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.802327  5365 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.755856  5488 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.716746  5507 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:16.767490  5332 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:16.824301  5488 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:16.838632  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 110324us
I20260709 12:59:16.841585  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.849213  5507 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:16.850181  2312 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:59:16.817245  5458 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:16.856578  2313 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 4.
I20260709 12:59:16.871093  5534 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:16.892078  5488 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:16.896371  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54973.4us
I20260709 12:59:16.907860  5488 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:16.908588  5488 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:16.910478  5488 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:16.944617  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.947366  5534 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:16.968431  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.979588  5526 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:16.981146  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.985062  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.989996  5526 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:16.989992  5534 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:16.991940  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:16.992058  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:16.993239  5526 raft_consensus.cc:2764] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:59:16.996222  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:16.997540  5526 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:17.000584  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.001606  5526 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.005467  5332 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:17.007098  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 238792us
I20260709 12:59:17.011391  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.012454  5526 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.016062  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:17.017326  5526 raft_consensus.cc:2764] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:59:17.024856  5526 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:17.028223  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.033017  5423 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:17.043565  5534 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:17.046929  5221 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:17.050221  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.052224  5365 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.054476  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:17.058835  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.063948  5365 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:17.064500  5365 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.064918  5365 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.076637  5423 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:17.077258  5423 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.077683  5423 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.087996  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.090552  5527 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:17.093477  5365 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.096520  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:17.345571  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 249146us
I20260709 12:59:17.120622  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:17.348397  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 227841us
I20260709 12:59:17.349412  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.121289  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:17.129329  5549 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:17.155567  5550 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.361935  5550 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.365171  5550 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:17.186448  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.196326  5488 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.367254  5250 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:17.367873  5250 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.368346  5250 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.367955  5488 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.370476  5488 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:17.230916  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 472101us
I20260709 12:59:17.371735  5526 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:17.372674  5548 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:17.373232  5548 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.373596  1746 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:17.247409  5458 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.258409  5249 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.319767  5508 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.331043  5423 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.351078  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.351881  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.379225  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.351748  1669 raft_consensus.cc:606] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.372677  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.380731  5508 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.384395  5249 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.385164  1677 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:17.386763  5249 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:17.382372  5527 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.387379  5423 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.384469  5221 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:17.373636  5548 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.387408  5249 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:17.386036  5508 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.391847  5221 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.400730  5221 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.398283  5488 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.377246  5458 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.389283  5526 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.410967  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.412882  5423 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.414865  5365 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:17.434168  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 55064.3us
I20260709 12:59:17.436962  5526 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:17.439999  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:17.441151  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52291us
I20260709 12:59:17.456013  5458 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.458632  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 7, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:17.468864  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 197) took 6078 ms. Trace:
I20260709 12:59:17.481067  1501 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 9, leader changed from <none> to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:17.480052  1496 rpcz_store.cc:276] 0709 12:59:11.390118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.421991 (+ 31873us) service_pool.cc:224] Handling call
0709 12:59:17.468771 (+6046780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.435677 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.446388 (+ 10711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.446472 (+    84us) write_op.cc:435] Acquired schema lock
0709 12:59:16.446497 (+    25us) tablet.cc:662] Decoding operations
0709 12:59:16.447416 (+   919us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.447526 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.460812 (+ 13286us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:16.463447 (+  2635us) tablet.cc:701] Row locks acquired
0709 12:59:16.463504 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:59:16.471783 (+  8279us) write_op.cc:270] Start()
0709 12:59:16.472010 (+   227us) write_op.cc:276] Timestamp: P: 1783601956471682 usec, L: 0
0709 12:59:16.472042 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.473064 (+  1022us) log.cc:844] Serialized 2113 byte log entry
0709 12:59:16.679357 (+206293us) op_driver.cc:464] REPLICATION: finished
0709 12:59:16.681611 (+  2254us) write_op.cc:301] APPLY: starting
0709 12:59:16.681766 (+   155us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:16.682090 (+   324us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:16.702604 (+ 20514us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:16.758086 (+ 55482us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:16.758429 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:59:16.758475 (+    46us) write_op.cc:312] APPLY: finished
0709 12:59:16.758885 (+   410us) log.cc:844] Serialized 47 byte log entry
0709 12:59:16.767226 (+  8341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.784962 (+ 17736us) write_op.cc:454] Released schema lock
0709 12:59:16.789953 (+  4991us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:16.790778 (+   825us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.790842 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27723,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":1886,"apply.run_cpu_time_us":4354,"apply.run_wall_time_us":109066,"num_ops":5,"prepare.queue_time_us":27908,"prepare.run_cpu_time_us":18036,"prepare.run_wall_time_us":82747,"raft.queue_time_us":69564,"raft.run_cpu_time_us":1849,"raft.run_wall_time_us":1961,"replication_time_us":207136,"thread_start_us":107688,"threads_started":4,"wal-append.queue_time_us":63803}]]}
W20260709 12:59:17.489306  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49484.8us
I20260709 12:59:17.490494  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:17.491581  5526 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:17.495218  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 122638us
I20260709 12:59:17.497440  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.499110  5553 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:17.508556  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 125506us
I20260709 12:59:17.512542  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.511994  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.463126  5221 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.520974  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.509758  5526 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:17.521831  1677 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:17.471441  5548 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.525233  1669 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:59:17.527387  5250 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.529834  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.530331  5250 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.531987  5221 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.525851  5526 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.538053  5526 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.533916  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.539588  5550 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:17.533520  5488 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.537083  5552 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.540498  5458 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.533502  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.544361  5365 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.544971  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:17.545266  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:17.545918  5365 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:17.546326  5249 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:17.540409  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.546854  5249 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.545629  5548 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.546496  5365 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.547258  5249 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.547642  5365 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:17.548014  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.541241  5508 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.549461  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.546716  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.550249  5553 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.547338  5458 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:17.550945  5527 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:17.551081  5553 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:17.547137  5550 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:17.552141  5550 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:17.553205  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:17.553406  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.554692  5552 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.555588  5527 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.556339  5488 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:17.556854  5488 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.557207  5552 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:17.557453  5488 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.565896  5365 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.553068  5550 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.558030  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.568472  5365 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:17.568959  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:17.570001  5553 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:17.570071  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:17.570523  5553 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.571085  5553 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.572810  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.573330  5550 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.573649  1745 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:17.562783  5526 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.575769  5458 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:17.576224  5458 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.576609  5458 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:17.576928  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:17.577600  2313 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.578182  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.579615  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:17.580641  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.580854  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.581249  1747 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:17.582182  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.583128  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.583434  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.583765  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.584031  2312 raft_consensus.cc:2410] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:17.584668  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.585278  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.587635  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.564400  5221 raft_consensus.cc:993] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:17.569082  5556 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:17.570611  5249 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.593602  5250 raft_consensus.cc:1081] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:17.557253  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.594594  2316 raft_consensus.cc:2368] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:59:17.564018  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.546509  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:17.595480  2313 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:17.596829  5365 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:17.600126  5508 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:17.603359  1672 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:59:17.603780  5508 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.604221  5508 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.606446  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.606971  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.608366  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.599051  5249 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:17.597988  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.613965  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.599665  5526 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:17.599131  5488 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.597455  5458 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.615154  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.618530  5221 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:17.635360  5488 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.624074  5508 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.618875  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:17.600011  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53578.9us
I20260709 12:59:17.643772  1746 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:59:17.596661  5553 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.613888  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.632917  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.646224  5553 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.638322  5221 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.646807  5221 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:17.647578  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.648537  5508 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.640208  1677 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:17.643030  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.668884  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.646341  1669 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:17.669916  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.616945  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.597815  5250 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:17.671036  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54213.8us
I20260709 12:59:17.671168  5548 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:17.671674  5548 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.672062  5548 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.673823  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.674685  2315 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:59:17.675112  5488 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.675307  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.675772  5488 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.677421  5556 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:17.677997  5556 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.653621  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 93) took 5947 ms. Trace:
I20260709 12:59:17.681057  1670 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:17.679771  1501 rpcz_store.cc:276] 0709 12:59:11.705997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.706323 (+   326us) service_pool.cc:224] Handling call
0709 12:59:17.653533 (+5947210us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:17.522493 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:17.523123 (+   630us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:17.523163 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:59:17.523183 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:17.523634 (+   451us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:17.523722 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:17.523750 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:17.532551 (+  8801us) tablet.cc:701] Row locks acquired
0709 12:59:17.542506 (+  9955us) write_op.cc:260] PREPARE: finished
0709 12:59:17.542714 (+   208us) write_op.cc:270] Start()
0709 12:59:17.542856 (+   142us) write_op.cc:276] Timestamp: P: 1783601957542660 usec, L: 0
0709 12:59:17.542881 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:17.543709 (+   828us) log.cc:844] Serialized 982 byte log entry
0709 12:59:17.600449 (+ 56740us) op_driver.cc:464] REPLICATION: finished
0709 12:59:17.640511 (+ 40062us) write_op.cc:301] APPLY: starting
0709 12:59:17.640621 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:17.640759 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:17.640908 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:17.641303 (+   395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:17.641488 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:17.641528 (+    40us) write_op.cc:312] APPLY: finished
0709 12:59:17.641735 (+   207us) log.cc:844] Serialized 29 byte log entry
0709 12:59:17.642594 (+   859us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:17.642689 (+    95us) write_op.cc:454] Released schema lock
0709 12:59:17.642736 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:17.667023 (+ 24287us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:17.667076 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19379,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":39489,"apply.run_cpu_time_us":2038,"apply.run_wall_time_us":26697,"num_ops":2,"prepare.queue_time_us":36427,"prepare.run_cpu_time_us":3314,"prepare.run_wall_time_us":21518,"replication_time_us":57367,"thread_start_us":67889,"threads_started":2}]]}
I20260709 12:59:17.685796  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.687791  2315 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:17.687925  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.690294  5556 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.672080  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.691871  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.692790  5549 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:17.693372  5549 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.693838  5549 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:17.696213  5332 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:17.696820  5332 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:17.697259  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:17.697760  5332 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.698731  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:17.703676  5250 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:17.704365  5250 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.704849  5548 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.709146  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:17.677997  5488 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.692822  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.714013  1595 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:17.714910  5550 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.713122  5548 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:17.715442  5550 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:17.641630  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.656267  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.657797  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.659364  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.661868  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.662215  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:17.665874  1675 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:17.678339  5553 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.677850  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:17.717065  2313 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:17.654405  5458 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.717626  2314 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 12:59:17.710258  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0553920429999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 12:59:17.736559  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:17.737406  1672 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.739588  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:17.736790  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:17.740602  1601 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:17.751407  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.755517  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:17.756523  2316 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:17.763190  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:17.748176  5249 raft_consensus.cc:2764] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:17.774596  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:17.777326  1669 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:17.775591  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 97808.1us
I20260709 12:59:17.771797  1500 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.772246  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:17.783749  1672 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:17.784945  2312 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:17.784680  1500 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:17.785079  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.786017  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.764187  5553 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:17.791946  1746 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.793639  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:17.804591  1500 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.805877  1594 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.806452  1500 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.808048  1750 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:17.808079  1500 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.814596  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:17.815670  1602 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.819694  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:17.820686  1598 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:17.837605  1748 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:17.823601  5553 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:17.831166  5250 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.841158  5553 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.826550  1500 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 8, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.846232  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.846828  1669 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
W20260709 12:59:17.847697  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 55624.5us
I20260709 12:59:17.846632  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.849669  1500 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.843396  5250 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.852018  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.851395  1500 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:17.851617  5458 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:17.856612  1500 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.857864  5458 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:17.858050  5365 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:17.857892  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.862056  1750 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:17.861522  1500 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.863777  5458 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.864032  1500 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.865561  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.865769  1500 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.867626  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.868572  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:17.869361  1596 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:17.869212  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:17.870278  1596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:17.870906  1596 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.871245  1596 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.803099  5556 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:59:17.872303  5556 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:17.872519  1599 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:17.872668  5556 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:17.873553  5556 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.874790  5556 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.876161  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:17.867336  1500 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.884703  1500 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.888765  5534 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.862138  1602 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:17.891171  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:17.896679  1602 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:17.881381  5221 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.902050  5221 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.891760  5365 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.894565  5526 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.804230  5549 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:17.882917  1746 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:59:17.792625  5550 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:17.887131  1500 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.909530  1594 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:17.932278  1500 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.940786  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:17.941737  1602 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.935047  1500 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 7, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.947003  1500 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.949730  1500 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.955657  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:17.956442  1594 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 12:59:17.959425  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71283.9us
I20260709 12:59:17.978252  1602 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:17.963224  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.017448  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:17.962255  1500 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.036137  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.040884  1669 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:18.040509  1500 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 6 to 10, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.037572  1594 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:17.951967  5488 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:17.984735  5365 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:59:18.039983  1602 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
W20260709 12:59:18.054181  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.058102  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:18.059235  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.059953  1597 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:18.048521  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.065505  5572 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:18.066215  5572 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.071979  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.071856  5526 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:18.072835  1677 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:18.073065  5526 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:18.065500  1598 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:18.039507  1595 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:18.064836  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:18.054988  1596 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.075798  1750 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:18.080268  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:18.094394  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:18.093952  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.095438  1672 raft_consensus.cc:2368] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:59:18.095266  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.093945  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.098083  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:18.098724  1746 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:18.106560  1594 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 12:59:18.108024  1596 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:17.997973  5534 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:59:18.112362  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.113188  1599 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:18.108361  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:18.115329  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.072991  5551 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:18.114682  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.073622  5526 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.130239  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.135632  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.136397  1599 raft_consensus.cc:2368] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:18.074754  5488 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:18.126021  1699 debug-util.cc:398] Leaking SignalData structure 0x7b08002650a0 after lost signal to thread 434
W20260709 12:59:18.186831  1699 debug-util.cc:398] Leaking SignalData structure 0x7b080010b380 after lost signal to thread 1535
W20260709 12:59:18.188457  1699 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffae0 after lost signal to thread 1627
W20260709 12:59:18.190148  1699 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9d20 after lost signal to thread 1702
W20260709 12:59:18.190567  1699 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca8a0 after lost signal to thread 1703
I20260709 12:59:18.191852  1597 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:18.196759  1669 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:18.198455  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:18.201308  1699 debug-util.cc:398] Leaking SignalData structure 0x7b0800381b40 after lost signal to thread 1776
I20260709 12:59:18.213022  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.214660  1599 raft_consensus.cc:2368] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
W20260709 12:59:18.215593  1699 debug-util.cc:398] Leaking SignalData structure 0x7b080038fd60 after lost signal to thread 2341
W20260709 12:59:18.215761  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 135618us
W20260709 12:59:18.217387  1699 debug-util.cc:398] Leaking SignalData structure 0x7b08003355c0 after lost signal to thread 5485
I20260709 12:59:18.231118  1597 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:18.233374  1597 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:59:18.212497  5249 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:18.238582  1602 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:18.238713  1750 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:18.233985  1597 pending_rounds.cc:85] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 3
I20260709 12:59:18.131791  5551 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.246323  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.247781  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:18.240336  5573 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 12:59:18.269095  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.243768  1597 pending_rounds.cc:107] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 12:59:18.269088  5570 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:18.271319  1597 raft_consensus.cc:2889] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:18.271780  1597 pending_rounds.cc:107] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:59:18.272048  1597 raft_consensus.cc:2889] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:18.274362  1595 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:18.278848  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.283839  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.284705  1677 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:18.258111  5549 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:18.239392  5527 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 12:59:18.295823  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77632.8us
I20260709 12:59:18.296543  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.297005  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.277899  5572 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:18.300644  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 195550us
I20260709 12:59:18.301676  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:18.306092  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:18.306797  1597 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:18.312988  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.313669  1677 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:18.314877  5551 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:18.303115  5249 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:18.316146  5586 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:18.316815  5586 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:18.316478  5249 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.321538  5365 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:18.322252  1675 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:18.324210  5365 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:18.325373  1676 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:18.325501  5365 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:18.325963  5365 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.327207  1677 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:18.326992  5365 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.329030  5365 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:18.340999  5488 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:18.343199  1597 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:59:18.344971  1598 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:18.282189  5526 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.354539  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.369081  5526 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:18.370163  5579 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260709 12:59:18.317901  5586 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.372812  1598 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:18.363461  5578 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:59:18.361436  5587 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:18.375792  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.351634  5527 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:18.379794  5534 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:59:18.391557  5534 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:18.392096  5534 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.393162  5534 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.395089  5534 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:18.396844  1597 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:18.376979  5587 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:18.397403  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.398532  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.411607  5587 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.413602  5587 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:18.417595  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.418684  1597 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:18.431239  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.431753  5574 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:18.432262  5574 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.432814  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.434028  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.433679  5574 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.434798  1677 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:18.435673  5574 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:18.436439  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.437866  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.432278  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.443357  1597 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:18.449798  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.452025  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.442938  5552 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.457985  5250 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:18.458267  5552 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.459803  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:18.444206  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet 516703d5c9f14537854665616191b5aa with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46970
I20260709 12:59:18.461048  5588 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:18.482838  1673 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:18.461530  5588 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.484992  5588 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.486778  5588 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:18.498658  1597 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:59:18.470680  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:18.500550  5250 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:18.463860  5550 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:18.510874  1673 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:18.514437  5552 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:18.515699  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.520752  1600 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:18.522532  1600 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:18.527297  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.532369  1595 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:18.534157  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.523500  1566 leader_election.cc:400] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:59:18.541240  1566 leader_election.cc:403] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:59:18.501459  5572 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:18.546358  1673 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:18.547963  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 246361us
I20260709 12:59:18.548411  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:18.560714  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.564069  5596 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:18.540246  5365 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:18.541725  5250 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:18.571007  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:18.573427  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.576668  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:18.577922  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.588467  5577 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:18.591208  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:18.551028  5488 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
W20260709 12:59:18.608578  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56874.3us
I20260709 12:59:18.608889  1747 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
I20260709 12:59:18.609248  5605 tablet_replica.cc:333] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 12:59:18.551288  5572 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:59:18.623900  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52608.1us
I20260709 12:59:18.581292  5553 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:18.580330  5556 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:18.589291  5577 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:18.636963  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56801.5us
W20260709 12:59:18.638180  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.643882  5556 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:18.610738  5582 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:18.652091  5583 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:18.676733  5583 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.677770  5583 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.678690  5613 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:18.679090  5583 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:18.653386  5603 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:18.547511  5597 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:59:18.681057  5597 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:18.681118  5603 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:18.681495  5597 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.679342  5613 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.656761  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:18.681633  5603 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.638670  5250 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.682667  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:18.684509  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 72928.3us
I20260709 12:59:18.582702  5365 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.674022  5577 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:18.692885  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:18.702739  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.728322  5365 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:18.729498  5597 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.731477  5597 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:18.731997  5582 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:18.734386  5221 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:18.633714  5609 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:59:18.742712  5609 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:18.743238  5603 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.745193  5603 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:18.746655  5613 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:18.744436  5527 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:18.748273  5556 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:18.748351  5527 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.674786  5572 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:18.743157  5609 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:18.695344  5488 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:18.747287  5589 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:18.706799  5553 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.807075  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 115089us
I20260709 12:59:18.768256  5488 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:18.784962  5589 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.799695  5534 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:18.831614  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:18.807374  5587 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.840199  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.843364  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:18.840420  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.844005  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.846200  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.821456  5488 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.851172  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:18.852691  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:18.858057  1673 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:18.860409  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:18.861702  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.823278  5589 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.804312  5553 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.874315  1601 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:18.874758  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:18.874822  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.880532  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:18.880445  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.881839  1595 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 10. Ops: []
I20260709 12:59:18.881335  1745 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:18.885963  1594 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:59:18.886497  1594 pending_rounds.cc:85] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:18.887102  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:18.870612  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:59:18.890892  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 208266us
I20260709 12:59:18.892429  1594 pending_rounds.cc:107] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:59:18.898061  1594 raft_consensus.cc:2889] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:18.899834  5591 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.900511  5591 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.901496  1603 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:18.837204  5609 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.903632  5591 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:18.899189  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.906016  5458 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:18.872454  5587 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.906661  5527 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:18.907514  5526 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:18.907970  5526 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:18.908946  5526 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.920599  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.922087  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:18.921172  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:18.921741  5610 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:18.845412  5534 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:18.945523  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.946941  1598 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:18.960634  5458 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:18.963126  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.963857  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:18.964238  5616 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:18.964602  1676 raft_consensus.cc:606] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:18.964896  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:18.965040  5616 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:18.965970  5584 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:18.966390  5584 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:18.971632  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.971276  1745 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:18.966404  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:18.981093  1750 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:18.986171  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.012719  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:19.014240  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.019387  1751 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:19.024799  1594 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:19.032006  1715 leader_election.cc:400] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:19.036782  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.038304  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:19.044413  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115027us
I20260709 12:59:18.979339  5584 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:19.010267  5458 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:19.049816  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:19.052593  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.056094  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:19.059880  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.060487  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.064857  1751 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:19.061580  1745 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.060468  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:19.029760  5591 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.012598  5553 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.031798  5527 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.063071  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:19.052058  5588 consensus_meta.cc:287] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.005s
I20260709 12:59:19.072120  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.067502  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.082091  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.082918  1744 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:19.084580  1750 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:59:19.085479  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62796.6us
I20260709 12:59:19.088518  1715 leader_election.cc:400] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
W20260709 12:59:19.092979  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.092521  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.068878  5458 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:19.070606  5527 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:19.106705  5616 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:19.107287  5616 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.107713  5616 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.077905  5587 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.109517  1566 leader_election.cc:400] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10.
I20260709 12:59:19.085276  5586 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.107630  5577 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.100145  5622 raft_consensus.cc:2764] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:19.109582  5527 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.120020  1596 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:19.123049  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:19.124559  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.125504  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.090721  5250 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.126675  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.128765  5586 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.092657  5249 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:59:19.131790  5553 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:19.108951  5589 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.133148  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:18.982281  5610 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.054054  5615 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.246s
W20260709 12:59:19.134728  5621 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:19.124644  1745 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:19.147017  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.150216  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.135326  5588 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:19.106901  5569 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:59:19.145583  1746 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:19.160097  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.150087  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.100015  5617 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:19.151087  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66509.3us
I20260709 12:59:19.106777  5458 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.162281  5586 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.146355  5332 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.166605  5584 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.167757  5626 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.151960  5572 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:19.151619  5556 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.183396  5534 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.198498  5577 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.172045  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.172900  1748 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:19.201398  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:19.176697  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.173780  5553 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:59:19.178684  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.202661  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.180522  1750 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:19.181377  1673 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:19.183516  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.203924  5556 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.158490  5588 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:19.215762  5588 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.174235  5582 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.186514  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.188796  5584 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.221415  5584 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.222062  5584 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:19.222980  5618 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:59:19.189743  5551 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:19.204843  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.175962  5574 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.190565  5488 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.224419  5574 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:19.224814  5574 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.225194  5574 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.226543  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.228528  5596 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:19.228963  5609 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.229086  5596 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:19.230197  5596 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.231839  5591 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.159729  5587 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:59:19.232661  5626 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:19.234426  5610 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.205032  1676 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:19.208575  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.209887  5553 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.210489  5534 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.205423  5617 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:19.221515  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.235653  5589 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.243971  5551 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:19.235090  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.244694  5551 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:19.245065  5534 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:19.245820  5551 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.246894  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.241982  5617 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:19.240990  5625 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:59:19.240231  5553 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.249330  5553 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.251829  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.253464  1673 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:19.254258  5526 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.255362  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.252091  5553 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.241329  5584 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:19.260780  5488 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.257181  5613 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:19.262943  5613 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:19.263975  5613 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.265511  5613 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.268568  5605 raft_consensus.cc:2243] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:19.269717  5605 raft_consensus.cc:2272] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:19.242985  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.206724  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:19.276906  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 69146.6us
W20260709 12:59:19.279574  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72869.9us
I20260709 12:59:19.280676  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.284520  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.289485  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.214855  5616 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.297242  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.291354  5553 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.304685  5565 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:19.305430  5249 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:19.308523  5565 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:19.309496  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.309686  5565 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.315083  5365 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.315707  5365 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:19.299316  5617 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.277352  5534 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:19.285526  5488 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:19.318496  5365 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.314497  5616 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.294404  5610 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.320815  5610 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.321506  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:19.322069  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:19.322480  1596 raft_consensus.cc:2376] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8. Re-sending same reply.
I20260709 12:59:19.322738  1603 raft_consensus.cc:2376] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14. Re-sending same reply.
I20260709 12:59:19.323158  5610 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.286314  5584 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.324949  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:19.325937  1594 raft_consensus.cc:2376] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11. Re-sending same reply.
I20260709 12:59:19.323947  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.331916  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.302153  5577 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:19.338361  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:19.339035  1748 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.291700  1501 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 9 to 11, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.328136  5626 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.238396  5574 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.334329  1603 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:19.336088  5584 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.337368  1596 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:59:19.347903  5584 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.350137  5584 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.350790  5250 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:19.352041  5250 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.353156  5250 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:19.353516  5250 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:19.354526  5250 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.341125  5610 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.356115  5610 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.357620  5534 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.358331  5610 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.358196  5534 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.360028  5576 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:19.360532  5576 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:19.361541  5576 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.363009  5576 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.364346  5615 raft_consensus.cc:993] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:19.364879  5615 raft_consensus.cc:1081] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:19.347311  5574 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.369077  5534 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.278298  5527 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.331431  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.309494  5605 ts_tablet_manager.cc:1916] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:19.376305  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.376530  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.335750  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.344691  5626 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.380867  5626 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.345408  5365 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.382563  5365 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.346412  5526 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.331250  5249 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:59:19.375439  5584 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.398279  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.399638  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.387760  1748 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:59:19.388406  1749 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:19.395248  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.398175  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.406476  1599 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:19.411000  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.412007  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.413028  1599 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:19.398816  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.405098  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.418670  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.424321  1597 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:19.421303  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:19.426249  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.428929  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:19.429561  1746 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:19.430294  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.431372  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.432274  1603 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:19.433244  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.434906  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.435886  1597 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:19.436218  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.436743  1598 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:19.440016  1600 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:59:19.442483  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:19.443172  2310 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 5.
I20260709 12:59:19.446224  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.447660  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.448673  5586 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:19.449290  5586 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:19.449559  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.450429  5586 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.451125  5508 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:19.451799  5508 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:19.451942  5606 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.452926  5508 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.390285  5526 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.455657  5577 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.455986  5526 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.434701  5622 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:19.456799  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.459201  1750 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:19.424127  5589 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.460471  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 185) took 4262 ms. Trace:
I20260709 12:59:19.460234  5249 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:19.460609  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:19.473994  1747 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:19.392189  5365 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:19.480185  1595 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:19.456281  5577 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.435034  5250 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.457648  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:19.471983  1746 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:19.391568  5552 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:59:19.441493  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.465397  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.486362  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.487371  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.494716  1748 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:19.494930  1751 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:19.488420  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.490005  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:19.459195  5629 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.441855  5619 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:59:19.502341  5626 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.506880  5577 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.491321  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:19.512641  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.514046  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.515029  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.515203  5488 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.515821  5616 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:19.516376  5616 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.498016  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.516757  5616 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:19.517783  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.390254  5584 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.502122  5629 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.520081  5629 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.502251  5594 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:59:19.522224  5594 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:19.471952  1500 rpcz_store.cc:276] 0709 12:59:15.176662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.251812 (+ 75150us) service_pool.cc:224] Handling call
0709 12:59:15.782278 (+530466us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b540036d228. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f948767f331 00007f948767a3fc 00007f948724c1b4 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:59:19.438699 (+3656421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:18.328467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:18.329080 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:18.329114 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:18.329134 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:18.331245 (+  2111us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:18.331311 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:18.331340 (+    29us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:59:18.342120 (+ 10780us) tablet.cc:701] Row locks acquired
0709 12:59:18.342145 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:59:18.345148 (+  3003us) write_op.cc:270] Start()
0709 12:59:18.349365 (+  4217us) write_op.cc:276] Timestamp: P: 1783601958342288 usec, L: 0
0709 12:59:18.349410 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:59:18.397569 (+ 48159us) log.cc:844] Serialized 8740 byte log entry
0709 12:59:18.638012 (+240443us) op_driver.cc:464] REPLICATION: finished
0709 12:59:19.062740 (+424728us) write_op.cc:301] APPLY: starting
0709 12:59:19.062838 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:19.082716 (+ 19878us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:19.109987 (+ 27271us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:19.142864 (+ 32877us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:19.143272 (+   408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:59:19.143344 (+    72us) write_op.cc:312] APPLY: finished
0709 12:59:19.190550 (+ 47206us) log.cc:844] Serialized 152 byte log entry
0709 12:59:19.190791 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:19.191052 (+   261us) write_op.cc:454] Released schema lock
0709 12:59:19.191130 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:19.191646 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:19.191683 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":337066,"reported_tablets":42,"spinlock_wait_cycles":6667008,"child_traces":[["op",{"apply.queue_time_us":369900,"apply.run_cpu_time_us":6472,"apply.run_wall_time_us":128856,"num_ops":22,"prepare.queue_time_us":247194,"prepare.run_cpu_time_us":7682,"prepare.run_wall_time_us":80027,"replication_time_us":271265,"thread_start_us":318262,"threads_started":2}]]}
I20260709 12:59:19.493479  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:19.523260  1603 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.523838  1603 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.523715  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:19.480232  5549 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:59:19.483662  5589 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:19.434525  5423 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:59:19.527134  5589 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.497781  5458 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.515903  5488 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:19.522603  5594 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:19.547420  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.571158  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.585482  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:19.590794  1746 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.599879  2312 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:19.561640  5488 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.601193  1641 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.562018  5553 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:19.602243  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.531530  5458 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:19.619350  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47862.2us
I20260709 12:59:19.631186  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.631574  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.583675  5526 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:19.635596  1743 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:19.636214  1746 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:19.638933  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.562183  5617 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:59:19.643851  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:19.635172  1641 raft_consensus.cc:2686] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:59:19.650141  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 49059.8us
I20260709 12:59:19.654624  5591 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:19.655449  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.614995  5488 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.650913  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.667094  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.668545  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.580312  5582 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:59:19.662446  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:19.632519  5458 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.626049  5596 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:19.615634  5572 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.561949  5588 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.677011  1673 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:19.678799  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.644415  5365 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:19.641094  5526 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.682194  1672 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:19.653131  5534 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:19.683126  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.684681  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.688849  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.687414  1603 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.698455  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.698817  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.700459  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.702458  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.657182  5610 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:19.708514  5577 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:19.708796  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:19.709198  5577 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:19.710464  5577 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.711697  1678 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:19.712291  5577 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:19.713770  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.720806  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.724213  1746 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:19.677767  5619 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.676225  5591 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:19.736460  1603 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:19.738363  1744 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:19.743104  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.691093  5527 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:19.693657  5583 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:19.744150  1678 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:19.694738  5526 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.755683  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:19.701809  5590 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.702056  5587 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:19.720218  5565 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.701663  5534 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:19.787847  5634 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:59:19.700587  5556 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.831921  5588 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:19.741546  5591 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:19.701287  5572 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.843340  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:19.861703  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.765372  5583 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.866421  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.874166  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.876348  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.826231  5534 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:19.759977  5596 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 12:59:19.876803  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.853968  5591 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.893217  1747 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
W20260709 12:59:19.895335  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 131461us
I20260709 12:59:19.859217  5553 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:19.900316  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:19.902595  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.875627  5583 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.904341  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:19.834208  5565 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.909828  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:19.828415  5590 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:19.878201  5617 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:19.878451  5587 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.924038  1671 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:19.890699  5574 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.898694  5582 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:19.855336  5556 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.901513  5626 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:19.903805  5647 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.978677  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.959954  5582 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:19.977834  5634 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.053s	user 0.000s	sys 0.007s
I20260709 12:59:20.000855  1745 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:20.008204  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:19.960484  5574 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:19.981369  5646 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:20.009114  5619 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:19.997813  5588 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.000551  5596 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:20.016928  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:20.003048  5582 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:20.004343  5587 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.013929  5658 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:20.029029  5645 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:59:20.029487  5649 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:20.033133  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:59:20.029070  5616 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.008s
I20260709 12:59:20.025485  5646 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.046269  5616 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.054358  5365 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.054970  5365 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:20.055022  5616 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.062345  5616 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:20.063073  5616 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.060501  5615 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:20.064162  5488 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.064646  5615 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:20.065109  5615 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.065847  5577 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:20.066030  5615 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.066664  5488 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.066453  5577 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.060822  5549 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:20.067694  5572 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.036769  5619 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.070192  5619 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.059089  5551 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:20.072257  1747 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:20.077071  5616 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.067492  5615 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:20.078675  5577 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.086489  1601 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:59:20.078961  5596 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:20.080456  5565 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.036617  5617 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:20.049975  5622 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:20.035094  5588 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.046593  5646 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:20.114707  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.039886  5587 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.051939  5649 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.072346  5551 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:20.018448  5553 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:20.125099  5576 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.762s	user 0.015s	sys 0.001s
I20260709 12:59:20.136075  5622 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.113060  5365 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.152549  5551 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:20.182785  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 124882us
I20260709 12:59:20.165618  5658 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:20.177640  1670 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:20.127763  5516 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:59:20.184116  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.204305  1669 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:20.202045  1670 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.171242  5590 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.172997  5556 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.179443  5655 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.168058  5606 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:59:20.206884  5596 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.216948  5631 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.382s	user 0.005s	sys 0.000s
I20260709 12:59:20.212596  5624 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:20.214496  1670 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:20.246243  5458 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.001s
W20260709 12:59:20.259044  5636 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
W20260709 12:59:20.262678  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63174.9us
I20260709 12:59:20.275723  1670 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.216212  5550 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:59:20.277631  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:20.278680  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:20.210459  5617 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.262346  5624 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:20.290226  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:20.246809  5596 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.283370  5656 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:20.296813  5656 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:20.283401  5641 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:59:20.241025  5551 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.284142  5653 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.291903  5624 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:20.245018  5655 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:20.305514  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91996.7us
I20260709 12:59:20.284286  5534 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.308281  5565 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:20.331679  2314 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:20.283638  5458 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.308260  5654 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.325573  5657 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:59:20.332039  1746 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:20.267755  5622 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.363735  5594 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:20.367599  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet bbe0e89474f14ac0be0bd7343e0f4601: Illegal state: Replica 1a40ab12c220464db732562e88c32c11 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:59:20.368376  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.347751  5647 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.331326  5666 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:20.321678  5551 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.388582  1602 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:20.341815  1747 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:20.358466  1595 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:20.318249  5653 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.362582  5553 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.333509  5588 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:20.363517  5664 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:59:20.372696  1599 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:20.332669  5565 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.381129  1751 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:20.245975  5649 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.409862  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.391979  1596 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:20.363287  1676 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:20.320494  5587 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:20.412911  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.372306  5654 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.420920  5587 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.421792  5667 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.421648  5587 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.422652  5654 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.424587  5587 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.428534  5670 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:20.430711  5670 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:20.431099  5670 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.432013  5670 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.433701  5670 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.434211  5458 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:20.379189  5556 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.385759  5365 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.441349  1750 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:20.386721  5666 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.439148  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.455648  1746 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:20.458081  5587 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.458745  5587 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.294699  5658 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.453001  1670 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:20.465188  1670 pending_rounds.cc:85] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 5
I20260709 12:59:20.466323  1670 pending_rounds.cc:107] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:20.415880  5588 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.462852  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:20.467732  1670 raft_consensus.cc:2889] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:20.399986  5553 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.461453  5556 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.394104  5647 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.461782  5666 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.422487  5667 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.506505  1598 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:20.504357  5423 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:20.487797  5565 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.515010  5656 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.516707  1677 raft_consensus.cc:606] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:20.517459  5680 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.485527  5588 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.521193  5594 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:20.524189  5629 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 1.004s	user 0.004s	sys 0.012s
I20260709 12:59:20.525064  5553 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.525556  5584 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:20.526558  5591 consensus_meta.cc:287] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.004s
I20260709 12:59:20.526803  5647 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.527139  5596 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:20.515769  5617 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:20.528088  1751 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:20.534147  5653 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.535800  5556 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.536049  5534 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.530984  5646 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.566795  1594 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:20.542518  5680 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.516912  5423 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.536072  5655 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.563186  5617 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.566267  5646 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.568997  1746 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:20.560572  5565 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:20.583184  5423 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.588546  5423 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:20.590713  5644 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.595s	user 0.003s	sys 0.000s
I20260709 12:59:20.562600  5591 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.593227  5591 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.594693  1746 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:20.579098  5526 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.005s
I20260709 12:59:20.595249  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 94) took 2037 ms. Trace:
I20260709 12:59:20.594841  5617 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:20.604163  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.549834  5629 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.613009  5527 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:20.613570  5527 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:20.614365  5629 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:20.587371  5582 consensus_meta.cc:287] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260709 12:59:20.615427  5582 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.608732  5526 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.628203  1752 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:20.629483  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1901) took 1129 ms. Trace:
I20260709 12:59:20.606632  1501 rpcz_store.cc:276] 0709 12:59:18.557655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.557813 (+   158us) service_pool.cc:224] Handling call
0709 12:59:20.595140 (+2037327us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:19.482957 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:19.506705 (+ 23748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:19.506764 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:59:19.506780 (+    16us) tablet.cc:662] Decoding operations
0709 12:59:19.507278 (+   498us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:19.507339 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:19.507367 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:19.507599 (+   232us) tablet.cc:701] Row locks acquired
0709 12:59:19.507616 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:19.507788 (+   172us) write_op.cc:270] Start()
0709 12:59:19.507919 (+   131us) write_op.cc:276] Timestamp: P: 1783601959507733 usec, L: 0
0709 12:59:19.507936 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:59:19.508727 (+   791us) log.cc:844] Serialized 599 byte log entry
0709 12:59:19.701137 (+192410us) op_driver.cc:464] REPLICATION: finished
0709 12:59:19.869448 (+168311us) write_op.cc:301] APPLY: starting
0709 12:59:19.869604 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:19.869756 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:19.869945 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:19.870288 (+   343us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:19.870551 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:19.870623 (+    72us) write_op.cc:312] APPLY: finished
0709 12:59:19.870912 (+   289us) log.cc:844] Serialized 23 byte log entry
0709 12:59:19.890342 (+ 19430us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:19.901032 (+ 10690us) write_op.cc:454] Released schema lock
0709 12:59:19.905579 (+  4547us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:19.962686 (+ 57107us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:19.980025 (+ 17339us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8789,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":142546,"apply.run_cpu_time_us":2530,"apply.run_wall_time_us":55576,"num_ops":1,"prepare.queue_time_us":109205,"prepare.run_cpu_time_us":3240,"prepare.run_wall_time_us":26151,"replication_time_us":168207,"thread_start_us":160192,"threads_started":2}]]}
I20260709 12:59:20.581205  5587 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.598973  5666 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.615906  2310 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:20.638872  5666 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.629318  5588 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:20.624364  5583 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.697s	user 0.013s	sys 0.000s
I20260709 12:59:20.626587  5527 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.641165  5582 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.629881  1752 rpcz_store.cc:276] 0709 12:59:19.560734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.568934 (+  8200us) service_pool.cc:224] Handling call
0709 12:59:19.601209 (+ 32275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.628611 (+1027402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.629245 (+   634us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540029e354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:20.629416 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361120640}
I20260709 12:59:20.622260  5667 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:20.642477  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 138253us
I20260709 12:59:20.650991  1746 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:59:20.652060  1746 pending_rounds.cc:85] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 10
I20260709 12:59:20.652961  1746 pending_rounds.cc:107] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:59:20.653944  1746 raft_consensus.cc:2889] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:20.654201  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.654865  5650 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.787s	user 0.006s	sys 0.001s
I20260709 12:59:20.656381  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 316) took 1092 ms. Trace:
I20260709 12:59:20.641110  5583 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.656913  5624 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.658946  5615 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:20.659497  1748 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:59:20.656754  1600 rpcz_store.cc:276] 0709 12:59:19.563875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.692956 (+129081us) service_pool.cc:224] Handling call
0709 12:59:19.730511 (+ 37555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:19.730897 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.730928 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:19.758949 (+ 28021us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.867615 (+108666us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:19.867662 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.868759 (+  1097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:20.643472 (+774713us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b240013ab88. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2269c4 00007f947e224acb 00007f947e3dfdc9 00007f947e3dfa55 00007f947e3df09d 00007f948101110e 00007f948102888c 00007f9481027bb6 00007f94810277d8 00007f9481031221
0709 12:59:20.656029 (+ 12557us) raft_consensus.cc:1685] finished
0709 12:59:20.656059 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:20.656313 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":939,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":29847,"spinlock_wait_cycles":79992192,"thread_start_us":49695,"threads_started":1,"wal-append.queue_time_us":50132}
I20260709 12:59:20.659232  5583 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.663182  1748 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:20.663759  5670 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:20.664577  5687 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:20.664848  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.665458  5680 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.665756  5687 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:20.666139  5687 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.666363  1748 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:20.629999  5605 ts_tablet_manager.cc:1929] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 12:59:20.667747  5605 log.cc:1199] T 516703d5c9f14537854665616191b5aa P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/516703d5c9f14537854665616191b5aa
I20260709 12:59:20.659235  5624 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:20.668220  5662 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.388s	user 0.000s	sys 0.002s
I20260709 12:59:20.669399  5605 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46970 (request call id 68) took 2236 ms. Trace:
I20260709 12:59:20.669819  5605 rpcz_store.cc:276] 0709 12:59:18.432589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.443856 (+ 11267us) service_pool.cc:224] Handling call
0709 12:59:18.608637 (+164781us) ts_tablet_manager.cc:1151] Deleting tablet 516703d5c9f14537854665616191b5aa
0709 12:59:18.608753 (+   116us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:59:20.016664 (+1407911us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:20.606130 (+589466us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:20.669306 (+ 63176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":657866,"tablet-delete.queue_time_us":147200,"thread_start_us":90474,"threads_started":1}
I20260709 12:59:20.675681  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:20.652969  5527 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:20.676982  5613 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:20.677361  5668 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:20.677958  5668 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:20.680963  5668 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.681617  5549 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:20.682543  5668 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:20.677405  5613 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.684489  5613 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:20.684373  5549 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:20.685945  5609 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:20.686345  5609 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.687249  5609 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:20.689795  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.693840  5526 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.694285  5574 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.694999  1600 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:20.696010  5606 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:20.699888  1601 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:20.701238  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.021s	sys 0.013s
I20260709 12:59:20.701390  1598 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:20.701798  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.021s	sys 0.013s
W20260709 12:59:20.702145  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 801814us
I20260709 12:59:20.706274  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:20.707217  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:20.709914  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.712204  1596 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:20.714253  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:20.716114  1745 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:20.724908  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.725665  1745 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.729892  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.731248  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:20.732219  5606 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:20.736193  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:20.737056  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:20.732425  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.739780  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:20.740358  1598 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:20.743014  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:20.746501  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:20.740674  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.748034  1744 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:20.748242  1751 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:20.748937  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.749756  1744 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:20.750941  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:20.755805  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.761121  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.761477  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.764263  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.764727  1749 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:20.764864  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.762112  1677 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:20.770099  1743 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:20.770619  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:20.771016  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.759969  5658 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:20.774123  5686 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:59:20.727761  5574 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.775681  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.775941  5574 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.778314  5574 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.779407  5584 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:20.750249  5622 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:20.781947  5622 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:20.783468  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.784721  5622 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:20.784971  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.785787  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.786036  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.786854  1671 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:20.787689  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.754299  5582 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:20.785871  1676 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:20.746017  5552 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:59:20.768958  5667 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.790815  5667 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.791035  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:20.768890  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:20.792047  5582 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:20.792403  5582 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.792744  5582 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:20.711875  5624 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:59:20.794245  5624 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:20.794691  5624 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:20.796452  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.796654  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.797173  1677 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:59:20.754593  5617 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:59:20.797291  1673 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.801692  5534 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.802269  5534 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.804397  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.805292  5534 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.769234  5583 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:20.758756  5626 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:20.811800  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet 516703d5c9f14537854665616191b5aa (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
W20260709 12:59:20.812582  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57124.7us
I20260709 12:59:20.763234  5556 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:20.814491  5556 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:20.817448  5582 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.816231  5687 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.775436  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.819482  1746 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:20.787181  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.805327  1669 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:20.818375  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.825810  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:20.843122  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:20.845345  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.845635  5680 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:20.846325  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.846554  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.847293  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.848511  5582 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.849488  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.850212  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.864718  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.845456  2316 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:59:20.851142  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.867221  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.867523  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.850832  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.853996  1600 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:20.855064  2312 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:20.857462  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.856123  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:20.877849  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.881317  1669 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:20.878798  5626 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:20.882989  5626 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:20.883397  5626 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.883764  5553 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:20.884418  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.886284  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.856287  1743 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:20.887372  1675 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:20.879704  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:20.893231  1747 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:20.879612  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.894912  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.896291  1599 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:20.903836  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:20.908268  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:20.909253  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36896 (request call id 255) took 1435 ms. Trace:
I20260709 12:59:20.910188  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:20.910456  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.851042  5617 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:20.855480  5680 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.923951  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.925094  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.952425  5626 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.958106  5626 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:20.958480  5613 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.962208  1670 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:20.963900  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:20.964600  1747 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:20.940099  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:20.911528  1598 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:20.914659  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.968967  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:20.819120  5624 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.988722  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.972245  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:20.983971  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:20.984568  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.996265  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:20.997361  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.997877  1675 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:20.977403  1747 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:20.982784  1751 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:20.981472  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.877262  1673 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:20.999744  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.002079  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.002442  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.003010  1600 raft_consensus.cc:2368] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:21.003170  1603 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:20.961314  5613 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:20.899314  5622 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:59:20.981856  5365 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.009421  5365 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:20.928040  5680 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.992734  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:20.912200  1745 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:20.913645  5574 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:20.999773  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:21.000058  5584 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:21.020576  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.005677  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:21.032590  1598 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:21.020457  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.030352  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:21.003878  5646 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:21.028009  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:21.034061  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:21.099823  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77708.4us
I20260709 12:59:20.988274  5668 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:59:20.969940  5670 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:59:21.034739  5574 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.991931  5582 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:20.995754  5658 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:21.033860  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:21.146483  1602 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:21.102119  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.104079  1597 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:21.104699  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:21.147300  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.106956  5609 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:21.108448  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.029142  5615 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.922228  5549 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:59:21.114241  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:21.021777  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:21.126076  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:21.126472  1603 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:21.150928  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 129218us
I20260709 12:59:21.140967  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.153975  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.124595  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:20.939078  5617 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:21.149657  1601 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:20.909724  2310 rpcz_store.cc:276] 0709 12:59:19.473477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.485743 (+ 12266us) service_pool.cc:224] Handling call
0709 12:59:19.489474 (+  3731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.637520 (+1148046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.908972 (+271452us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400680954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:20.909183 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581129984}
I20260709 12:59:21.158543  1596 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:21.163156  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.170691  1597 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:21.173659  5587 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:21.174275  5670 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:21.174358  5587 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:21.174849  5670 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:21.175927  5587 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:21.177132  5670 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.178840  5617 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:21.179175  5553 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:21.179641  5582 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.143945  5574 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.180830  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.144470  5626 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.116039  5646 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:21.205399  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.183113  1669 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:21.176399  5658 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.210021  5658 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:21.186133  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 45299.4us
I20260709 12:59:21.104806  5688 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:59:21.192865  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 172535us
I20260709 12:59:21.216656  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.148955  5588 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.218530  1671 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:21.155454  5624 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:21.222138  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.222270  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.227479  1673 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:21.178930  5670 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.231220  1675 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:21.162518  5629 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:21.179476  5617 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.127517  5584 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.233469  1670 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:59:21.182956  5365 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.249846  1678 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:21.219321  5646 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:21.253147  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.156975  5622 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:59:21.232049  5527 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.003s
I20260709 12:59:21.219976  5526 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.231706  5656 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:21.180604  5681 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:59:21.183341  5615 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.227983  5583 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:21.219626  5626 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.219729  5582 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:21.309657  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 130184us
I20260709 12:59:21.262085  5684 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:21.258641  5667 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.258189  5629 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:21.259348  5365 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:21.300307  5656 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.304312  5534 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.332639  5584 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.332789  5534 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.334072  1674 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:21.334522  1674 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:21.303639  5526 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.337683  5526 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.305943  5583 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:21.338750  5694 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:59:21.340559  5583 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.344930  5332 raft_consensus.cc:993] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:21.349999  5582 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.354722  5629 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:21.326998  5687 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:21.328044  5696 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.355728  5583 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:21.367199  5583 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.369606  5583 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.335364  1674 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.372200  1674 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:21.255745  5617 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.376201  1496 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.316787  5684 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:21.337539  5649 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:21.239396  5588 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:21.362287  5656 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.388826  1496 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:21.364838  5658 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.395970  1602 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:21.399948  1496 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.355523  5680 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.388724  5553 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:21.391973  5649 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:21.395231  5556 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:21.395750  5582 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:21.378989  5696 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.402433  5534 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.441259  5696 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.441845  5582 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:21.450845  1674 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:21.460871  5646 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.463418  5646 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.466276  1677 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:21.467855  5553 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.469264  5582 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:21.470448  5365 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:21.471973  5615 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.473481  5649 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.449429  5684 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.476399  5684 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:21.480614  5617 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.481067  5574 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.482300  5626 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:21.490562  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.495270  1745 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:21.495414  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.499200  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.499958  1743 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:21.500784  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:21.501739  2312 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:21.501950  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.502899  1743 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:21.503489  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.498536  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.506371  1747 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:21.506692  1745 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:21.511204  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:21.514351  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 292269us
W20260709 12:59:21.523496  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 200995us
I20260709 12:59:21.436008  5556 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.483469  5574 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.525554  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:21.525916  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:21.525957  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.526789  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.536156  1748 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:21.530704  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.535519  1752 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.524902  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.490166  5656 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.536834  1750 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
W20260709 12:59:21.523515  5423 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:59:21.545485  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.546139  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.551182  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.548273  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.553200  1597 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:21.547873  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.552389  1600 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:21.555114  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.546839  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.531839  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:21.562891  5715 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:21.528622  5586 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:21.600886  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:21.601456  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46475.8us
I20260709 12:59:21.602303  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.603227  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:21.604557  1751 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:21.597119  5574 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:21.542838  5704 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:21.554189  5703 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:59:21.601601  1594 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.592204  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.611112  1601 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:21.605512  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:21.607389  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82565.5us
I20260709 12:59:21.603785  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.612334  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:21.610977  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.600298  5615 raft_consensus.cc:1081] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:21.528949  5678 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:59:21.558820  5700 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:21.625013  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.626614  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.628008  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.632445  5587 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:21.621174  5551 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:21.617658  5534 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:21.636453  5365 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:21.638080  5556 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.626807  5613 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.647239  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.657575  1594 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:59:21.658155  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 54464.1us
I20260709 12:59:21.627831  5715 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:59:21.661127  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48478.4us
I20260709 12:59:21.599810  5687 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:21.658460  1752 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:21.627477  5700 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:21.675503  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:21.675932  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 135026us
I20260709 12:59:21.674106  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.661171  5610 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:21.678071  5534 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:21.665002  5698 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:21.678608  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.679276  5698 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:21.671335  5549 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:59:21.680688  5703 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:21.680526  5698 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:21.681144  5609 consensus_meta.cc:287] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.005s
I20260709 12:59:21.681200  5703 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.681749  5703 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:21.681874  5365 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.682392  5365 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.683909  5584 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:21.684384  5584 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.681617  5617 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:21.684743  5584 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.674996  5613 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.686718  5556 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:21.687685  5556 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:21.688057  5556 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:21.692642  1672 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:21.694388  1715 leader_election.cc:400] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:21.694979  1715 leader_election.cc:403] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:21.661017  5553 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:21.688865  5583 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:21.707783  5626 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
W20260709 12:59:21.708863  5714 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:59:21.709517  5556 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.710340  5670 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:21.711143  5556 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:21.712370  1750 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:59:21.717338  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.717623  5716 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:21.719566  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.721684  5719 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:21.725584  5719 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:21.722391  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45554.9us
I20260709 12:59:21.726538  5670 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:21.727906  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.726594  5719 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.729137  5719 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.740041  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.740701  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:21.743386  1752 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:21.745294  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:21.747067  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.750275  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:21.752105  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.752650  1749 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:21.615581  5704 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.756932  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.758894  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.730463  5553 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:21.877352  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:21.876863  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 200220us
I20260709 12:59:21.810151  5658 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:21.841914  5656 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.843701  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:21.903612  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.846982  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:21.904917  1745 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:21.905071  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:21.729748  5549 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:21.906102  5549 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:21.906363  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.907140  5549 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.675828  5700 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.813809  1601 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:21.831288  1752 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:21.909363  1674 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:21.850878  1599 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:21.753480  5574 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:21.857378  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.812522  5423 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.866624  1749 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:21.854076  5697 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:21.917490  5697 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:21.919700  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.922230  5649 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:21.927645  5724 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:59:21.929131  5423 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:21.929955  1743 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:21.858510  5617 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:21.932077  5617 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.869792  5718 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:21.935283  1601 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:21.867314  5703 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.875308  5587 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:21.804273  5626 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:21.878275  1675 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:21.878927  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:21.955699  1673 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.878289  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.957077  1670 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
W20260709 12:59:21.878947  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 122140us
I20260709 12:59:21.958819  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:21.961871  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:21.755395  5583 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:21.882648  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 1655) took 1099 ms. Trace:
I20260709 12:59:21.976709  1750 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:21.882870  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.854413  5613 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.982837  1601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:21.983453  1601 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.983848  1601 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:21.936268  5584 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.878628  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.879118  5681 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:21.884016  5716 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:21.884773  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:21.890976  5680 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.959110  5658 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.894821  5365 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:21.754264  5646 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:22.030475  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.915987  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.935045  5718 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:21.947600  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:21.948942  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 190151us
I20260709 12:59:22.032003  1745 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:22.032845  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.848887  5715 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.968565  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.976266  1743 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:21.977221  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.034811  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.978879  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:22.035585  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58426.9us
I20260709 12:59:21.976874  1672 rpcz_store.cc:276] 0709 12:59:20.783165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.784680 (+  1515us) service_pool.cc:224] Handling call
0709 12:59:21.882428 (+1097748us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54003e71d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:21.882546 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061759872}
I20260709 12:59:22.035846  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:21.986028  1673 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:22.036367  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:21.991725  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.036639  1678 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 12:59:22.013541  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.037113  1670 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:21.893415  5588 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:21.963754  5565 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.954504  5626 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.055280  5626 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:22.056149  1674 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:22.042934  5715 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.060209  5715 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.014892  5681 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:22.060215  5703 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.061834  5681 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:22.034780  5553 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:22.066126  5553 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.069921  5718 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.075356  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.077370  5624 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:22.077847  5624 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.078258  5624 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:22.082791  5584 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.089824  5617 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.989974  5687 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:59:22.100131  5687 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:22.104636  5697 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.105505  5716 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:22.105990  5716 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.106482  5716 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.027850  1598 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:22.029727  1599 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:21.913828  5549 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:21.883778  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.124136  1677 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:21.872989  5704 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:21.975926  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:21.976920  5587 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:22.040987  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:21.976812  5583 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:22.041391  1600 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:22.044976  1675 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:22.045099  1673 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:22.046794  1601 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:22.139000  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 98122.7us
W20260709 12:59:22.139688  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.122810  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.140489  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.112314  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.141435  1595 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:22.138866  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 170367us
I20260709 12:59:22.053120  5332 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:22.143290  1603 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:22.142145  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.141726  1751 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:22.144790  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.148509  1601 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.148617  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.042181  5698 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:22.045163  5670 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.063429  5681 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:22.108742  5696 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:22.172029  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.142953  5583 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:22.155090  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.069955  5701 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:59:22.183511  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:22.147936  5697 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:22.144282  5704 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:22.126176  5565 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.154074  5588 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:22.194142  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.198971  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.211256  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.216837  5698 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:22.196753  5423 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:22.232419  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.234596  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.240628  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:22.240787  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.207274  5587 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:22.243158  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 78021.9us
I20260709 12:59:22.277766  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.189963  5556 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:22.188665  5678 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:59:22.218281  5365 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:22.277354  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.295231  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:22.301302  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.303617  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.244328  5680 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:22.280572  5728 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:22.322863  5527 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:22.277328  5617 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:22.335762  5617 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.336418  5617 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:22.288548  5656 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.337437  5656 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.338246  5656 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.285545  5715 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:22.239809  5727 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.281404  5584 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:22.323534  5574 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:22.332450  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.289340  5719 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.341866  1751 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:22.344283  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:22.242422  5698 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:59:22.346546  1749 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:22.300232  5365 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.289275  5587 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:22.339113  5704 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:22.310824  5708 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:59:22.311915  5726 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:59:22.355064  5365 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.292794  5551 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:59:22.350375  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:22.361469  1746 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.350984  1743 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:22.339170  5527 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.364013  5527 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:22.364248  5733 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:59:22.364674  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.365439  1743 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:22.351346  5556 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:22.366268  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:22.366091  5556 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:22.366950  1743 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:22.369040  5556 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:22.371910  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:22.372301  5730 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:59:22.373306  5624 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.307459  5703 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:22.355868  1669 raft_consensus.cc:606] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.382377  1669 raft_consensus.cc:614] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:22.373107  5587 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.375691  5698 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.349761  5700 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:22.342676  5584 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.306874  5701 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:59:22.344471  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.385181  1676 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:22.355731  5715 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:22.357331  5704 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.404289  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:22.350982  5719 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:22.406355  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61986.5us
I20260709 12:59:22.375361  5583 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:22.384447  5556 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:22.412273  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:22.394539  5584 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.418076  5727 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:22.432121  5727 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:22.433081  5727 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.436285  5700 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:22.438653  5719 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.406934  5680 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:22.440950  5680 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.390133  5698 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.417129  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:22.420123  1672 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.444921  1678 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.445879  1746 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:22.414716  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.428524  5740 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:22.447773  1673 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:22.429235  5583 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:22.376663  5737 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:59:22.430629  5556 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:22.430928  5728 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:22.431581  1750 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:22.415778  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.453621  1675 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:22.429936  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.454591  1670 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:59:22.421547  5738 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:59:22.407495  5704 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:22.461449  1672 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 12:59:22.463994  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55840.9us
I20260709 12:59:22.466161  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:22.452317  5740 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.454917  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:22.460229  5565 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.474256  5700 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.469352  5737 consensus_queue.cc:1243] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:22.477715  5740 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:22.487025  5624 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.488500  5365 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.484683  5583 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.498658  5527 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.500659  5365 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.501626  5365 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.502290  5365 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.506749  5556 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:22.513866  5698 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.492314  5703 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:22.527001  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.535215  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:22.536494  2312 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:22.540835  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:22.541231  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:22.541800  1744 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:22.493764  5742 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.493469  2310 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:22.520442  5658 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:22.549808  1603 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:59:22.550287  1603 pending_rounds.cc:85] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:22.550518  1603 pending_rounds.cc:107] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:59:22.550758  1603 raft_consensus.cc:2889] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:22.551611  5527 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.555033  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.548702  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.556385  2312 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:22.557152  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:22.520955  5365 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.515317  5626 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.577366  5626 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.585670  5688 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:22.586495  5688 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:22.496083  5583 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.592701  1746 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:22.594255  5583 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.597488  1747 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:22.547669  5703 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.623097  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:22.623562  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:22.623910  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.626029  1749 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:22.626976  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.627934  2316 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:22.628382  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.631047  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.556025  5742 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.608335  5715 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:22.634652  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.637010  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:22.638630  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:22.641690  1677 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.648720  1678 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:22.650223  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.630154  5741 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:22.652007  1669 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:22.617453  5703 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.639005  5527 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:22.617568  5680 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.616415  5688 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.646061  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:22.679370  5588 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.680246  5588 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.673767  5751 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:22.690452  5751 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.690979  5751 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.677006  5583 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.653752  5741 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.696765  5741 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:22.696985  5617 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.646435  5553 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.700634  5553 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.701560  5742 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.702836  5553 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.702579  5656 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:22.700067  5716 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.004s
I20260709 12:59:22.629482  5584 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.707863  5716 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.708784  5527 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:22.709208  5688 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:22.707989  5704 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.707758  5583 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:22.709882  5527 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.713379  1677 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:22.719043  5583 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.713733  5584 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.720956  5703 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:22.721632  5681 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.007s
W20260709 12:59:22.722672  1641 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75dc4812cc534228899ce2b7b14d2237. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:22.699359  5617 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:22.723201  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 397308us
I20260709 12:59:22.723956  5720 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:22.750560  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:22.750707  5720 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:22.732522  5646 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:22.733103  1602 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:22.735584  5688 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:22.742182  5574 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:22.744115  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.822170  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.822777  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:22.745060  1601 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.744982  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:22.824312  1600 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:22.745795  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.762477  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.752897  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:22.825228  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.825178  1595 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:22.825490  1749 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:22.826138  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:22.814211  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58371us
I20260709 12:59:22.762665  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:22.761053  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.762737  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:22.753357  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:22.758662  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:22.884183  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:22.848387  1752 raft_consensus.cc:2368] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:22.857925  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.820559  5574 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.825810  5613 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.819804  5646 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:22.903746  1601 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:22.847220  1598 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:22.909618  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51786.2us
I20260709 12:59:22.712304  5716 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.847638  5615 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:22.945595  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 187090us
I20260709 12:59:22.846444  5658 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:59:22.904284  5365 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:22.949432  5719 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.976809  5719 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.977406  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:22.944379  5613 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.979626  5715 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.981779  5656 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:22.986563  5615 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.990144  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:22.993605  5704 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:22.887023  5720 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.948913  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.964457  1747 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:59:23.000540  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:23.000810  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55040.3us
I20260709 12:59:22.965262  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:23.001685  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:22.885687  5626 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.909982  5697 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:22.948737  5516 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:59:22.959553  5624 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:22.974050  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.974797  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:22.884505  5668 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:59:22.884718  5617 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:59:22.828243  5688 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:22.707312  5740 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.002187  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:23.036548  1750 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
W20260709 12:59:22.895458  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 245408us
I20260709 12:59:22.788440  5680 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.027696  5668 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:22.944924  5676 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.050545  5741 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.051456  5676 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.054306  5676 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.034063  1602 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:23.034648  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:23.020087  1597 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:23.025168  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:23.044747  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.037791  5740 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.056527  1675 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:23.056767  5728 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:23.033013  5727 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:23.057139  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:23.057685  5727 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:23.058416  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:23.058600  5727 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.059422  5704 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:23.059755  5617 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:23.019986  5626 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.060084  5704 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:23.049161  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:23.061686  1752 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:23.045640  5668 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:23.063144  5668 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.064145  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.064425  5668 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:23.028961  5697 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:23.066041  5697 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.050374  5751 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.046730  5615 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.061118  5704 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.062052  5626 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:23.070569  1675 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:23.072475  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.043421  5720 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:23.084246  5588 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.094134  5588 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.083698  5740 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:59:23.090476  5741 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:23.043851  5613 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.088975  1751 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:23.089027  5719 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.089812  5751 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.090437  1744 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:23.106623  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.111989  1501 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.115561  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.116513  1669 raft_consensus.cc:2368] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:23.116348  1675 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:23.114285  1501 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 11 to 14, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.123986  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.123899  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.129405  1677 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:23.129825  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.130735  1669 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:23.131050  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.131942  1678 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:23.132254  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.132814  1675 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:23.135123  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.136704  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:23.139799  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:23.147419  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 244254us
I20260709 12:59:23.148586  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.110517  5626 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:23.149266  1672 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:23.120185  5613 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:23.155810  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.156441  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.162223  1677 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:23.151206  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:23.158288  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.158617  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.123273  5587 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:23.164016  1673 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.164728  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:23.167512  1676 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:23.167583  2316 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:59:23.183503  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.147306  5741 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:23.251075  1672 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:23.167877  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:23.244367  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.266304  1673 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:23.267007  1678 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:23.235263  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:23.237644  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86542us
I20260709 12:59:23.269887  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:23.246708  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.271795  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.272328  1671 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:23.272504  1677 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:59:23.236182  1675 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:23.151510  5751 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:23.257543  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:23.264472  1670 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:23.162411  5626 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:23.284437  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.285274  1674 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:23.281731  1676 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:23.283098  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:23.289925  1597 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:23.286748  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:23.295920  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.233659  5587 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:23.295395  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.299429  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:23.288280  5756 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:59:23.237567  5753 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:23.309759  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:23.305492  1752 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:23.167217  5613 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.278191  5740 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:23.284603  5624 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.332409  5624 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.334816  5624 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.309072  1598 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.336319  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:23.337229  1594 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:59:23.341142  5757 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:59:23.304847  5658 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:23.342732  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.342942  5613 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:23.345880  5587 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.309842  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:23.328052  5574 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.293195  2310 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:23.329413  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:23.331475  5719 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.291109  5549 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:23.285808  5583 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:23.291801  5742 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.297827  5527 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:59:23.313984  1597 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:23.373097  1594 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:23.341128  5365 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:23.397425  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:23.398701  1752 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:23.306499  5718 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:59:23.364800  5656 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:23.318977  5703 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:59:23.367313  5549 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:23.408034  1598 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:23.341027  5740 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.366465  5728 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 12:59:23.431298  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 122505us
W20260709 12:59:23.432785  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 146934us
I20260709 12:59:23.420027  5365 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:23.444487  2316 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:23.400077  5680 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.372344  5719 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.377775  5742 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.423671  5617 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:23.430444  5549 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:23.431419  5583 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:23.457796  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 178320us
I20260709 12:59:23.447714  5718 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:23.436851  5626 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.475515  5742 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:23.477274  5755 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:59:23.485128  5574 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.487114  5773 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:23.487663  5773 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:23.451028  5751 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:23.495853  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 200493us
I20260709 12:59:23.497431  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.456923  5703 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:23.501718  1669 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:23.502743  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.509384  1670 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:23.504437  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:23.505986  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:23.510366  1678 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:23.470618  5718 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:23.525712  1674 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:23.489446  5583 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:23.465270  5617 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.498678  5588 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:23.524883  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 81705.9us
I20260709 12:59:23.528407  5527 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:23.523247  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.529935  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:23.520648  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56150us
I20260709 12:59:23.549307  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:23.534987  5728 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:59:23.565524  5527 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.566152  5728 consensus_queue.cc:1243] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:23.566848  5728 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.567446  5728 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.568869  5583 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.521754  5703 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.573980  5703 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:23.574254  5763 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:59:23.574788  5703 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:23.575897  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1943) took 1018 ms. Trace:
I20260709 12:59:23.576610  5777 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:23.577414  5777 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.577909  5777 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.578904  5617 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.535293  5742 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.579938  5742 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.580386  5766 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:23.581013  5764 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:23.581439  5766 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:23.575276  5703 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:23.576377  1745 rpcz_store.cc:276] 0709 12:59:22.557952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.558099 (+   147us) service_pool.cc:224] Handling call
0709 12:59:22.558461 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.571282 (+ 12821us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:22.571332 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:23.000605 (+429273us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b2c0013d8c8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 12:59:23.014233 (+ 13628us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.274002 (+259769us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:23.274060 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.274167 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.575393 (+301226us) raft_consensus.cc:1685] finished
0709 12:59:23.575427 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.575775 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17239,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"spinlock_wait_cycles":67351296,"thread_start_us":228096,"threads_started":1,"wal-append.queue_time_us":359708}
I20260709 12:59:23.488600  5773 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.645494  5718 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.555016  5588 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:23.717885  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.784479  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 235218us
I20260709 12:59:23.583345  5703 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:23.830562  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.030501  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:24.070120  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48630.6us
I20260709 12:59:24.089051  5583 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.005496  5740 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.102661  5740 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.024642  5718 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.103252  5740 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.105866  5740 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.106531  5740 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.097631  5588 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.108633  5583 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.111140  5583 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.816310  5684 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.098577  5788 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.107055  5740 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.099858  5681 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:24.101958  5766 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.024915  5617 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.112926  5742 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:23.771636  5527 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:23.838922  5775 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:23.872092  5720 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.838636  5574 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:24.067935  5549 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.008s
I20260709 12:59:24.116029  5728 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:23.787734  5751 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:23.893296  5769 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:24.097368  5365 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 12:59:24.128706  5684 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.135982  5617 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.186631  5617 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:24.123492  5777 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.010s
W20260709 12:59:24.149945  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77377.2us
I20260709 12:59:24.169348  5549 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.141357  5720 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.170360  5646 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.174911  5574 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.123701  5778 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.183185  5365 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.195017  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:24.179405  5624 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.005s	sys 0.020s
I20260709 12:59:24.187431  5617 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.220319  5646 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.222908  5684 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.218210  5778 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.223605  5789 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.132136  5788 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.224184  5789 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:24.216171  5624 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.007s	sys 0.020s
I20260709 12:59:24.205186  5792 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.206101  5775 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:24.232329  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 101697us
I20260709 12:59:24.216339  5740 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.182138  5769 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:24.208491  5777 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.259279  1746 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:24.333636  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 138718us
I20260709 12:59:24.346586  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:24.366734  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:24.366744  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:24.322448  5548 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.230176  5766 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:24.276002  5583 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.409570  5583 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.382936  5527 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.413020  5583 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.230885  5684 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.234442  5728 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.273408  5793 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.233934  5792 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.271258  5751 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.227062  5617 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.405740  5789 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.427484  5804 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.405956  5780 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:24.432930  5617 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:24.417702  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51027.7us
I20260709 12:59:24.341857  5588 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.332242  5720 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.343266  5787 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.437589  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:24.347886  5765 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.345533  5718 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.347779  5745 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.451184  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:24.452136  5796 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.432988  5804 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.451993  5751 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.425793  5742 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.382747  5740 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:59:24.431855  5788 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.466979  5718 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.433573  5617 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.471129  5804 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.427672  5728 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.461205  5787 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.415072  5548 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.471197  5792 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.432294  5777 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.431010  5800 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.470150  5768 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.434170  5780 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.474347  5583 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:59:24.435941  5778 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.428192  5549 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.427304  5684 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.433463  5793 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.452033  5588 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:24.572675  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 339480us
I20260709 12:59:24.575398  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:24.576778  1674 raft_consensus.cc:2410] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:24.504884  5365 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:24.579075  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 127960us
I20260709 12:59:24.504897  5574 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.514001  5800 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.367252  5775 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.588850  1748 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:24.512341  5742 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:24.582264  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 163844us
I20260709 12:59:24.464710  5765 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.502427  5617 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.512727  5792 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.514142  5804 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.516160  5789 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.566460  5777 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.594576  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:24.476174  5745 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.572293  5715 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.474658  5796 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.585098  5778 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.513826  5768 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.513991  5780 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.591467  5365 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.592265  5742 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.611843  5549 raft_consensus.cc:2764] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:24.633116  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.633913  1746 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:24.635530  5768 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.618129  5778 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.638401  5778 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.625954  5742 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.627506  5365 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.640808  5617 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.631665  5646 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.641790  5365 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.641891  5548 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.642915  5805 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.642071  5646 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.643689  5805 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.645661  5646 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.648824  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.604744  5792 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.646409  5805 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.653281  5718 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.653635  5800 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.613874  5777 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.608727  5804 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.667758  5810 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:24.668323  5810 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.668699  5810 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:24.669382  5751 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.672554  5793 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.658547  5778 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:24.648941  5769 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.673549  5778 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.674759  5745 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.675587  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 685) took 1145 ms. Trace:
I20260709 12:59:24.676029  1749 rpcz_store.cc:276] 0709 12:59:23.530697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.564522 (+ 33825us) service_pool.cc:224] Handling call
0709 12:59:23.564990 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.581964 (+ 16974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.582001 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:23.582048 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:23.582086 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.675294 (+1093208us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b540013a954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:24.675349 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.675495 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38517120}
I20260709 12:59:24.677040  5777 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.678642  5684 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.680567  5728 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.658828  5617 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.681542  5617 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.681668  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.683362  5588 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.683408  1501 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.687762  1501 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.689101  5780 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.659649  5813 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.690397  5813 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.660395  5646 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.692505  5646 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.693039  5813 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.694057  5778 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.694521  5617 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.700482  5688 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:24.701320  5681 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.002s
I20260709 12:59:24.682421  5765 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.699676  5796 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.708474  5728 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.709254  5728 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.616823  5715 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.656802  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.610030  5789 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.665298  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.715917  1750 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:24.680604  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:24.717088  1602 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:24.703156  5742 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.726914  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.727332  5805 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.727851  1599 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:24.729998  1566 leader_election.cc:400] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:24.730463  1566 leader_election.cc:403] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:24.694882  5646 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.729075  1746 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:24.732791  5796 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.750382  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.755493  5796 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.752835  5778 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:24.757494  5778 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.758671  5688 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.759320  5688 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.760949  5778 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.761870  5688 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:24.734372  5805 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:24.764412  5805 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.726962  5789 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.758430  5796 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:24.776944  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 193600us
I20260709 12:59:24.780997  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.790768  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:24.791117  1750 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:24.791436  1674 raft_consensus.cc:606] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:24.791822  1674 raft_consensus.cc:614] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:24.778729  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49807.1us
I20260709 12:59:24.793533  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:24.795400  5646 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
I20260709 12:59:24.796868  5646 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.797329  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.797705  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:24.797995  1600 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:24.799140  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.799494  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.797654  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.807086  1600 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:24.807338  1601 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:24.799149  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.807314  1598 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:24.809109  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.810173  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.812393  1678 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:24.812642  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:24.802464  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.797346  5646 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.803802  1566 leader_election.cc:400] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:24.819864  1566 leader_election.cc:403] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:59:24.789688  1595 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:59:24.784032  5688 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.804778  5816 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:24.831466  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:24.816025  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:24.835958  2312 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.837432  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:24.832916  1641 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43001 timed out after 1.805s (SENT) [suppressed 8 similar messages]
I20260709 12:59:24.778615  5813 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.826090  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.844643  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.856664  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:24.862386  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:24.863226  1601 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:24.863185  1596 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:24.866219  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.867362  1595 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:24.824105  1750 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:24.869199  1598 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
W20260709 12:59:24.880851  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 131120us
I20260709 12:59:24.884048  1602 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:24.883356  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.884778  1599 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:24.890462  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1588) took 1600 ms. Trace:
I20260709 12:59:24.830811  5742 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.905715  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.840384  5804 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.843789  5548 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:24.907935  2312 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:24.909278  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:24.904295  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.891063  1602 rpcz_store.cc:276] 0709 12:59:23.285580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.285735 (+   155us) service_pool.cc:224] Handling call
0709 12:59:24.680484 (+1394749us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368f8c 00007f947e368ef6 0000000000375939 00007f94863dc1e0 00007f94864a50c4 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:59:24.884603 (+204119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286208}
I20260709 12:59:24.862603  5681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 8) took 4078 ms. Trace:
I20260709 12:59:24.906524  1600 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
W20260709 12:59:24.888520  5626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.039s	sys 0.057s
I20260709 12:59:24.843760  5818 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:24.921046  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.922168  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:24.923138  1599 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:24.928069  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.884840  5728 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:24.889122  5789 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:24.949110  5789 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.884150  5813 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.933284  1596 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:24.953146  5813 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:24.953365  5754 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.562s	user 0.007s	sys 0.018s
I20260709 12:59:24.889554  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:24.839267  5688 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.886664  5796 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:24.886847  5777 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:24.937888  1743 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:24.960013  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:24.941133  5829 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:59:24.943264  5646 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:24.924753  5626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.039s	sys 0.058s
I20260709 12:59:24.945909  5810 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.933009  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.968398  1602 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:24.955492  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 122585us
I20260709 12:59:24.955698  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.955821  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.970731  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.958366  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.971246  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:24.971832  1745 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:24.972105  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.914252  5548 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.961817  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:24.972842  1596 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:24.974308  1600 raft_consensus.cc:2410] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:59:24.960649  1599 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:24.975283  1596 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:24.962987  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:24.919281  5814 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:24.922784  5818 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.967279  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:24.934242  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:24.977795  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.979410  5548 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:24.979872  5715 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:24.975777  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:25.019905  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44211.2us
I20260709 12:59:25.020068  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:25.021322  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:25.078677  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57475.3us
I20260709 12:59:25.020448  5818 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.980711  5549 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:25.112758  5549 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.033596  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:25.115064  1595 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:25.119217  1752 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 12:59:25.120572  1745 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:25.113945  5549 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:25.124622  1602 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:25.118283  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:25.139936  1602 pending_rounds.cc:85] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
I20260709 12:59:25.134263  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.140450  1602 pending_rounds.cc:107] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:25.140861  1745 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 2.
I20260709 12:59:25.140992  1602 raft_consensus.cc:2889] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:25.142771  1602 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:25.146198  1602 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:25.147972  1602 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:25.096882  5684 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:25.044507  5768 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:25.100827  5810 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:25.140362  5823 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 12:59:25.145216  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:25.149501  1602 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:24.963970  5777 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.170554  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:24.918941  5681 rpcz_store.cc:276] 0709 12:59:20.760896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.762460 (+  1564us) service_pool.cc:224] Handling call
0709 12:59:20.888809 (+126349us) log.cc:844] Serialized 506 byte log entry
0709 12:59:21.479869 (+591060us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b540035bc20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948140db26 00007f948140749a 00007f9481406714 00007f94813e6eaa 00007f94813edd53 00007f94813edcd9 00007f94813edc69 00007f94813edc31 00007f94813ecdfd 000000000038f354
0709 12:59:21.481816 (+  1947us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b180043b160. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f94813e6b0b 00007f948146bb63 00007f9481493752 00007f9486453d29
0709 12:59:21.706451 (+224635us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b180043b160. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:24.839404 (+3132953us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":392441,"raft.queue_time_us":307473,"raft.run_cpu_time_us":5543,"raft.run_wall_time_us":467373,"spinlock_wait_cycles":15141760,"thread_start_us":276229,"threads_started":2,"wal-append.queue_time_us":392203,"wal-append.run_cpu_time_us":2076,"wal-append.run_wall_time_us":1034278}
I20260709 12:59:24.987787  5646 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:25.044692  5814 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:25.056486  5789 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:25.183858  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.187655  5836 ts_tablet_manager.cc:933] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:25.178299  1595 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:25.206419  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.187846  1602 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.207129  1745 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 12:59:25.178776  5768 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.227672  5768 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:25.161389  5718 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:25.176862  5835 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:25.188755  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:25.197160  1751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1965) took 2233 ms (client timeout 1805 ms). Trace:
W20260709 12:59:25.263559  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74874.8us
W20260709 12:59:25.183857  5831 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:59:25.187465  5814 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:25.237829  5688 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.233728  5718 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.269045  5718 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.269842  5624 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:25.270373  5624 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.177830  5684 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:25.271562  5624 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.177359  5715 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:25.275557  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.276482  1745 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:25.259443  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:25.204173  5829 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:59:25.267562  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:25.263339  1751 rpcz_store.cc:269] 0709 12:59:22.963589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.964858 (+  1269us) service_pool.cc:224] Handling call
0709 12:59:25.196770 (+2231912us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b540017d9d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:25.196992 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200063360}
I20260709 12:59:25.186882  5646 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.278829  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.271961  5684 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:25.281546  5646 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.188294  5681 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:25.282379  5681 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.282793  5681 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.274282  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:25.182655  5777 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:25.286903  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.291100  1751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:25.291952  1751 raft_consensus.cc:606] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:25.292382  1751 raft_consensus.cc:614] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:25.294507   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:25.298933  5615 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:25.288177  5688 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:25.298950  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:25.317329  5773 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:25.317831  5549 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.332651  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1951) took 2046 ms. Trace:
I20260709 12:59:25.335029  1597 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:25.307021  5768 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.341984  1596 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:25.333199  1752 rpcz_store.cc:276] 0709 12:59:23.286408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.416778 (+130370us) service_pool.cc:224] Handling call
0709 12:59:23.432990 (+ 16212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.119716 (+1686726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.332271 (+212555us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54000d3754. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:25.332562 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3876647808}
I20260709 12:59:25.342784  5768 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.285912  5715 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:25.353571  1747 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:59:25.356196  5715 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:25.362118  5548 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.312894  5765 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:59:25.387132  5765 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.445752  5765 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.453702  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:25.454696  1594 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:25.432608  5799 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.461615  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.459558  1671 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:25.444880  5549 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.458014  5766 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:25.483327  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.462745  5658 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:25.470211  5656 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:25.460273  5697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.861s	user 0.017s	sys 0.032s
I20260709 12:59:25.472282  5766 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:25.510824  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 353431us
W20260709 12:59:25.513134  5697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.929s	user 0.017s	sys 0.033s
W20260709 12:59:25.514393  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 411727us
I20260709 12:59:25.498513  5658 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.464823  5799 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:25.506319  5656 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.526562   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.494771  5681 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.492515  5818 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:25.533175  5588 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:25.534216  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:26.061419  5656 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.006s
I20260709 12:59:26.091665  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:25.610625  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 306873us
I20260709 12:59:25.815896  5740 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:26.097179  5771 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:26.097690  5771 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.097438  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:26.098299  5771 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:25.902287  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1952) took 1644 ms. Trace:
W20260709 12:59:25.543313  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.552702  5843 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:59:25.749653  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.515519  5809 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.103340  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.097574  5740 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:25.922524  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1992) took 1031 ms. Trace:
I20260709 12:59:25.863461  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1599) took 1007 ms. Trace:
W20260709 12:59:25.793035  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.914438  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 2035) took 2890 ms (client timeout 1900 ms). Trace:
I20260709 12:59:25.910686  5807 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:26.110358  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:26.111884  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:26.220752  1603 rpcz_store.cc:269] 0709 12:59:23.023691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.023809 (+   118us) service_pool.cc:224] Handling call
0709 12:59:25.914017 (+2890208us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54003b4054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:25.914259 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5659961216}
I20260709 12:59:26.113262  5588 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:25.605363  5850 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:59:26.216445  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 99633.2us
I20260709 12:59:26.216312  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:25.684062  2310 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:25.570322  5681 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:26.219880  1642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.019s	sys 0.039s
I20260709 12:59:26.219614  1596 rpcz_store.cc:276] 0709 12:59:24.856388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.107256 (+250868us) service_pool.cc:224] Handling call
0709 12:59:25.341570 (+234314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.342446 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.863102 (+520656us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400038c50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:25.863345 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537612032}
W20260709 12:59:26.238114  1642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.019s	sys 0.039s
I20260709 12:59:26.099632  1748 rpcz_store.cc:276] 0709 12:59:24.258135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.259105 (+   970us) service_pool.cc:224] Handling call
0709 12:59:24.288042 (+ 28937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.589525 (+301483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.901971 (+1312446us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:25.902208 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690495872}
W20260709 12:59:25.601598  5817 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.971s	user 0.006s	sys 0.000s
I20260709 12:59:26.219450  1749 rpcz_store.cc:276] 0709 12:59:24.891195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.921211 (+1030016us) service_pool.cc:224] Handling call
0709 12:59:25.921714 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.922003 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.922044 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:25.922108 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:25.922158 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.922241 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.922436 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.116992  5814 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:25.601626  5799 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.116546  5548 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.610051  5718 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.224349  5807 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:26.226078  5777 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.908332  5792 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.580188  5766 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.247076  5681 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:25.856217  5658 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:25.572420  5818 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.703085  5854 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:25.605065  5684 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.213626  5656 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:25.595146  5836 tablet_copy_client.cc:323] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:59:25.603947  5624 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.223124  5809 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.257266  5777 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.271128  5818 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:26.271849  5818 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:26.273370  5703 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:26.274084  5818 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:26.257576  5787 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.248713  5814 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:26.277096  5807 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.281658  5740 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:26.282101  5718 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.269542  5854 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:26.283011  5777 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.282858  5809 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.284788  5854 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:26.285526  5765 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.286180  5814 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:26.277144  5856 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:26.287253  5856 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.287685  5856 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.287876  5771 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:26.291325  5771 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:25.633527  1490 maintenance_manager.cc:419] P de45a76180d64c6884c212bcc9eaa1c0: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033370
W20260709 12:59:26.332541  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.334661  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1595) took 1509 ms. Trace:
I20260709 12:59:26.234354  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.378618  1602 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:26.334828  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.336279  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.336722  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.338220  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.338397  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:26.339886  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115807us
I20260709 12:59:26.343504  5624 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.347820  5745 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.334870  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.339910  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.354838  5588 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.387470  1603 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:26.388810  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:26.389539  1603 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:26.390161  1596 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:26.382092  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.387485  1598 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:26.396361  5745 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.400553  5745 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.406054  5588 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:26.409874  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 294202us
I20260709 12:59:26.411724  5814 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:26.413409  5684 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.412844  5814 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.376762  1599 rpcz_store.cc:276] 0709 12:59:24.825354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.976289 (+150935us) service_pool.cc:224] Handling call
0709 12:59:25.047626 (+ 71337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.048108 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.048152 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.066015 (+ 17863us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.516004 (+449989us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:25.516089 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.516165 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.333820 (+817655us) raft_consensus.cc:1685] finished
0709 12:59:26.333903 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.334346 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":35833,"thread_start_us":371685,"threads_started":1,"wal-append.queue_time_us":1124050}
I20260709 12:59:26.416126  1603 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:26.418244  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:26.423519  1746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 1981) took 1767 ms (client timeout 1569 ms). Trace:
I20260709 12:59:26.423900  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:26.424436  1746 rpcz_store.cc:269] 0709 12:59:24.655904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.656387 (+   483us) service_pool.cc:224] Handling call
0709 12:59:26.422808 (+1766421us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54001c43d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:26.423082 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31858560}
I20260709 12:59:26.429049  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 1994) took 1512 ms. Trace:
I20260709 12:59:26.429795  1744 rpcz_store.cc:276] 0709 12:59:24.916047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.916232 (+   185us) service_pool.cc:224] Handling call
0709 12:59:24.916690 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.181610 (+264920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.181644 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:25.181688 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:25.181721 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.428155 (+1246434us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000d4b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:26.428309 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.428706 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608646016}
I20260709 12:59:26.438294  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.442301  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.443500  1602 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:26.444650  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:26.445604  1599 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:26.443279  5807 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:26.460153  5656 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.460711  1602 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:26.461928  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.462457  5814 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.463672  5658 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.472474  5719 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:26.461767  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.475274  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:26.476171  1603 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:26.477818  1601 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:26.478367  1601 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:26.479996  1601 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:26.481953  1601 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:26.484444  5365 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:26.485363  5365 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.489670  5857 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.491104  5719 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.492373  5716 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:26.490774  5857 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.493633  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:26.495216  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 71774.6us
I20260709 12:59:26.505244  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:26.493700  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:26.507866  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.508296  2312 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:26.525749  5856 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.509059  5857 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.509167  1674 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:26.510169  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.533304  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.534421  1678 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 12:59:26.510797  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.536427  1677 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:26.511358  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.512034  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.538064  1673 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:26.512321  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.512544  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.513845  1672 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:26.540109  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 198) took 7723 ms. Trace:
I20260709 12:59:26.514025  5766 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.514626  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.514765  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:26.543331  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.544196  1676 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:26.544901  1746 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:26.545463  5684 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:26.546218  5684 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:26.546418  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.548094  5684 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.523033  1603 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:26.549501  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:26.530387   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.520390  5365 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:26.519718  5719 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.545504  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:26.550447  1678 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:26.540343  1675 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:26.555591  5857 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:26.556165  5857 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:26.556667  5857 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.558570  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.560251  1595 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:26.565505  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.569031  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.573340  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.574553  1675 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:26.578655  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.580749  5719 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.578747  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.584510  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.540843  1496 rpcz_store.cc:276] 0709 12:59:18.816183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.817991 (+  1808us) service_pool.cc:224] Handling call
0709 12:59:18.917461 (+ 99470us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:59:26.537195 (+7619734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:21.613281 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:21.629322 (+ 16041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:21.629386 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:59:21.629405 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:21.630021 (+   616us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:21.630083 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:21.630116 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:21.630456 (+   340us) tablet.cc:701] Row locks acquired
0709 12:59:21.630471 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:59:21.630653 (+   182us) write_op.cc:270] Start()
0709 12:59:21.630775 (+   122us) write_op.cc:276] Timestamp: P: 1783601961630583 usec, L: 0
0709 12:59:21.630797 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:21.631528 (+   731us) log.cc:844] Serialized 1317 byte log entry
0709 12:59:22.374070 (+742542us) op_driver.cc:464] REPLICATION: finished
0709 12:59:22.567353 (+193283us) write_op.cc:301] APPLY: starting
0709 12:59:22.567496 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:22.567715 (+   219us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:22.567877 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:22.568417 (+   540us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:22.568654 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:22.568713 (+    59us) write_op.cc:312] APPLY: finished
0709 12:59:22.568987 (+   274us) log.cc:844] Serialized 35 byte log entry
0709 12:59:22.569210 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:22.569331 (+   121us) write_op.cc:454] Released schema lock
0709 12:59:22.569383 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:22.569848 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:22.569886 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52135,"reported_tablets":30,"spinlock_wait_cycles":48185088,"child_traces":[["op",{"apply.queue_time_us":171373,"apply.run_cpu_time_us":2510,"apply.run_wall_time_us":20367,"num_ops":3,"prepare.queue_time_us":135994,"prepare.run_cpu_time_us":31359,"prepare.run_wall_time_us":321016,"raft.queue_time_us":253909,"raft.run_cpu_time_us":48813,"raft.run_wall_time_us":144949,"replication_time_us":720937,"thread_start_us":488171,"threads_started":4,"wal-append.queue_time_us":331711,"wal-append.run_cpu_time_us":71883,"wal-append.run_wall_time_us":1588391}]]}
I20260709 12:59:26.585398  1675 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:26.595021  1670 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:26.595988  1746 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:26.603834  5856 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.604729  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:26.609941  1601 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:59:26.611052  1601 pending_rounds.cc:85] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 8
I20260709 12:59:26.603812  5719 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.611323  1601 pending_rounds.cc:107] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:59:26.615872  1601 raft_consensus.cc:2889] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:26.619057  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.619345  5719 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.622462  5719 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:26.626937  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 64116.6us
I20260709 12:59:26.627168  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.636466  1599 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:26.638166  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.641688  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:26.641810  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:26.642938  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.635080  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:26.645818  1744 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:26.661600  5703 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.662426  5703 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.663198  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:26.664088  1744 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:26.665259  5703 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.670441  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 75dc4812cc534228899ce2b7b14d2237 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:59:26.671409  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 75dc4812cc534228899ce2b7b14d2237 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-75dc4812cc534228899ce2b7b14d2237
I20260709 12:59:26.679937  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.680936  1676 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:59:26.687098  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52292.9us
W20260709 12:59:26.688639  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.698657  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.699856  1748 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:26.692646  5684 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:26.703306  5684 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:26.703915  5684 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:26.706226  5365 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:26.707641  5574 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:26.709285  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:26.709510  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.718228  5766 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:26.720319  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.722204  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.710353  5857 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:26.712649  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:26.714283  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:26.723618  1746 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:26.727842  1688 tablet_copy_source_session.cc:215] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.731297  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.731480  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.733023  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.736997  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:26.738462  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.745455  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.752852  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.759083  1675 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:26.762341  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.755174  1748 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:26.771739  1673 raft_consensus.cc:2368] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13.
I20260709 12:59:26.772495  1746 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:26.773770  1744 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 12:59:26.749732  5703 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:26.781322  5821 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:26.785696  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.792348  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:26.792999  1671 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:26.794144  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.795131  1674 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:26.796942  5821 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.794950  5703 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:26.796437  5857 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:26.807729  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.816418  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.817966  1678 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:59:26.820973  1670 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:26.832305  1744 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:26.830379  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:26.835807  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.841395  1746 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:26.846745  1674 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:26.845429  5821 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:26.873246  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 61273.8us
I20260709 12:59:26.882233  5703 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:26.889737  1674 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:26.898396  5836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc4812cc534228899ce2b7b14d2237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.910854  1670 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:26.923030  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.923834  1674 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:26.931010  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.948962  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:26.960173  1670 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:59:27.001930  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:27.003919  5549 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:27.001798  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:27.114104  5875 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:59:27.128322  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 103472us
W20260709 12:59:27.135977  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 189196us
I20260709 12:59:27.137097  5705 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:27.137814  5705 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:27.136266  1674 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:27.141430  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.141827  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.142199  1670 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:27.142555  1674 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
W20260709 12:59:27.156287  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 203431us
I20260709 12:59:27.143199  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:27.172678  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.174388  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.157696  1670 raft_consensus.cc:2376] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13. Re-sending same reply.
I20260709 12:59:27.177717  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:27.193549  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.195413  1677 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:27.196496  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.196812  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.195509  1669 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:27.197733  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.199990  1674 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:27.138901  5705 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.211772  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:27.213011  1671 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:27.213655  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.221906  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:27.229460  5684 consensus_meta.cc:287] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.000s
I20260709 12:59:27.229944  5766 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:27.232067  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.246057  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.247040  1674 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:27.234228  5684 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.257280  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.258862  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.259927  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.259991  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.261380  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:27.263662  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.269343  1678 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:27.271220  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.268417  5766 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:27.272436  5766 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.272838  5766 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.280613  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:27.281553  1671 raft_consensus.cc:2368] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13.
I20260709 12:59:27.287322  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.288437  5365 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:27.290400  5365 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:27.290920  5365 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.292273  5574 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:27.291313  5365 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:27.294898  5856 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.298254  5856 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.302937  5856 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.313130  5684 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:27.325775  5365 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.326831  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 95) took 6578 ms. Trace:
I20260709 12:59:27.340142  1501 rpcz_store.cc:276] 0709 12:59:20.746025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.758501 (+ 12476us) service_pool.cc:224] Handling call
0709 12:59:27.323067 (+6564566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:24.892066 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:24.892699 (+   633us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:24.892736 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:59:24.892756 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:24.893585 (+   829us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:24.893669 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:24.893697 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:24.894273 (+   576us) tablet.cc:701] Row locks acquired
0709 12:59:24.894292 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:24.894455 (+   163us) write_op.cc:270] Start()
0709 12:59:24.894576 (+   121us) write_op.cc:276] Timestamp: P: 1783601964894399 usec, L: 0
0709 12:59:24.894597 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:24.897131 (+  2534us) log.cc:844] Serialized 2069 byte log entry
0709 12:59:26.275300 (+1378169us) op_driver.cc:464] REPLICATION: finished
0709 12:59:26.525111 (+249811us) write_op.cc:301] APPLY: starting
0709 12:59:26.525324 (+   213us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:26.526308 (+   984us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:26.526469 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:26.646190 (+119721us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:26.647265 (+  1075us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:59:26.647347 (+    82us) write_op.cc:312] APPLY: finished
0709 12:59:26.667874 (+ 20527us) log.cc:844] Serialized 47 byte log entry
0709 12:59:26.733252 (+ 65378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.733516 (+   264us) write_op.cc:454] Released schema lock
0709 12:59:26.733604 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:26.734188 (+   584us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.734224 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1966035,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":249356,"apply.run_cpu_time_us":13774,"apply.run_wall_time_us":209116,"num_ops":5,"prepare.queue_time_us":195426,"prepare.run_cpu_time_us":10723,"prepare.run_wall_time_us":25826,"raft.queue_time_us":959098,"raft.run_cpu_time_us":15880,"raft.run_wall_time_us":177552,"replication_time_us":1380363,"thread_start_us":689809,"threads_started":5,"wal-append.queue_time_us":177512,"wal-append.run_cpu_time_us":26287,"wal-append.run_wall_time_us":1627637}]]}
I20260709 12:59:27.347968  5766 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.360879  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 260) took 2464 ms. Trace:
I20260709 12:59:27.363008  5836 rpcz_store.cc:276] 0709 12:59:24.896228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.896861 (+   633us) service_pool.cc:224] Handling call
0709 12:59:25.205980 (+309119us) ts_tablet_manager.cc:934] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 12:59:26.895748 (+1689768us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:27.309041 (+413293us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:27.309225 (+   184us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:27.359711 (+ 50486us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:27.360143 (+   432us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:27.360585 (+   442us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:27.360751 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":62244,"tablet-copy.queue_time_us":225789,"thread_start_us":325216,"threads_started":2}
I20260709 12:59:27.366852  5836 tablet_copy_client.cc:806] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.369594  5836 tablet_copy_client.cc:670] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.369814  5882 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:27.355249  5365 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:27.382177  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:27.383002  2316 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:27.382792  5365 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:27.392158  5574 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:27.393905  5574 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:27.394337  5574 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:27.398907  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:27.401916  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:27.395337  5574 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.407016  5574 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.408540  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:27.408855  5703 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.409562  5880 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.409418  5703 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.410504  5880 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:27.411463  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.412295  5703 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.424105  5788 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:59:27.425558  5788 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.425946  5788 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:27.431180  5836 tablet_copy_client.cc:538] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.436414  5766 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.426934  5788 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.439075  5788 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.439270  5365 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:59:27.463593  5365 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:59:27.472062  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.473115  5703 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.474793  5703 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:27.482823  5703 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.515928  5836 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
W20260709 12:59:27.565018  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.586401  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.588229  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.593400  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.594180  1674 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:27.594673  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.595110  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:27.597332  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.601951  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.602926  1674 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:27.603856  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.605039  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.605778  5888 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.607754  5888 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.614353  5549 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.615020  5549 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.617398  5549 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.605829  1674 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:27.606212  5703 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.618001  5549 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.619694  5549 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.619808  5703 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.622076  5549 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.618057  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.622756  5549 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.623292  5549 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.623600  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.624437  1676 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 12:59:27.625617  5549 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.628015  5883 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:27.628497  5883 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:27.629454  5703 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:27.627259  5885 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:27.636008  5885 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.636843  5885 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:27.636106  5703 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:27.639048  5703 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.630616  5880 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:27.642386  5880 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:27.629655  5883 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.643509  5880 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.645347  5880 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.646437  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.641340  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:27.648365  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.648954  1601 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:27.652266  5703 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:27.653149  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.663197  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.664548  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.665081  1747 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.665977  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:27.654314  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.667729  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.667958  1743 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.669180  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.669816  1594 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:27.655378  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.656208  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.668787   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.672307  1751 raft_consensus.cc:2410] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:59:27.673194  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.673890  1751 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:27.674646  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.659246  1601 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:27.671294  1745 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:27.676450  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.678803  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.657222  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.675410  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.680088  1599 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.680630  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.681854  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.682629  1601 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:27.683013  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.683727  1751 raft_consensus.cc:2410] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:27.689116  1599 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:27.684657  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.712265  1751 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:27.712436  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.713274  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.713388  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.713585  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.711406  1743 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:27.644310  5883 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.714730  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.714323  1752 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:27.719512  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.722754  1745 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:27.723909  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.725131  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.725971  1673 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:27.726269  1594 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:27.728858  1747 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:27.719698  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.729955  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.626989  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:27.731490  1752 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:27.641461  5888 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.732009  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.735932  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.742513  5574 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.743631  5887 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.744222  5887 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.746627  5887 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:27.748687  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.749442  1602 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.736470  1752 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:27.752563  1751 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:27.737071  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.754555  5549 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:27.754832  1745 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:27.755101  5549 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.755623  5549 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.743156  5574 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:27.759431  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.763566  1675 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:27.754118  1752 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:27.769917  1602 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
W20260709 12:59:27.770558  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.774231  1743 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:27.775080  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.775295  5885 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.775271  5574 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:27.781901  1747 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:27.770372  1745 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:27.785311  5885 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:27.787045  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 375619us
I20260709 12:59:27.787993  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:27.788935  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 162041us
I20260709 12:59:27.789716  5574 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:27.793840  1641 consensus_peers.cc:597] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60a0f19eac6047fdb1fd191d07ab7355. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.789824  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.792346  5885 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:27.800429  5574 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:27.802191  5574 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.802605  5574 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:27.801411  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.803929  5887 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:27.804344  5887 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:27.804730  5887 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.807999  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.808750  1594 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.811954  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.797775  5549 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.823525  1594 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:27.820940  5549 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:27.826140  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:27.826743  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.830641  5574 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.833238  5574 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:27.838877  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.839512  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.842315  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.845602  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.845907  1746 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:27.846437  1602 raft_consensus.cc:2410] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:27.846701  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.847661  1749 raft_consensus.cc:2410] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:27.848031  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.848750  1602 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:27.850023  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.850605  1602 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:27.853475  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.854226  1752 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:27.860172  5684 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.857997  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.861462  1602 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:27.862093  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.863899  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:27.867117  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66226.9us
I20260709 12:59:27.836391  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.871372  1746 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
W20260709 12:59:27.873947  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52029.1us
I20260709 12:59:27.873857  5365 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:27.876073  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:27.876163  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50141.4us
I20260709 12:59:27.876101  5365 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:27.878932  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.880373  1602 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:27.880518  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:27.881896  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:27.881768  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:27.881747  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:27.882627  2312 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 6.
I20260709 12:59:27.887514  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.888160  1602 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:27.886351  5365 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.892627  5719 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.879410  5574 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:27.854240  5887 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.886719  5885 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.894088  5574 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:27.894446  1715 leader_election.cc:400] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:27.897298  5365 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.906597  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.907310  1715 leader_election.cc:403] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:27.900543  1500 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 14, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.903403  1749 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:59:27.904332  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:27.908453  1594 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.911392  1749 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 11. Ops: []
I20260709 12:59:27.896086  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:27.907274  1603 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:27.912541  1751 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:27.913956  1500 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.920168  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.921010  1603 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:27.922289  5516 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:27.922461  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:27.922870  5516 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.922217  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:27.923300  5516 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.925292  5574 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.928579  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.932993  5888 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:27.946612  5887 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:27.946331  5888 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:27.933398  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48672.4us
I20260709 12:59:27.950376  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:27.935389  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.932843  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:27.952185  1750 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:27.942149  1594 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:27.935766  2312 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 3.
I20260709 12:59:27.945235  1748 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:27.934964  5857 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:27.957298  1602 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:27.958966  5365 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:27.932838  1566 connection.cc:256] RPC call timeout handler was delayed by -2.7982386770000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 12:59:27.933585  5882 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:27.966547  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:27.968894  1603 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:27.970010  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.970469  1566 connection.cc:256] RPC call timeout handler was delayed by -2.6911386770000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 12:59:27.936167  5705 consensus_queue.cc:1059] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:59:27.975462  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.977626  1750 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:59:27.978538  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.963914  5703 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.967893  5719 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:27.979936  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.982887  5719 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.983518  5719 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:27.986100  5888 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:27.984475  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:27.958418  5887 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:59:27.989166  5703 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:27.991761  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.991914  5703 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:27.992167  1594 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:59:27.992540  1566 connection.cc:256] RPC call timeout handler was delayed by -2.5264386769999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 12:59:27.992998  1566 connection.cc:256] RPC call timeout handler was delayed by -2.4517386770000371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 12:59:27.993333  5894 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:27.987635  5684 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:27.976359  5857 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:27.993929  5894 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:27.994546  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:27.993407  1566 connection.cc:256] RPC call timeout handler was delayed by -2.3680386770000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:59:27.995745  1566 connection.cc:256] RPC call timeout handler was delayed by -2.3658427639999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 12:59:27.995029  5857 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:27.996585  5365 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:27.997539  5856 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:27.996089  1566 connection.cc:256] RPC call timeout handler was delayed by -2.3208427639999627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 12:59:27.984807  1500 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.998677  5365 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:27.940075  5516 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:27.998342  5882 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:28.003938  1747 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:28.007953  5882 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.008531  5882 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:28.006258  5788 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:59:28.015038  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:27.995309  5894 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:28.021251  5516 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:28.021809  5894 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:28.025393  1566 connection.cc:256] RPC call timeout handler was delayed by -2.1229571789999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:59:28.026105  1566 connection.cc:256] RPC call timeout handler was delayed by -1.8780427639999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 12:59:28.026506  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7457427639999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 12:59:28.027197  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6173397439999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:59:28.027532  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6111386769999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2832s for a response
I20260709 12:59:28.028163  5365 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.016548  1500 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 13, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.028790  5856 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.030668  5703 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:28.034530  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:28.035502  1678 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:28.038197  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:28.042990  5684 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:28.047529  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.048746  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48844.2us
I20260709 12:59:28.064334  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:28.033186  5887 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:28.066747  1566 leader_election.cc:400] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9.
W20260709 12:59:28.069537  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.070509  1500 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.040196  5549 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:28.048151  5703 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:28.085841  5703 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:28.087806  5856 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.070297  5574 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.092705  5766 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:28.093927  5766 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.094990  5766 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.109246  5896 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:59:28.113780  1715 leader_election.cc:400] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13.
I20260709 12:59:28.114197  1715 leader_election.cc:403] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:59:28.115048  5887 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13.
W20260709 12:59:28.114861  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 80832.6us
I20260709 12:59:28.114846  5684 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:28.140806  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 102663us
I20260709 12:59:28.146641  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.141402  5882 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.170245  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.190119  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.154232  5882 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:28.169122  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:28.199050  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.201864  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.202194  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:28.202904  1675 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.204635  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.204802  5904 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:28.210422  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:28.213238  1674 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:28.211915  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.212075  1677 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:28.183748  5719 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.196626  5703 raft_consensus.cc:2764] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:59:28.221634  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.240240  5904 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.254098  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:28.277611  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 135881us
W20260709 12:59:28.278923  5899 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 12:59:28.287003  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.287925  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.332724  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 111596us
I20260709 12:59:28.334444  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:28.335484  5896 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:28.335990  5896 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.336350  5896 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.330440  1678 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:28.331470  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 117618us
I20260709 12:59:28.275630  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:28.341813  1677 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:28.344461  5719 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.347173  1676 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:28.335448  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:28.366281  1675 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:28.366811  1674 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:28.430253  1678 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
W20260709 12:59:28.449302  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 119497us
W20260709 12:59:28.456799  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.430408  5907 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:28.391595  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56218.1us
I20260709 12:59:28.507452  1677 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
W20260709 12:59:28.513746  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 175631us
W20260709 12:59:28.480274  1489 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.288s	user 0.011s	sys 0.032s
W20260709 12:59:28.392081  2279 leader_election.cc:336] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.912s (SENT)
I20260709 12:59:28.521168  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.524540  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.525514  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.526142  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.526921  1675 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:28.526926  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.526995  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.528092  1674 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:28.529145  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.531004  1678 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
W20260709 12:59:28.532631  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.508636  5914 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:59:28.511569  5896 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.534477  1669 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:28.533794  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.536005  5896 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.383534  5836 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:28.541661  1677 raft_consensus.cc:2368] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:28.545176  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:28.459956  5898 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.517419  5907 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:28.549211  1624 debug-util.cc:398] Leaking SignalData structure 0x7b08002b07c0 after lost signal to thread 434
W20260709 12:59:28.561962  1624 debug-util.cc:398] Leaking SignalData structure 0x7b0800296fa0 after lost signal to thread 1535
W20260709 12:59:28.562340  1624 debug-util.cc:398] Leaking SignalData structure 0x7b080012b960 after lost signal to thread 1549
W20260709 12:59:28.563395  1624 debug-util.cc:398] Leaking SignalData structure 0x7b08000987a0 after lost signal to thread 1627
W20260709 12:59:28.563678  1624 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6620 after lost signal to thread 1628
W20260709 12:59:28.564776  1624 debug-util.cc:398] Leaking SignalData structure 0x7b080031a9a0 after lost signal to thread 1702
W20260709 12:59:28.565048  1624 debug-util.cc:398] Leaking SignalData structure 0x7b080038c6c0 after lost signal to thread 1703
I20260709 12:59:28.565613  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:28.567132  1624 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdbe0 after lost signal to thread 1776
W20260709 12:59:28.569475  1624 debug-util.cc:398] Leaking SignalData structure 0x7b08002074c0 after lost signal to thread 2341
W20260709 12:59:28.569810  1624 debug-util.cc:398] Leaking SignalData structure 0x7b080031c2a0 after lost signal to thread 2342
I20260709 12:59:28.573169  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:28.574021  1594 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.574400  1595 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:28.544044  5766 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:59:28.568285  5898 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.579002  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:28.590606  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50131.8us
I20260709 12:59:28.587992  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:28.560840  5574 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:59:28.593271  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 210402us
I20260709 12:59:28.557127  5788 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:28.592070  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:28.585418  5907 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.595490  1750 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:28.598755  1603 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.618397  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:28.619284  2312 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:28.599807  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.624424  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.625090  5703 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:28.625447  5923 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:28.455036  5904 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:28.625744  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56070.8us
I20260709 12:59:28.630175  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.603180  5766 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:28.584762  5836 tablet_bootstrap.cc:492] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:59:28.631569  5766 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.631837  5919 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:28.632733  5766 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:59:28.633464  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 50748.9us
I20260709 12:59:28.634146  5766 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:28.636050  5836 ts_tablet_manager.cc:1403] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.121s	user 0.068s	sys 0.029s
W20260709 12:59:28.608011  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.613483  1745 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.641474  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.642449  5923 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:28.599867  1752 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:28.646061  5836 raft_consensus.cc:359] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:28.600005  5898 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.600201  5574 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.650305  5574 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:28.650841  5836 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:59:28.651791  5836 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:28.652958  1594 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:28.653852  5923 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:28.658218  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.661777  5923 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:28.662638  5923 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.664095  5703 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:28.664203  2312 raft_consensus.cc:1217] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:59:28.665633  5923 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:28.624017  5922 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:59:28.676622  5703 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:28.679128  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:28.684432  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49138.9us
I20260709 12:59:28.688656  5703 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:28.689491  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.689828  5703 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:28.690483  5703 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.694024  5894 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:28.694646  5894 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:28.695564  5898 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:28.696350  5898 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.697444  5894 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.697260  5898 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.701804  1745 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:28.704262  1752 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:28.711326  5365 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:28.712564  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.710265  5882 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:59:28.717669  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.721419  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.729082  5703 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.731633  1603 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 12:59:28.738092  5703 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.739913  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:28.758746  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.741338  5904 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:28.742262  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.751008  5930 ts_tablet_manager.cc:933] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:28.719719  5923 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:28.752199  5365 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:28.755529  5574 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:28.720453  5898 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:28.761478  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.766080  5766 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:28.766614  5766 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:28.767076  5766 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:28.767875  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.765594  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.771252  5684 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:28.771814  5684 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:28.772208  5684 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:28.772480  5836 ts_tablet_manager.cc:1434] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.136s	user 0.005s	sys 0.005s
I20260709 12:59:28.768708  5923 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.770431  5703 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:28.782563  5923 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.716081  1489 maintenance_manager.cc:643] P de45a76180d64c6884c212bcc9eaa1c0: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.322s	user 0.185s	sys 0.104s Metrics: {"bytes_written":30038,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":64146,"dirs.run_cpu_time_us":432,"dirs.run_wall_time_us":1686,"drs_written":1,"lbm_read_time_us":361,"lbm_reads_lt_1ms":4,"lbm_write_time_us":58465,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"raft.queue_time_us":125481,"reinsert_count":0,"rows_written":63,"thread_start_us":423364,"threads_started":3,"update_count":5,"wal-append.queue_time_us":284883}
I20260709 12:59:28.792058  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.764043  5904 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:28.817591  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.821704  5574 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:28.822535  1490 maintenance_manager.cc:419] P de45a76180d64c6884c212bcc9eaa1c0: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10601 bytes on disk
I20260709 12:59:28.825215  1489 maintenance_manager.cc:643] P de45a76180d64c6884c212bcc9eaa1c0: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":480,"lbm_reads_lt_1ms":4}
I20260709 12:59:28.826018  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-75dc4812cc534228899ce2b7b14d2237 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:59:28.820524  5719 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.828362  5719 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.826967  5896 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:28.830407  5896 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:28.830808  5896 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:28.830832  5719 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:28.834786  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.836341  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-75dc4812cc534228899ce2b7b14d2237 on tablet 75dc4812cc534228899ce2b7b14d2237 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:28.818475  5923 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:28.839847  5923 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.840222  5907 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:28.840983  5923 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.850229  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:28.851084  5897 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:28.851188  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:28.851749  5897 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:28.852242  5920 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:28.852813  5897 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.853854  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d7ba20be4524b828e4259656531c103"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:28.854624  1676 raft_consensus.cc:606] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:28.852818  5920 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:28.856221  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 134870us
I20260709 12:59:28.856411  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.856761  5930 tablet_copy_client.cc:323] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 12:59:28.857136  5920 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:28.861919  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.862778  5898 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:28.850416  5904 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:59:28.863888  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.865094  5934 raft_consensus.cc:2764] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:59:28.866570  1566 leader_election.cc:400] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:28.867007  5684 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.870138  5684 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:28.870886  5684 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:28.878382  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 60a0f19eac6047fdb1fd191d07ab7355 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 12:59:28.875875  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:28.871372  5684 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:28.884419  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45270us
I20260709 12:59:28.885119  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:28.885838  1752 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:28.887400  1747 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:28.887861  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:28.890142  1594 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:28.880172  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 60a0f19eac6047fdb1fd191d07ab7355 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-60a0f19eac6047fdb1fd191d07ab7355
I20260709 12:59:28.882396  5684 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:28.893210  5896 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:28.897884  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:28.899662  1745 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:28.901088  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:28.901827  1603 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:28.906090  1750 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:28.914120  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:28.914894  1670 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:28.916937  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:28.919010  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:28.919312  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:28.927456  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:59:28.927733  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.500s (SENT)
I20260709 12:59:28.930603  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:28.931319  1598 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:28.934329  5703 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:28.934460  1602 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:28.937144  1672 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:59:28.937353  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.508s (SENT)
W20260709 12:59:28.941624  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.515s (SENT)
I20260709 12:59:28.942207  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:28.947650  1671 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:28.931802  5907 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:28.909183  5766 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:28.958978  1715 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.516s (SENT)
I20260709 12:59:28.959594  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:28.940969  5896 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:28.962821  1715 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.545s (SENT)
I20260709 12:59:28.963301  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:28.973685  5365 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:28.977742  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 101979us
W20260709 12:59:28.980029  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.748s (SENT)
W20260709 12:59:28.980548  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53145.1us
I20260709 12:59:28.961138  5574 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:29.007447  5935 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:28.984764  5904 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:29.012151  1598 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:29.011688  1715 leader_election.cc:336] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.759s (SENT)
I20260709 12:59:29.014796  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:29.014137  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:29.024379  5904 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:29.025763  5766 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.034444  1670 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:29.035413  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:29.021278  5574 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:29.043516  5904 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.039418  5684 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:29.045624  5684 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.046044  5684 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.047771  5934 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:29.048432  5934 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:29.049467  5934 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.037478  5549 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:29.060114  5897 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:29.065722  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47073.7us
W20260709 12:59:29.074949  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 63280.9us
I20260709 12:59:29.076381  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:29.079526  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:29.079530  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:29.081274  1601 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:29.073598  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.085932  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:29.087288  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:29.105518  1601 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:29.079627  5766 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:59:29.105850  1748 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:29.108574  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:29.109380  1600 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:29.109404  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 96819us
I20260709 12:59:29.074853  5574 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.097864  1501 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:59:29.121582  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.133631  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58381.1us
I20260709 12:59:29.135933  1566 leader_election.cc:400] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 12:59:29.136296  1566 leader_election.cc:403] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:29.129284  5934 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.120316  5574 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.144697  5897 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:59:29.150869  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:29.154318  5574 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:29.152127  1600 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:29.159338  5920 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:29.150750  5934 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:29.161098  5934 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.152616  5684 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.181118  5684 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.154592  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:29.190650  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:29.187314  1501 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:29.193813  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 97007.5us
I20260709 12:59:29.200289  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:29.191461  5897 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.203687  5897 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:29.209304  5897 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.213255  5574 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.214005  5574 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.216554  5574 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:29.219020  5365 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.221727  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:29.198532  5684 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:29.224943  5365 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:29.226529  5365 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:29.205242  5923 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:29.225535  5920 raft_consensus.cc:993] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:29.233217  1566 leader_election.cc:400] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:29.233745  1566 leader_election.cc:403] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:29.230223  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:29.229964  5365 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.242501  1501 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 7 to 8, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:29.244122  5919 raft_consensus.cc:1081] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:29.236222  5953 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:29.244963  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:29.245992  5953 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:29.247622  5954 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 12:59:29.254400  5944 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:29.253558  5954 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:29.256270  5954 consensus_queue.cc:1243] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:29.255579  5923 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:29.265992  5923 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.258683  5574 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:29.268280  5574 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:29.246950  5953 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.271344  5365 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:29.229617  5684 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:29.261121  5934 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.257316  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 168) took 8477 ms. Trace:
W20260709 12:59:29.286716  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86465.3us
I20260709 12:59:29.276031  5935 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:29.296480  5935 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:29.298211  5574 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.298923  5935 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:29.299860  5684 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.306175  5944 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:29.306700  5944 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:29.289299  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:29.308733  5919 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:29.309293  5919 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:29.310621  5919 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:29.312326  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.313720  1670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:29.314680  1670 raft_consensus.cc:606] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:29.320984  1596 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:29.322461  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:29.322983  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 89939.3us
I20260709 12:59:29.323216  1603 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.279088  1500 rpcz_store.cc:276] 0709 12:59:20.779472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.783859 (+  4387us) service_pool.cc:224] Handling call
0709 12:59:29.257220 (+8473361us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:28.274900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:28.472274 (+197374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:28.475378 (+  3104us) write_op.cc:435] Acquired schema lock
0709 12:59:28.475411 (+    33us) tablet.cc:662] Decoding operations
0709 12:59:28.486203 (+ 10792us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:28.486345 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:28.486386 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:28.533495 (+ 47109us) tablet.cc:701] Row locks acquired
0709 12:59:28.533531 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:59:28.533750 (+   219us) write_op.cc:270] Start()
0709 12:59:28.534007 (+   257us) write_op.cc:276] Timestamp: P: 1783601968533682 usec, L: 0
0709 12:59:28.534037 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:59:28.534826 (+   789us) log.cc:844] Serialized 2089 byte log entry
0709 12:59:28.761821 (+226995us) op_driver.cc:464] REPLICATION: finished
0709 12:59:28.874217 (+112396us) write_op.cc:301] APPLY: starting
0709 12:59:28.874348 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:29.042539 (+168191us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:29.042687 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:29.046518 (+  3831us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:29.046765 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:59:29.046822 (+    57us) write_op.cc:312] APPLY: finished
0709 12:59:29.047184 (+   362us) log.cc:844] Serialized 57 byte log entry
0709 12:59:29.050428 (+  3244us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:29.050587 (+   159us) write_op.cc:454] Released schema lock
0709 12:59:29.050652 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:29.051074 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:29.051114 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3034,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":109737,"apply.run_cpu_time_us":17029,"apply.run_wall_time_us":176878,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18837,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":27073,"lbm_reads_1-10_ms":3,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":8,"num_ops":5,"prepare.queue_time_us":127331,"prepare.run_cpu_time_us":11432,"prepare.run_wall_time_us":295410,"replication_time_us":190538,"thread_start_us":177601,"threads_started":2}]]}
I20260709 12:59:29.327114  1601 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.329756  1597 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:29.328593  1594 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:29.335311  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:29.336061  1597 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
W20260709 12:59:29.336553  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.339125  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:29.339848  1752 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.341063  1600 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:29.343704  1599 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:29.345093  1750 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:29.346125  1603 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:29.348387  1744 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:59:29.349975  1744 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:59:29.350564  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:29.350605  1744 pending_rounds.cc:85] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 4
I20260709 12:59:29.351305  1749 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:29.351249  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:29.351737  1744 pending_rounds.cc:107] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:59:29.352216  1744 raft_consensus.cc:2889] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:29.353494  1750 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:59:29.353822  1750 pending_rounds.cc:85] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 7
I20260709 12:59:29.354038  1750 pending_rounds.cc:107] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:59:29.354236  1750 raft_consensus.cc:2889] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:29.355829  1602 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:29.356244  1602 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:29.348980  1595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d7ba20be4524b828e4259656531c103"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:29.361496  1595 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.361958  1595 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:29.373003  1601 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:59:29.378006  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:29.378793  1597 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 12:59:29.384686  5549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 9) took 3939 ms. Trace:
I20260709 12:59:29.386057  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:29.385339  5549 rpcz_store.cc:276] 0709 12:59:25.442028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.442255 (+   227us) service_pool.cc:224] Handling call
0709 12:59:25.515941 (+ 73686us) log.cc:844] Serialized 506 byte log entry
0709 12:59:26.407091 (+891150us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b180043ae00. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:26.465151 (+ 58060us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b4c0006e940. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f76b13f 00007f947f72f2ab 00007f947f75cf3c 00007f947f75d3fe 00007f947f9ea50b 00007f94813e9381 00007f94813e726b 00007f94813edd53 00007f94813edcd9
0709 12:59:29.381237 (+2916086us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99334,"raft.queue_time_us":128586,"raft.run_cpu_time_us":43435,"raft.run_wall_time_us":1411565,"spinlock_wait_cycles":940401664,"thread_start_us":33538,"threads_started":1,"wal-append.queue_time_us":708908,"wal-append.run_cpu_time_us":2339,"wal-append.run_wall_time_us":1019249}
I20260709 12:59:29.387008  1598 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 7: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:29.388197  1598 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:59:29.389087  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:29.390431  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:29.391433  1599 raft_consensus.cc:2410] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:29.387751  1602 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.432078  1602 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.457015  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:29.318845  5944 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:29.452661  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 173732us
I20260709 12:59:29.470418  1752 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:29.485049  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:29.485980  1603 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:29.514879  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:29.521733  1598 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:29.522362  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:29.490499  5922 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
I20260709 12:59:29.480695  5946 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.481858  5935 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.521162  5943 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 12:59:29.575603  5365 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:29.576234  5365 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:29.481236  5897 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.595408  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:29.606681  1602 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:59:29.616336  1602 pending_rounds.cc:85] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 6
I20260709 12:59:29.616884  1602 pending_rounds.cc:107] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:59:29.617264  1602 raft_consensus.cc:2889] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:29.618714  5365 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:29.621320  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.625834  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.577335  5953 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:29.648141  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52812.1us
I20260709 12:59:29.657199  5897 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.660378  1595 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.617621  5944 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:29.674273  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 144344us
I20260709 12:59:29.607873  5934 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.680238  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:29.681660  1595 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.577502  5935 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.588219  5946 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:29.764463  5964 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260709 12:59:29.778981  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 98837.8us
I20260709 12:59:29.607661  5954 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:59:29.740765  5968 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:29.669919  5955 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.780239  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.817195  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 222803us
W20260709 12:59:29.819317  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.798909  5934 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:29.880600  5946 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:29.880851  5965 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:59:29.857335  5970 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.143s	user 0.000s	sys 0.004s
I20260709 12:59:29.838873  5953 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:29.903379  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 224464us
W20260709 12:59:29.841703  5882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.007s	sys 0.012s
W20260709 12:59:29.927748  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69550.5us
I20260709 12:59:29.831967  5955 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:29.875721  5967 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:29.913098  5882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.013s
W20260709 12:59:29.931016  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 133949us
I20260709 12:59:29.941864  5967 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.953122  5972 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.933180  5935 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:29.969103  5955 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.971411  5967 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:29.951859  5953 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:29.985142  5985 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:29.940925  1688 tablet_copy_source_session.cc:215] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:29.953946  5684 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:30.012931  5950 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.700s	user 0.002s	sys 0.005s
W20260709 12:59:30.012670  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet 8507985adb5b47a187ad9f20a3c73870: Illegal state: Replica 1a40ab12c220464db732562e88c32c11 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:59:30.032135  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 119499us
I20260709 12:59:30.036904  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:30.040584  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.044760  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 465536us
I20260709 12:59:30.082626  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:30.083781  1748 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:59:30.085137  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.086055  1670 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:59:30.094631  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:30.095829  1748 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 2.
I20260709 12:59:30.097604  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:30.092463  2279 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 3.240s (SENT) [suppressed 51 similar messages]
I20260709 12:59:30.101233  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:30.111049  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 174085us
I20260709 12:59:30.098397  5968 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:30.099134  5963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.004s	sys 0.009s
I20260709 12:59:30.114665  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:30.127025  1674 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:30.127270  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.130162  1677 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:30.132251  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.128573  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.142213  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:30.142875  1669 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:30.044000  5972 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.147607  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:30.150763  1715 connection.cc:256] RPC call timeout handler was delayed by -1.1292854480000756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:59:30.159180  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0644854480000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 12:59:30.159374  1671 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:59:30.159750  1715 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.645s (SENT)
I20260709 12:59:30.147607  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:30.160235  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:30.149199  5963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.005s	sys 0.009s
W20260709 12:59:30.160434  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45893.7us
I20260709 12:59:30.160538  2316 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:59:30.161576  1715 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.671s (SENT)
I20260709 12:59:30.162704  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2072) took 1082 ms. Trace:
I20260709 12:59:30.162073  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.163218  1673 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:30.142836  5882 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:30.161700  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:30.158677  1688 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:38702 (request call id 770) took 1268 ms. Trace:
I20260709 12:59:30.167151  1669 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:30.163125  1745 rpcz_store.cc:276] 0709 12:59:29.084632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.084822 (+   190us) service_pool.cc:224] Handling call
0709 12:59:29.085162 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.095779 (+ 10617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.095804 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.105528 (+  9724us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.218671 (+113143us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:29.218735 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.218873 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.952968 (+734095us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:30.152835 (+199867us) raft_consensus.cc:1685] finished
0709 12:59:30.152861 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.162625 (+  9764us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4572,"raft.queue_time_us":10964,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":13071,"spinlock_wait_cycles":12311936,"thread_start_us":112636,"threads_started":1,"wal-append.queue_time_us":197266}
I20260709 12:59:30.171409  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.180362  5994 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:30.172035  1688 rpcz_store.cc:276] 0709 12:59:28.877968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.878156 (+   188us) service_pool.cc:224] Handling call
0709 12:59:29.884471 (+1006315us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400194e54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814973f7 00007f948642d036 00007f9486436a3e 00007f947dcfa27b 00007f94864369ba 00007f9486431acc 00007f948642cc7b 00007f94864218d1 00007f94854d54b4 00007f94854d5442
0709 12:59:30.146094 (+261623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913078144}
I20260709 12:59:30.181150  5994 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:30.137378  5919 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:59:30.166636  5971 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:59:30.145169  5967 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:59:30.184056  5992 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:30.162312  5719 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:30.184681  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92249.8us
W20260709 12:59:30.188072  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.208853  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:30.210400  5983 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.211004  5983 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.211453  5983 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.167440  5856 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:59:30.243355  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51414.2us
W20260709 12:59:30.248203  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.252285  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 90713.8us
I20260709 12:59:30.253073  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:30.190454  5992 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:30.244867  5944 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.550s	user 0.018s	sys 0.002s
I20260709 12:59:30.193034  5907 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.257588  5896 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:30.259997  5719 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:30.313891  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60906.6us
I20260709 12:59:30.314854  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:30.188787  5923 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 12:59:30.316037  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 154464us
I20260709 12:59:30.317569  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:30.328434  1715 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.691s (SENT)
W20260709 12:59:30.334885  1715 leader_election.cc:336] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.776s (SENT)
I20260709 12:59:30.293237  5992 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:30.335817  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.252792  5897 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 12:59:30.346849  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.325312  5968 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:30.324851  5963 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:30.322196  6006 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:30.246905  5987 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.259s
I20260709 12:59:30.330406  6005 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:30.356062  1715 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.889s (SENT)
W20260709 12:59:30.353024  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 104936us
I20260709 12:59:30.334898  5882 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:30.366379  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.371371  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:30.372418  5894 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.372697  1595 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:30.373018  5894 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.373660  5894 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.374152  1600 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:30.375294  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:30.376003  1601 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.379285  1594 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:30.382064  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:30.382941  6001 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 12:59:30.384227  1743 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:30.315722  5907 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.400604  1748 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:30.402760  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 85259us
I20260709 12:59:30.401525  1745 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:30.401710  5986 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:30.316566  5983 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:30.408710  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:30.354107  5963 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:30.411305  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 55270.8us
I20260709 12:59:30.413022  1752 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:30.418823  1752 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:30.420197  1601 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:30.334782  5976 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.235s
I20260709 12:59:30.429045  1599 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:59:30.418993  1715 leader_election.cc:336] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.921s (SENT)
I20260709 12:59:30.433712  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.435868  5904 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.436456  5904 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:30.436959  5930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a0f19eac6047fdb1fd191d07ab7355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.399251  6002 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:30.467641  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:30.351935  5991 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.316s
I20260709 12:59:30.462488  1599 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:59:30.475589  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56598.1us
W20260709 12:59:30.475557  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66933.7us
I20260709 12:59:30.528236  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:30.432802  1752 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.529793  1752 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:30.401929  5703 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:30.480795  5962 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.249s
I20260709 12:59:30.429189  5963 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.540512  6021 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.541237  6021 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:30.544126  6009 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:59:30.492949  5898 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:30.494319  5966 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:30.402868  6005 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:30.493940  6010 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:59:30.464862  6006 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:30.571309  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:30.575198  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:30.575984  1598 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:30.459857  5788 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:30.503993  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.502684  1602 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:30.445633  1745 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:59:30.586302  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:30.414650  5574 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:30.437840  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:30.437340  5961 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:30.525003  5919 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:59:30.536521  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52725.3us
I20260709 12:59:30.438764  5994 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:30.549111  1750 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:30.552479  1601 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:30.553828  1748 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:30.405617  5719 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.527204  6002 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.552975  5972 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:30.563862  1600 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:30.564221  5983 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:30.565039  6013 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:59:30.587260  1752 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:30.552114  5944 raft_consensus.cc:2764] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:59:30.431743  5968 raft_consensus.cc:2764] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:59:30.552716  5882 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.595386  5365 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:30.595654  5788 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:30.603523  6023 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:59:30.606700  1750 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:30.584538  6021 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:30.594146  5961 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:30.651249  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 123948us
I20260709 12:59:30.611300  5703 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:30.586524  1745 pending_rounds.cc:85] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 6
W20260709 12:59:30.736964  6018 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:59:30.737771  5788 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:30.695027  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71190.4us
I20260709 12:59:30.737015  1745 pending_rounds.cc:107] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:30.748041  1745 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.620584  6002 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.752063  5907 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:30.754374  6002 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:30.712822  5904 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:30.756469  6005 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:30.757817  5944 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.648345  6027 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 12:59:30.734619  5961 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:30.717432  5962 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:59:30.709913  5365 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:30.831278  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 110835us
W20260709 12:59:30.845571  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.789872  1750 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.848042  1750 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:30.837359  6028 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:59:30.761317  5963 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.862224  1670 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:30.877471  1676 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:30.878810  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.881259  5365 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:30.901355  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58442.4us
W20260709 12:59:30.841373  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.923578  1599 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:30.924168  1715 leader_election.cc:336] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.938s (SENT)
W20260709 12:59:30.924470  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.935233  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.858016  6005 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.926681  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
W20260709 12:59:30.928166  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 356916us
I20260709 12:59:30.939726  1676 raft_consensus.cc:606] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.940120  1676 raft_consensus.cc:614] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:30.868518  5953 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:30.939188  1715 leader_election.cc:336] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.010s (SENT)
I20260709 12:59:30.942267  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:30.877034  5966 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:30.843885  5944 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.945879  1597 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:30.945956  1715 leader_election.cc:336] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.054s (SENT)
I20260709 12:59:30.946964  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:30.842752  5894 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:30.946681  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.948370  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:30.961529  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:30.962280  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:30.963521  5365 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:30.963969  1715 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.082s (SENT)
I20260709 12:59:30.964551  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:30.971386  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:30.975522  1715 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.184s (SENT)
I20260709 12:59:30.945405  6006 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:30.977843  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:30.981218  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.992480  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:30.952010  6005 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:30.997478  5987 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:30.998208  1715 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.900s (SENT)
I20260709 12:59:30.999877  6005 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:31.004436  5992 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.650s	user 0.014s	sys 0.002s
I20260709 12:59:31.004997  5992 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.015023  1594 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:30.968564  6012 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:31.028932  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:30.954510  5953 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:31.037580  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 84590.1us
I20260709 12:59:31.039316  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:31.025187  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:31.007889  6032 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:59:30.959758  5966 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:31.011818  5919 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.007882  6024 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:31.007467  5992 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.066421  5365 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:31.068347  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:31.013010  5944 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.100402  5365 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:31.101122  5365 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.101697  5365 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:31.010977  5976 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:59:31.032543  6036 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:31.064013  5968 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:31.070698  6012 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:31.109299  6006 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:59:31.124189  6006 consensus_queue.cc:1243] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:31.124760  6006 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:31.125087  6006 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:31.125970  6006 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.130733  5953 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:31.136287  5963 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.113677  5549 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:31.139458  5549 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:31.140038  5549 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.139757  6006 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.148718  5894 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.033865  5994 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 12:59:31.170115  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 130877us
I20260709 12:59:31.177853  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:31.070106  5919 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.156065  6012 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.192265  5365 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.179335  6037 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:31.195703  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 167420us
I20260709 12:59:31.166193  5968 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:31.190595  6017 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.656s	user 0.005s	sys 0.018s
I20260709 12:59:31.164569  5904 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.203164  5904 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.206321  5904 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:31.212755  6040 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:59:31.200933  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:31.189057  6012 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.194826  6036 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:31.217343  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.237335  5365 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:31.238510  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:31.249150  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 145410us
W20260709 12:59:31.250066  6039 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:59:31.252283  6043 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:31.258402  5930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 272) took 2640 ms. Trace:
I20260709 12:59:31.261010  5919 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.262045  5966 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:31.262733  5966 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:31.264977  5882 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:31.265834  5904 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:59:31.268153  5897 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:31.270268  5994 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:31.270784  5994 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.271132  5994 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.247069  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:31.281677  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.259132  6038 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:31.288538  5365 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.297363  5365 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:31.291690  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.292949  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.301921  1752 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:31.304553  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 103695us
I20260709 12:59:31.308565  5365 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:31.319202  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.328462  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:31.283795  6050 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:31.348220  1752 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:31.325613  5985 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:31.362639  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 112131us
I20260709 12:59:31.368932  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.370970  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.349663  6050 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.383282  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:31.411106  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:31.357975  6036 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:31.424772  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:31.426142  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:31.383862  5985 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:31.258958  5930 rpcz_store.cc:276] 0709 12:59:28.618033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.657614 (+ 39581us) service_pool.cc:224] Handling call
0709 12:59:28.760371 (+102757us) ts_tablet_manager.cc:934] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 12:59:30.255086 (+1494715us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:31.006878 (+751792us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:31.007044 (+   166us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:31.257485 (+250441us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:31.257872 (+   387us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:31.258247 (+   375us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:31.258325 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8666,"tablet-copy.queue_time_us":92567,"thread_start_us":142750,"threads_started":2}
I20260709 12:59:31.449505  5930 tablet_copy_client.cc:806] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
W20260709 12:59:31.450055  6026 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.519s	user 0.002s	sys 0.002s
I20260709 12:59:31.450327  5930 tablet_copy_client.cc:670] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:31.445271  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.450085  6038 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.452337  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.452236  6038 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.453064  1743 raft_consensus.cc:2368] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:31.439674  5985 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:31.454852  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.455278  6038 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.456107  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:31.456758  6033 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 12:59:31.364395  5897 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:31.462901  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:31.463963  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:31.431807  2316 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:31.465564  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:31.465620  1715 leader_election.cc:336] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.618s (SENT)
W20260709 12:59:31.481590  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.481832  1675 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:31.481900  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:31.358062  6024 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:31.479789  1743 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:31.360774  5944 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:59:31.531278  1675 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:31.505028  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.533588  1751 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:31.507613  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:31.434154  5961 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.003s
I20260709 12:59:31.509403  5365 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:31.516263  2314 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.516424  2312 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:31.516779  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.755s (SENT)
W20260709 12:59:31.537089  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 177631us
I20260709 12:59:31.520098  6024 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.521168  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.521960  5549 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.407580  6050 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:31.522692  6051 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:59:31.524665  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59106us
I20260709 12:59:31.525578  6036 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.526089  6038 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.431248  6020 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:59:31.363662  5963 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 12:59:31.504906  1566 connection.cc:256] RPC call timeout handler was delayed by -3.471689533000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:59:31.543988  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:31.545257  2279 connection.cc:256] RPC call timeout handler was delayed by -1.0818630069999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26890000000000003s for a response
I20260709 12:59:31.550654  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:31.575676  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.579417  1566 connection.cc:256] RPC call timeout handler was delayed by -3.4239895329999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:59:31.580425  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:31.581024  1566 connection.cc:256] RPC call timeout handler was delayed by -3.3258895330000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:59:31.581478  1566 connection.cc:256] RPC call timeout handler was delayed by -3.2655895330000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:59:31.581877  1566 connection.cc:256] RPC call timeout handler was delayed by -3.2304895330000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:59:31.581969  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:31.582289  1566 connection.cc:256] RPC call timeout handler was delayed by -3.0432895330000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 12:59:31.582688  1566 connection.cc:256] RPC call timeout handler was delayed by -2.9334895329999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:59:31.584973  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.585853  1669 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:31.587819  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.588667  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.585779  1748 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
W20260709 12:59:31.552913  5995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.024s	sys 0.063s
I20260709 12:59:31.612092  5365 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.612969  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.629693  1748 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.507299  5897 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.638999  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:31.641768  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.643112  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.628901  5365 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:31.644371  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58349.1us
I20260709 12:59:31.645560  5365 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:31.628018  5995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.024s	sys 0.064s
I20260709 12:59:31.659680  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.527523  6012 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:31.668207  1743 raft_consensus.cc:2368] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 12:59:31.544220  5961 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.636473  5963 consensus_queue.cc:1243] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:31.701246  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.701591  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2103) took 1184 ms. Trace:
I20260709 12:59:31.705034  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:31.646397  6006 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.701979  1746 rpcz_store.cc:276] 0709 12:59:30.517699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.517833 (+   134us) service_pool.cc:224] Handling call
0709 12:59:30.540918 (+ 23085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.588367 (+ 47449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.588403 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.589064 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.867787 (+278723us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:30.867980 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.669784 (+801804us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b5400420754. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:31.669864 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.669938 (+    74us) raft_consensus.cc:1685] finished
0709 12:59:31.669958 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.701509 (+ 31551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":108100352,"thread_start_us":208398,"threads_started":1,"wal-append.queue_time_us":405902}
I20260709 12:59:31.685835  6005 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.722811  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:31.720225  1596 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:31.721864  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.585477  6038 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.725400  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.733390  1751 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.734911  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.724490  1744 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:31.714354  5995 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.745911  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:31.579356  6036 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:31.757047  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:31.759657  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 211577us
I20260709 12:59:31.760205  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:31.762403  1744 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:31.762511  1715 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.387s (SENT)
I20260709 12:59:31.763170  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:31.759195  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:31.767149  1751 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 4.
W20260709 12:59:31.764873  1715 leader_election.cc:336] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 3.313s (SENT)
I20260709 12:59:31.795672  1751 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:31.757673  5963 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:31.742990  5944 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:31.833246  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 68362us
W20260709 12:59:31.834144  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.834590  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.836834  1746 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:59:31.838594  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 92743us
I20260709 12:59:31.844435  1743 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:31.846942  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 260197us
I20260709 12:59:31.724287  6006 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:31.739856  6020 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:59:31.864261  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:31.699011  1748 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:31.901249  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:31.738397  6063 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 12:59:31.756273  6005 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:31.798086  5976 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:31.925809  6055 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:59:31.911062  6057 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:31.909119  6077 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:31.795804  5995 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:31.936507  5549 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:32.018906  1744 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
W20260709 12:59:32.034246  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 170093us
I20260709 12:59:32.040000  5365 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:32.044037  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:32.048089  5994 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.007s
I20260709 12:59:32.048568  5994 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:32.050627  6037 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.833s	user 0.008s	sys 0.003s
I20260709 12:59:32.050846  5994 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:32.051168  6037 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:32.052340  6066 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:59:32.010854  5944 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:32.015069  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.006531  5963 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:32.021133  5897 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:32.117456  1600 raft_consensus.cc:2410] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:59:32.109668  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 66110.7us
W20260709 12:59:32.119098  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 473649us
W20260709 12:59:32.168061  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47785.2us
I20260709 12:59:32.042878  5856 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:32.176107  5856 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.109233  5963 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.178823  5856 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.182050  5968 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:32.169296  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:32.173120  6074 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:59:32.174235  6062 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
W20260709 12:59:32.174938  6064 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 12:59:32.042263  6057 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.183853  5992 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:32.053560  6006 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.063722  6077 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:32.065276  5961 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:31.965664  5976 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.075845  6012 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.249116  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:32.170140  6037 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:32.255003  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 85838us
I20260709 12:59:32.256345  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:32.242364  5944 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:32.325650  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69621us
W20260709 12:59:32.251443  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.244277  5992 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:32.329500  5961 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:32.333170  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2167) took 1048 ms. Trace:
W20260709 12:59:32.331467  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 322642us
I20260709 12:59:32.248522  5963 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:32.357640  1595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.008s	sys 0.008s
W20260709 12:59:32.362916  1595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.008s
I20260709 12:59:32.254812  5968 raft_consensus.cc:2764] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:32.258882  5904 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:32.325703  6037 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.362656  1599 rpcz_store.cc:276] 0709 12:59:31.284453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.285816 (+  1363us) service_pool.cc:224] Handling call
0709 12:59:31.286586 (+   770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.286977 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.287008 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.304765 (+ 17757us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.595787 (+291022us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:31.595853 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.595958 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.332891 (+736933us) raft_consensus.cc:1685] finished
0709 12:59:32.332914 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.333095 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":585,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11417,"thread_start_us":227638,"threads_started":1,"wal-append.queue_time_us":392134}
I20260709 12:59:32.368068  1673 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:32.364590  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2168) took 1075 ms. Trace:
I20260709 12:59:32.366735  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:32.372877  1677 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 6: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 12:59:32.375648  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.219s (SENT)
I20260709 12:59:32.376250  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:32.381647  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.382205  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:32.382894  1599 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:32.382892  1672 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:32.390550  1676 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:32.356971  6036 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:32.372452  1595 rpcz_store.cc:276] 0709 12:59:31.289536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.305702 (+ 16166us) service_pool.cc:224] Handling call
0709 12:59:31.323942 (+ 18240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.324233 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:31.347567 (+ 23334us) log.cc:844] Serialized 14 byte log entry
0709 12:59:32.364050 (+1016483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.364114 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:32.364169 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.364252 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.364517 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14870,"prepare.queue_time_us":23477,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2770,"raft.queue_time_us":60773,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5546,"thread_start_us":1015979,"threads_started":2,"wal-append.queue_time_us":407332}
I20260709 12:59:32.366722  5961 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:32.433631  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.403038  6079 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:59:32.380182  5966 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:32.388852  6083 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:59:32.334522  5944 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.446907  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:32.447625  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70921.8us
I20260709 12:59:32.452011  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:32.480680  1715 leader_election.cc:336] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.393s (SENT)
I20260709 12:59:32.475021  6089 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:32.480737  1595 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11.
I20260709 12:59:32.462296  5684 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:32.402495  5992 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.497026  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.500814  1595 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:32.453616  5897 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:32.463382  5961 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:32.483031  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:32.510704  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:32.564915  1595 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:32.566274  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.567144  1595 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:32.576923  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.578744  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.579730  1595 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
W20260709 12:59:32.593566  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 112924us
I20260709 12:59:32.465900  5966 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.615664  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:32.617651  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1808) took 1180 ms. Trace:
I20260709 12:59:32.601449  5995 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.608994  6036 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.499477  5684 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.613642  6088 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.633488  1670 rpcz_store.cc:276] 0709 12:59:31.433521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.433729 (+   208us) service_pool.cc:224] Handling call
0709 12:59:31.434150 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.507521 (+ 73371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.507581 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.545827 (+ 38246us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.954927 (+409100us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:31.960773 (+  5846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.960904 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.613355 (+652451us) raft_consensus.cc:1685] finished
0709 12:59:32.613382 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.613532 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45061,"spinlock_wait_cycles":9984896,"thread_start_us":292426,"threads_started":1,"wal-append.queue_time_us":462453}
I20260709 12:59:32.642113  1595 raft_consensus.cc:2368] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
I20260709 12:59:32.562830  5944 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:32.627007  6034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.014s	sys 0.031s
I20260709 12:59:32.624398  5992 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:32.655413  6087 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:59:32.657465  6086 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 12:59:32.657859  6069 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.539s	user 0.000s	sys 0.001s
I20260709 12:59:32.690410  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2173) took 1375 ms. Trace:
I20260709 12:59:32.690752  5976 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.657671  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.691996  1602 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:32.690963  1597 rpcz_store.cc:276] 0709 12:59:31.315001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.186395 (+871394us) service_pool.cc:224] Handling call
0709 12:59:32.186819 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:32.187278 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.187311 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:32.188090 (+   779us) log.cc:844] Serialized 52 byte log entry
0709 12:59:32.352773 (+164683us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:32.352847 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.352969 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.688664 (+335695us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:32.690027 (+  1363us) raft_consensus.cc:1685] finished
0709 12:59:32.690049 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.690335 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55013,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":4744,"spinlock_wait_cycles":21072128,"thread_start_us":164133,"threads_started":1,"wal-append.queue_time_us":414840}
I20260709 12:59:32.618520  5997 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.322s
I20260709 12:59:32.693231  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.693979  1602 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:32.694036  6057 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.696161  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2166) took 1413 ms. Trace:
I20260709 12:59:32.693222  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:32.669196  6085 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 12:59:32.660485  1678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.515s	user 0.023s	sys 0.024s
I20260709 12:59:32.621223  6081 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:32.602818  5897 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.650972  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.675839  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.656160  6093 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.750185  6093 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:32.748659  1566 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54658 dropped due to backpressure: service queue is full with 50 items
I20260709 12:59:32.752853  6093 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.663738  6096 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:32.655799  6084 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:32.677881  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.038s	sys 0.032s
W20260709 12:59:32.761817  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.038s	sys 0.032s
I20260709 12:59:32.677325  5574 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:32.762221  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 854672us
I20260709 12:59:32.682861  5684 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:32.684018  6068 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.468s	user 0.004s	sys 0.000s
I20260709 12:59:32.684365  6037 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.602250  6067 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.392s
I20260709 12:59:32.694152  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 96) took 5219 ms. Trace:
I20260709 12:59:32.770440  1501 rpcz_store.cc:276] 0709 12:59:27.474558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.474802 (+   244us) service_pool.cc:224] Handling call
0709 12:59:32.694080 (+5219278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:29.841290 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:29.964113 (+122823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:29.964167 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:59:29.964193 (+    26us) tablet.cc:662] Decoding operations
0709 12:59:29.984727 (+ 20534us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:29.984793 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:29.984822 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:29.985478 (+   656us) tablet.cc:701] Row locks acquired
0709 12:59:29.985502 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:59:29.985683 (+   181us) write_op.cc:270] Start()
0709 12:59:29.985811 (+   128us) write_op.cc:276] Timestamp: P: 1783601969985617 usec, L: 0
0709 12:59:29.985834 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:59:29.986603 (+   769us) log.cc:844] Serialized 2132 byte log entry
0709 12:59:30.178526 (+191923us) op_driver.cc:464] REPLICATION: finished
0709 12:59:30.501136 (+322610us) write_op.cc:301] APPLY: starting
0709 12:59:30.514306 (+ 13170us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:30.766988 (+252682us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:30.767180 (+   192us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:31.000934 (+233754us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:31.001164 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:59:31.001215 (+    51us) write_op.cc:312] APPLY: finished
0709 12:59:31.001504 (+   289us) log.cc:844] Serialized 57 byte log entry
0709 12:59:31.031041 (+ 29537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.040719 (+  9678us) write_op.cc:454] Released schema lock
0709 12:59:31.057397 (+ 16678us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:31.110612 (+ 53215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.113569 (+  2957us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78156,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":285079,"apply.run_cpu_time_us":13586,"apply.run_wall_time_us":586937,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":516756,"prepare.run_cpu_time_us":7862,"prepare.run_wall_time_us":157210,"replication_time_us":179383,"thread_start_us":389579,"threads_started":2}]]}
I20260709 12:59:32.696768  1598 rpcz_store.cc:276] 0709 12:59:31.282920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.283244 (+   324us) service_pool.cc:224] Handling call
0709 12:59:31.283701 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.284101 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.284135 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.284714 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.740403 (+455689us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:31.740479 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.740592 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.695843 (+955251us) raft_consensus.cc:1685] finished
0709 12:59:32.695877 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.696076 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5898,"raft.queue_time_us":1211,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":29822,"thread_start_us":455055,"threads_started":1,"wal-append.queue_time_us":642646}
W20260709 12:59:32.667863  6078 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 12:59:32.674321  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1813) took 1210 ms. Trace:
I20260709 12:59:32.700676  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2120) took 1358 ms. Trace:
I20260709 12:59:32.700562  5966 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:32.704245  6050 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.151s	user 0.009s	sys 0.004s
I20260709 12:59:32.783794  1752 rpcz_store.cc:276] 0709 12:59:31.342225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.354449 (+ 12224us) service_pool.cc:224] Handling call
0709 12:59:31.367787 (+ 13338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:31.428429 (+ 60642us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:31.678232 (+249803us) log.cc:844] Serialized 14 byte log entry
0709 12:59:31.911912 (+233680us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:31.934346 (+ 22434us) log.cc:844] Serialized 52 byte log entry
0709 12:59:31.961169 (+ 26823us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:31.961212 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.961277 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.698989 (+737712us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:59:32.700334 (+  1345us) raft_consensus.cc:1685] finished
0709 12:59:32.700442 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.700604 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78169,"prepare.queue_time_us":328871,"prepare.run_cpu_time_us":2038,"prepare.run_wall_time_us":6947,"raft.queue_time_us":378662,"raft.run_cpu_time_us":3118,"raft.run_wall_time_us":449230,"spinlock_wait_cycles":4357376,"thread_start_us":429075,"threads_started":2,"wal-append.queue_time_us":613657}
I20260709 12:59:32.785485  6050 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:32.782687  1669 rpcz_store.cc:276] 0709 12:59:31.463500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.467127 (+  3627us) service_pool.cc:224] Handling call
0709 12:59:31.467473 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.592535 (+125062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.673969 (+1081434us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003e71d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:32.674222 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271719168}
I20260709 12:59:32.788029  6050 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:32.650458  6088 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.790620  6088 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:32.706051  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 1999) took 1156 ms. Trace:
I20260709 12:59:32.719264  1597 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:32.791332  1751 rpcz_store.cc:276] 0709 12:59:31.550105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.803979 (+253874us) service_pool.cc:224] Handling call
0709 12:59:31.806112 (+  2133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.806459 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.806497 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.825701 (+ 19204us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.324060 (+498359us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:32.324131 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.324250 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.705781 (+381531us) raft_consensus.cc:1685] finished
0709 12:59:32.705812 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.705984 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":413196,"threads_started":1,"wal-append.queue_time_us":630684}
I20260709 12:59:32.794960  6037 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:32.795948  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:32.675082  6034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.015s	sys 0.031s
I20260709 12:59:32.725829  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1804) took 1735 ms. Trace:
W20260709 12:59:32.729292  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.695211  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.830123  1602 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:32.726235  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45271.8us
I20260709 12:59:32.732164  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:32.734416  6030 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.809s	user 0.003s	sys 0.003s
I20260709 12:59:32.650955  6036 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.735414  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2150) took 2206 ms. Trace:
I20260709 12:59:32.828457  1676 rpcz_store.cc:276] 0709 12:59:30.990474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.990727 (+   253us) service_pool.cc:224] Handling call
0709 12:59:30.991231 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.401260 (+1410029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.725506 (+324246us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003232d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:32.725739 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3217102208}
I20260709 12:59:32.741293  5897 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:32.748688  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.886615  1595 raft_consensus.cc:2410] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:59:32.749385  6097 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:32.751880  1566 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54658 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2175)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2176)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1676)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1677)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1679)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1681)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1692)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1697)
I20260709 12:59:32.763101  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:32.766203  2314 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.843746  1603 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
W20260709 12:59:32.845263  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.787413  6041 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:32.855034  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:32.899523  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.900463  1595 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:32.886502  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:32.844364  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:32.889964  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.901336  1598 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:32.854439  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:32.895666  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.901762  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57464.9us
I20260709 12:59:32.855487  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:32.903504  1678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.759s	user 0.024s	sys 0.024s
I20260709 12:59:32.878865  1594 rpcz_store.cc:276] 0709 12:59:30.518205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.518447 (+   242us) service_pool.cc:224] Handling call
0709 12:59:30.518927 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.026180 (+507253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.724549 (+1698369us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400422054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:32.724860 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140154112}
I20260709 12:59:32.898056  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.906701  1597 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:32.906962  5365 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:32.855321  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:32.896554  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:32.909905  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:32.879779  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:32.911443  1676 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:32.901489  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.912796  1595 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:59:32.913916  1603 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:32.914333  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 151293us
I20260709 12:59:32.919008  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:32.921090  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.922312  1595 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 3.
I20260709 12:59:32.898850  5987 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:32.889333  6086 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:32.924598  5365 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:32.928493  5365 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:32.928692  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.929204  1750 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:32.929543  1603 raft_consensus.cc:2410] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:32.927611  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:32.769361  5574 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.878082  6088 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:32.887737  6089 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:32.933120  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.950939  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:32.952384  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.934526  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2114) took 1643 ms. Trace:
I20260709 12:59:32.954295  5882 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:32.943594  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.955104  5882 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.949550  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.957062  1602 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:32.957633  1746 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:32.929394  5365 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.958000  5882 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:32.958616  5365 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:32.958770  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:32.953270  1745 rpcz_store.cc:276] 0709 12:59:31.291596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.291715 (+   119us) service_pool.cc:224] Handling call
0709 12:59:31.292043 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.296618 (+  4575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.296655 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.297223 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.782709 (+485486us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:31.782775 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.782886 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.663161 (+880275us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:32.915926 (+252765us) raft_consensus.cc:1685] finished
0709 12:59:32.915961 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.934424 (+ 18463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9781,"raft.queue_time_us":12619,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7790,"spinlock_wait_cycles":49234048,"thread_start_us":451109,"threads_started":1,"wal-append.queue_time_us":701016}
I20260709 12:59:32.964349  6091 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:32.958045  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.968087  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.969129  1598 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:32.905563  5992 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.968494  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.903779  6041 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:32.898355  6006 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:32.971192  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.948047  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:32.904542  6097 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:32.923602  6057 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:32.978997  1602 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:32.979502  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 749) took 1299 ms. Trace:
I20260709 12:59:32.980298  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.930796  6103 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:32.783423  6084 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:32.958788  5966 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.998625  1598 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:33.013549  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.887066  6037 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.977541  6088 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.986476  5992 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.998171  1743 rpcz_store.cc:276] 0709 12:59:31.680039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.914065 (+234026us) service_pool.cc:224] Handling call
0709 12:59:31.941712 (+ 27647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.009115 (+ 67403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.009655 (+   540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.009741 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:32.009815 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.979254 (+969439us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b540013a954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:32.979305 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.979439 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153553152}
I20260709 12:59:33.016032  1594 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:33.003763  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:32.927057  5987 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:32.995810  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.024304  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:32.985137  6094 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.010349  1599 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:33.013686  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 746) took 1334 ms. Trace:
W20260709 12:59:33.014726  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.512s (SENT)
I20260709 12:59:32.797640  6096 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.018190  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.031024  1598 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:33.018936  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:32.985246  5999 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:33.033808  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.032s
I20260709 12:59:33.035941  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.037894  1597 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:33.025096  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
W20260709 12:59:33.027619  1715 leader_election.cc:336] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.621s (SENT)
I20260709 12:59:33.038622  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:33.026963  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.026461  1748 rpcz_store.cc:276] 0709 12:59:31.679039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.914494 (+235455us) service_pool.cc:224] Handling call
0709 12:59:31.914896 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.254877 (+339981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.254919 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.254973 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:32.255007 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.013394 (+758387us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400283a54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:33.013450 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.013616 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781264128}
I20260709 12:59:33.038964  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.040334  1603 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:33.044282  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.045181  1594 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.039857  1595 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:33.049150  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.050161  1595 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:33.051558  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.053859  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.014134  6057 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:33.060739  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.061740  1598 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 10 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:59:33.062451  1644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.028s	sys 0.087s
W20260709 12:59:33.062892  1644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.028s	sys 0.088s
I20260709 12:59:32.998138  6006 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:33.064774  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.068164  1676 raft_consensus.cc:1217] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Deduplicated request from leader. Original: 8.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:59:33.068262  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:33.068835  1676 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:59:33.069339  1670 raft_consensus.cc:2368] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:33.070364  1671 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:33.070709  1669 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:33.071988  1594 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:33.064462  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.072718  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:33.073247  1595 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 12:59:33.072018  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:33.078699  1675 raft_consensus.cc:1217] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[9.5-11.6]   Dedup: 11.6->[]
I20260709 12:59:33.079429  1675 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:59:33.089282  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.091612  1672 raft_consensus.cc:2368] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 12.
W20260709 12:59:33.092711  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 65140.5us
W20260709 12:59:33.093683  1715 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.657s (SENT)
W20260709 12:59:33.095816  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 142316us
I20260709 12:59:33.090292  1603 raft_consensus.cc:2376] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13. Re-sending same reply.
I20260709 12:59:33.015473  6089 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:59:33.035820  5882 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.101265  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.037113  5999 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:33.026927  6081 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:59:33.026117  5966 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.122629  1672 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:33.126299  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.128984  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.130874  1597 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:33.105867  6097 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.035714  6094 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.139698  5365 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:33.145546  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.145305  5365 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.152154  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.154855  5365 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.152737  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.041635  6041 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.159345  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:33.154982  1597 raft_consensus.cc:2376] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13. Re-sending same reply.
I20260709 12:59:33.130887  6117 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:33.116942  5882 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:33.175127  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.177816  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 80907.8us
W20260709 12:59:33.100302  1715 leader_election.cc:336] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.442s (SENT)
I20260709 12:59:33.182016  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.151505  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:33.189596  2279 connection.cc:256] RPC call timeout handler was delayed by -1.1405195110000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:59:33.190284  2279 connection.cc:256] RPC call timeout handler was delayed by -1.1405195110000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:59:33.190821  2279 connection.cc:256] RPC call timeout handler was delayed by -1.0262195110000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 12:59:33.191181  2279 connection.cc:256] RPC call timeout handler was delayed by -1.0262195110000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 12:59:33.191490  2279 connection.cc:256] RPC call timeout handler was delayed by -1.0109195109999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:59:33.191897  2279 connection.cc:256] RPC call timeout handler was delayed by -1.0109195109999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 12:59:33.200402  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.202080  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.203004  1598 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.193230  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.205541  1597 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:33.204438  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1796) took 3059 ms. Trace:
I20260709 12:59:33.219372  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:33.216413  6081 consensus_queue.cc:1243] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:33.181242  6041 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:33.224159  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 123874us
W20260709 12:59:33.230844  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.231405  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.180246  5944 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.236209  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.236970  1597 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:33.233542  1715 leader_election.cc:336] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.730s (SENT)
I20260709 12:59:33.199745  6100 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.199497  5923 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:33.239812  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:33.247664  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:33.240254  5944 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.251870  6088 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.253057  6084 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:33.255102  5989 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.255738  5989 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:33.256721  5989 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:33.153190  6057 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.218710  5574 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.250746  5923 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.163810  5999 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.217413  1678 rpcz_store.cc:276] 0709 12:59:30.133580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.133741 (+   161us) service_pool.cc:224] Handling call
0709 12:59:30.134079 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.134410 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:32.904041 (+2769631us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.191328 (+287287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:33.191388 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:33.191999 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.192079 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.192738 (+   659us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42964,"prepare.queue_time_us":190049,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":69,"raft.queue_time_us":42898,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12083,"thread_start_us":3003410,"threads_started":2}
I20260709 12:59:33.272816  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2109) took 2687 ms. Trace:
I20260709 12:59:33.275480  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:33.288226  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.288295  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54794.3us
I20260709 12:59:33.281777  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:33.287437  1597 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.291388  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.272362  6037 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.285027  5898 raft_consensus.cc:993] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:33.287418  1672 raft_consensus.cc:606] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
W20260709 12:59:33.274940  6121 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:33.286666  1749 rpcz_store.cc:276] 0709 12:59:30.585335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.621367 (+ 36032us) service_pool.cc:224] Handling call
0709 12:59:30.621848 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.276181 (+654333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.276218 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:31.276267 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:31.276302 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.250717 (+1974415us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54002e7554. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:33.272505 (+ 21788us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.272719 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504027392}
W20260709 12:59:33.283722  5961 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.002s
I20260709 12:59:33.316534  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:33.280041  6054 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:33.285044  5999 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.274224  6006 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.264457  6096 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.281304  5992 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.323663  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.335966  1598 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:33.273191  6073 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.015s	user 0.000s	sys 0.007s
I20260709 12:59:33.260766  5966 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.292876  6088 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:33.278019  5882 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.276902  6094 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.299639  5920 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:33.347978  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.348982  1751 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:33.321264  6084 raft_consensus.cc:1081] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
W20260709 12:59:33.347025  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.347316  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.412102  1749 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:33.414724  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:33.332022  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 114255us
I20260709 12:59:33.326555  5898 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:33.350785  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.324252  6054 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:33.416591  1745 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 12:59:33.417169  6054 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.274878  6100 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.327140  5961 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:33.381621  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:33.423252  1752 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.335815  5987 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:33.415516  1603 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:33.418985  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.421361  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:33.424839  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:33.426141  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92789.3us
I20260709 12:59:33.435624  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.454833  1751 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:33.455199  1602 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:33.437345  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.437667  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.458048  1603 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
W20260709 12:59:33.439764  1715 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.955s (SENT)
I20260709 12:59:33.437593  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:33.459932  2312 raft_consensus.cc:2368] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:59:33.460425  1566 leader_election.cc:400] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:33.449414  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.438014  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.460748  1566 leader_election.cc:403] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:59:33.427521  1598 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:33.465442  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:33.448323  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.438455  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.447228  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.469269  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.434284  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.474363  6089 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.474871  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:33.477087  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.477947  6094 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:33.478082  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:33.479362  6125 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:33.479645  6088 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:33.479900  6125 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:33.480604  6125 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:33.441727  5987 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:33.482869  5920 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:59:33.483207  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49194.7us
I20260709 12:59:33.443677  1597 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:33.428215  5944 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.489050  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.465042  5992 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.490185  1603 raft_consensus.cc:2368] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
I20260709 12:59:33.490077  5992 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.490573  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:33.494405  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.452611  6041 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.495743  6041 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.498423  6041 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.498893  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:33.483326  5920 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:33.500401  5920 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.501451  6037 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:33.501870  5920 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:33.502185  6037 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.502871  6037 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.503983  5987 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:33.507691  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2136) took 3138 ms. Trace:
I20260709 12:59:33.509733  1715 leader_election.cc:400] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
W20260709 12:59:33.508683  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 74506.5us
I20260709 12:59:33.508240  1596 rpcz_store.cc:276] 0709 12:59:30.369320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.371388 (+  2068us) service_pool.cc:224] Handling call
0709 12:59:30.371764 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.723866 (+1352102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.507341 (+1783475us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400038254. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:33.507606 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100183296}
I20260709 12:59:33.472050  6096 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:33.436717  6054 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:33.511713  1596 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:33.513113  5919 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:33.515017  5919 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:33.515126  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.515457  5919 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:33.511713  6100 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.484148  5961 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:33.516451  5919 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.508673  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:33.517985  5919 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.518321  1715 leader_election.cc:403] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:33.519062  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:33.519984  6070 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 1.058s	user 0.004s	sys 0.013s
I20260709 12:59:33.520236  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:33.520430  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.520849  5719 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:33.520102  5904 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:33.521412  5549 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:33.521502  5719 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:33.521793  5904 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:33.521998  5549 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:33.522365  5904 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.522730  5719 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.524210  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.514204  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1642) took 1183 ms. Trace:
I20260709 12:59:33.525112  6021 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:33.527448  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.516963  6097 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:33.523319  6005 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:33.524166  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2170) took 2232 ms. Trace:
W20260709 12:59:33.527413  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.530758  1596 rpcz_store.cc:276] 0709 12:59:32.330489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.510946 (+1180457us) service_pool.cc:224] Handling call
0709 12:59:33.511330 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:33.513880 (+  2550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.514137 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:33.546522  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.546830  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.547562  1596 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:33.531267  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 59590.6us
I20260709 12:59:33.542932  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.542975  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.517912  5992 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:33.555738  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.544795  1601 rpcz_store.cc:276] 0709 12:59:31.291854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.293912 (+  2058us) service_pool.cc:224] Handling call
0709 12:59:31.294350 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.294887 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:31.294931 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.311410 (+ 16479us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.745191 (+433781us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:31.745259 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.745370 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.519248 (+1773878us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:33.523800 (+  4552us) raft_consensus.cc:1685] finished
0709 12:59:33.523824 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.524102 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1516,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7695,"spinlock_wait_cycles":13835648,"thread_start_us":390222,"threads_started":1,"wal-append.queue_time_us":1037308}
I20260709 12:59:33.556577  1743 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 12:59:33.559581  1752 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:33.560447  1566 leader_election.cc:400] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 12:59:33.560467  1745 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:33.535979  5894 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:33.560915  1566 leader_election.cc:403] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:33.561635  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 52043.9us
I20260709 12:59:33.542891  5961 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:33.564576  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.573855  1674 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:59:33.574303  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.535650  6097 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:33.577836  1678 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:33.570148  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.573961  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.581722  1675 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 12:59:33.523058  5549 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.535275  5987 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7.
I20260709 12:59:33.585876  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.586126  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.587620  1598 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
I20260709 12:59:33.588768  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:33.591096  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:33.593981  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.571058  5961 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:33.598098  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.577198  5992 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 12:59:33.599223  1750 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:33.595942  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.604540  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:33.613227  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.584091  5894 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:33.621169  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:33.593447  6100 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:33.596814  6096 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:33.635638  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:33.609104  5961 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:33.629609  6100 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.612126  6041 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:33.645478  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.640352  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.636935  5992 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:33.627688  5944 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:59:33.659421  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.643188  1749 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:33.660689  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 144328us
W20260709 12:59:33.667719  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.708139  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.709928  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.713063  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:33.665000  6130 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:59:33.664194  6131 log.cc:927] Time spent T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:59:33.711675  6083 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:33.724426  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:33.726265  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.656699  6100 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.663188  6041 consensus_queue.cc:1243] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:33.628665  6097 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:33.668459  6132 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:33.662603  5953 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:33.704365  5972 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:33.755990  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.748065  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.707476  6005 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.711470  5944 consensus_queue.cc:1243] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:33.738234  6084 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:33.666132  6125 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:33.711990  6109 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:59:33.761019  6005 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:33.663609  5987 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 12:59:33.774286  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 161142us
W20260709 12:59:33.748865  6140 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:59:33.818012  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.849475  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:33.848104  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.864272  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:33.755000  5972 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:33.771857  6097 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.756264  5953 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:33.881937  6139 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:59:33.884212  6135 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:59:33.897037  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:33.909344  1602 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 12:59:33.900113  6115 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.637s	user 0.003s	sys 0.000s
W20260709 12:59:33.900615  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.712018  5894 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:33.906966  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.907848  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2175) took 2577 ms. Trace:
W20260709 12:59:33.922204  2279 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 3.240s (SENT)
I20260709 12:59:33.915684  1603 rpcz_store.cc:276] 0709 12:59:31.330603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.491206 (+2160603us) service_pool.cc:224] Handling call
0709 12:59:33.508049 (+ 16843us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:33.535951 (+ 27902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:33.535991 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:33.550624 (+ 14633us) log.cc:844] Serialized 52 byte log entry
0709 12:59:33.636804 (+ 86180us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:33.636853 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.636931 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.907489 (+270558us) raft_consensus.cc:1685] finished
0709 12:59:33.907525 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.907756 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":54440,"threads_started":1,"wal-append.queue_time_us":152356}
I20260709 12:59:33.852756  5944 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:33.939276  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.941751  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.942266  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.944475  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.929773  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 181587us
I20260709 12:59:33.878899  5972 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:33.906631  5953 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:33.935446  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:33.977125  1602 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:59:33.977972  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1675) took 1276 ms. Trace:
I20260709 12:59:33.978276  1602 rpcz_store.cc:276] 0709 12:59:32.701996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.940597 (+1238601us) service_pool.cc:224] Handling call
0709 12:59:33.976856 (+ 36259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.977659 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.977902 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:33.997213  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75063us
W20260709 12:59:34.003284  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.946947  6088 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:33.954310  6124 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:34.015470  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2132) took 1123 ms. Trace:
I20260709 12:59:34.016191  1744 rpcz_store.cc:276] 0709 12:59:32.892223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.893956 (+  1733us) service_pool.cc:224] Handling call
0709 12:59:32.894310 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.894708 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.894734 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.905150 (+ 10416us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.114424 (+209274us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:33.114508 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.114612 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.899179 (+784567us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:34.000460 (+101281us) raft_consensus.cc:1685] finished
0709 12:59:34.000498 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.015355 (+ 14857us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9893,"raft.queue_time_us":4011,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":20500,"spinlock_wait_cycles":46983040,"thread_start_us":165185,"threads_started":1,"wal-append.queue_time_us":267161}
W20260709 12:59:34.021946  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 157792us
W20260709 12:59:34.025389  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.026826  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.028192  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81981.9us
I20260709 12:59:33.975847  5992 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:33.985977  6111 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:33.949179  5944 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.022796  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:34.020955  5920 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.003s
W20260709 12:59:34.029146  6012 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.021s	sys 0.028s
W20260709 12:59:34.034255  6089 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.000s
I20260709 12:59:34.029016  5898 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:34.048786  1602 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:34.033222  6111 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:34.052192  5898 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.021461  6088 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.053678  6089 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:34.093952  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:34.067003  1749 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:34.096858  1744 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:34.058023  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:34.109272  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51318.7us
W20260709 12:59:34.046643  6012 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.021s	sys 0.028s
W20260709 12:59:34.079950  6054 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.568s	user 0.003s	sys 0.010s
I20260709 12:59:34.120645  1749 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:34.119340  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.085561  6094 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 12:59:34.116099  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.075310  6142 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:34.125059  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:34.138079  6142 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:34.138587  6142 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:34.138684  6094 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:34.139647  1751 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:34.140724  1746 raft_consensus.cc:2410] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:59:34.125433  5898 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.126005  6005 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:34.075033  5904 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
W20260709 12:59:34.056938  6141 log.cc:927] Time spent T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:59:34.074149  5919 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.555s	user 0.013s	sys 0.000s
I20260709 12:59:34.125818  6111 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.076992  5944 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:34.135640  6146 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:34.074036  6088 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:34.114688  6052 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:34.080946  6089 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.056077  6147 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:34.141798  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 119079us
I20260709 12:59:34.077404  6125 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:34.072779  5923 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.151695  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:34.206861  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 55246.3us
I20260709 12:59:34.155827  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 2174) took 2834 ms. Trace:
I20260709 12:59:34.159090  6041 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:34.161966  1603 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:34.211596  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1678) took 1508 ms. Trace:
I20260709 12:59:34.212080  1603 rpcz_store.cc:276] 0709 12:59:32.702808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.161275 (+1458467us) service_pool.cc:224] Handling call
0709 12:59:34.161697 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.211205 (+ 49508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.211497 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:34.134436  6144 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:59:34.172260  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:34.215646  1671 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.218321  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:34.218654  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.181157  1743 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:34.170838  1594 pending_rounds.cc:85] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 3
I20260709 12:59:34.219810  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.220225  1594 pending_rounds.cc:107] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 10.4
I20260709 12:59:34.220580  1594 raft_consensus.cc:2889] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.221362  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:34.172227  5999 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.008s
I20260709 12:59:34.143230  6036 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.223031  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.225455  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:34.153177  6023 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.209519  1600 rpcz_store.cc:276] 0709 12:59:31.321162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.014178 (+693016us) service_pool.cc:224] Handling call
0709 12:59:34.155403 (+2141225us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b5400039154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.155704 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99505536}
I20260709 12:59:34.227433  1595 raft_consensus.cc:1217] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:59:34.227993  1595 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:59:34.228531  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1681) took 1524 ms. Trace:
I20260709 12:59:34.228855  1595 rpcz_store.cc:276] 0709 12:59:32.703677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.226973 (+1523296us) service_pool.cc:224] Handling call
0709 12:59:34.227300 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.228297 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.228477 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.230345  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1686) took 1486 ms. Trace:
I20260709 12:59:34.230909  1669 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:34.185803  6084 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.203009  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:34.141441  5907 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:59:34.225797  1601 raft_consensus.cc:1217] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:59:34.266251  1601 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:34.214437  5919 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.267129  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1680) took 1563 ms. Trace:
I20260709 12:59:34.267624  1601 rpcz_store.cc:276] 0709 12:59:32.703342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.225297 (+1521955us) service_pool.cc:224] Handling call
0709 12:59:34.225666 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.266763 (+ 41097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.267053 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.205366  6147 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:34.196019  6052 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.262044  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.264410  1603 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:34.240083  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:34.269775  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66858.5us
I20260709 12:59:34.222332  1677 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:59:34.171137  5904 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.210927  6041 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:34.286710  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:34.195569  5985 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:59:34.291201  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1679) took 1588 ms. Trace:
I20260709 12:59:34.297688  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.297924  1603 rpcz_store.cc:276] 0709 12:59:32.703068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.213075 (+1510007us) service_pool.cc:224] Handling call
0709 12:59:34.264188 (+ 51113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.284825 (+ 20637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.291112 (+  6287us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:34.292255  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.172240  5961 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:34.230721  1595 rpcz_store.cc:276] 0709 12:59:32.743941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.229567 (+1485626us) service_pool.cc:224] Handling call
0709 12:59:34.229872 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.230057 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.230081 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.230123 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:34.230152 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.230203 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.230294 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.300294  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.293234  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.149083  5992 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:34.294431  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.304683  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.306098  1601 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:34.307770  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1692) took 1562 ms. Trace:
I20260709 12:59:34.308776  1601 rpcz_store.cc:276] 0709 12:59:32.745703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.301809 (+1556106us) service_pool.cc:224] Handling call
0709 12:59:34.302034 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.307016 (+  4982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.307703 (+   687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.310693  1601 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:34.311254  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1697) took 1564 ms. Trace:
I20260709 12:59:34.311524  1601 rpcz_store.cc:276] 0709 12:59:32.747151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.310282 (+1563131us) service_pool.cc:224] Handling call
0709 12:59:34.310560 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.311050 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.311209 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:34.269901  5549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.019s	sys 0.013s
I20260709 12:59:34.315299  1671 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:59:34.205163  6089 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.283715  6036 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:34.302500  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:34.315399  1674 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:34.293121  6052 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:34.320027  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.318503  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.316627  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.321264  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.283560  6147 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.291201  5944 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.291502  6049 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:34.327423  6089 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:34.328271  1743 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:34.270252  6084 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:34.329603  6113 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.063s	user 0.002s	sys 0.000s
I20260709 12:59:34.330471  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.331813  6041 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.332646  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.336174  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.337170  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.338778  6038 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.359220  6038 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:34.359824  6038 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.340909  5961 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.342429  1598 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:34.344519  1595 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:34.370615  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1688) took 1626 ms. Trace:
I20260709 12:59:34.371168  1595 rpcz_store.cc:276] 0709 12:59:32.744632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.300936 (+1556304us) service_pool.cc:224] Handling call
0709 12:59:34.344134 (+ 43198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.370291 (+ 26157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.370547 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.370687  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:34.336097  1748 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:34.346777  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1676) took 1644 ms. Trace:
I20260709 12:59:34.386183  1602 rpcz_store.cc:276] 0709 12:59:32.702279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.984781 (+1282502us) service_pool.cc:224] Handling call
0709 12:59:34.035263 (+ 50482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.049214 (+ 13951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.346485 (+297271us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5400038c54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:34.346707 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30444800}
I20260709 12:59:34.323899  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:34.315843  5549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.019s	sys 0.013s
I20260709 12:59:34.317894  6036 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.358021  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.337057  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:34.393157  1673 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:34.393432  1715 leader_election.cc:400] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
W20260709 12:59:34.354737  6037 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.851s	user 0.014s	sys 0.000s
I20260709 12:59:34.398697  6037 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.400619  5930 tablet_copy_client.cc:538] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:34.401803  6037 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.350900  6149 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:34.407441  6088 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:34.410825  6125 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:34.411522  6125 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.412025  6125 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.389072  6089 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:34.417622  6038 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.418092  6089 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.418673  6089 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:34.418792  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.419798  1602 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:34.419669  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:34.420565  6119 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.156s	user 0.000s	sys 0.002s
I20260709 12:59:34.420971  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.421414  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.422269  1603 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:34.422190  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:34.418253  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1677) took 1715 ms. Trace:
I20260709 12:59:34.392130  6041 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:34.391634  6036 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:34.438004  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:34.426509  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.431416  1747 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:34.423368  1603 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:34.441419  1603 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:34.441298  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.423182  1594 rpcz_store.cc:276] 0709 12:59:32.702550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.170195 (+1467645us) service_pool.cc:224] Handling call
0709 12:59:34.170608 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.221233 (+ 50625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.221268 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.221842 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:59:34.286755 (+ 64913us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:34.286793 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.286866 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.417971 (+131105us) raft_consensus.cc:1685] finished
0709 12:59:34.417994 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.418165 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":64463,"threads_started":1,"wal-append.queue_time_us":193822}
I20260709 12:59:34.420806  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:34.423601  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.446494  1602 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:34.434538  1601 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:59:34.447121  1601 pending_rounds.cc:85] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:34.447402  1601 pending_rounds.cc:107] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:59:34.447782  1601 raft_consensus.cc:2889] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.422851  1672 raft_consensus.cc:2376] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7. Re-sending same reply.
I20260709 12:59:34.445919  1595 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:34.428781  5904 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:34.397847  6163 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:59:34.451772  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:34.452028  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.431749  5972 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.353410  5944 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.478302  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:34.479604  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.480504  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.432220  6063 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:34.355724  6049 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.505806  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.436897  6084 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.526979  1672 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:34.509874  1752 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:34.455799  6149 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:34.517315  5944 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.504776  6142 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.514176  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:34.509346  5972 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:34.481482  1603 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.455516  6041 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.519445  1600 raft_consensus.cc:1217] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 12:59:34.536760  1600 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:59:34.495064  5930 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
W20260709 12:59:34.508153  6101 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.847s	user 0.006s	sys 0.002s
I20260709 12:59:34.524902  1594 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:34.543026  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.524688  6063 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:34.560411  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2179) took 1380 ms. Trace:
I20260709 12:59:34.560979  1595 rpcz_store.cc:276] 0709 12:59:33.180193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.449066 (+1268873us) service_pool.cc:224] Handling call
0709 12:59:34.479217 (+ 30151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.479436 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:34.510529 (+ 31093us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.559525 (+ 48996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.559653 (+   128us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:34.559785 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.559939 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.560274 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31384,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":298,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"thread_start_us":35843,"threads_started":1}
I20260709 12:59:34.559291  1596 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:34.437556  6098 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:59:34.453420  6012 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:34.531016  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2176) took 3184 ms. Trace:
W20260709 12:59:34.517304  6100 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.005s
I20260709 12:59:34.534523  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.586989  1597 rpcz_store.cc:276] 0709 12:59:31.346833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.491504 (+2144671us) service_pool.cc:224] Handling call
0709 12:59:34.165879 (+674375us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:59:34.166204 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:34.166797 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.166839 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:34.172102 (+  5263us) log.cc:844] Serialized 52 byte log entry
0709 12:59:34.292485 (+120383us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:34.292539 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.292621 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.518767 (+226146us) raft_consensus.cc:1685] finished
0709 12:59:34.518802 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.530920 (+ 12118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42145,"raft.queue_time_us":29579,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":9640,"spinlock_wait_cycles":37178624,"thread_start_us":75615,"threads_started":1,"wal-append.queue_time_us":141599}
I20260709 12:59:34.425909  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:34.435669  6088 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.097s
W20260709 12:59:34.524992  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 177877us
W20260709 12:59:34.554486  5953 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.573s	user 0.014s	sys 0.000s
I20260709 12:59:34.557482  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.558631  1603 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:34.567178  1599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1645) took 2226 ms (client timeout 1500 ms). Trace:
I20260709 12:59:34.570139  6142 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.571821  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:59:34.575312  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.577750  6125 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.580191  6149 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.544404  6041 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.593503  1677 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:34.593953  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.598268  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.598294  1599 rpcz_store.cc:269] 0709 12:59:32.332674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.416241 (+ 83567us) service_pool.cc:224] Handling call
0709 12:59:34.558332 (+2142091us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000794d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.558567 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638871936}
I20260709 12:59:34.599715  5953 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.605026  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 2190) took 1043 ms. Trace:
I20260709 12:59:34.643392  1598 rpcz_store.cc:276] 0709 12:59:33.561805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.620818 (+ 59013us) service_pool.cc:224] Handling call
0709 12:59:34.604739 (+983921us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54003b3154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.604942 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654013824}
I20260709 12:59:34.605741  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.612912  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.583392  6049 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.644712  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.646057  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.646898  1598 raft_consensus.cc:2410] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:34.647899  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.648424  1598 raft_consensus.cc:2376] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:59:34.649297  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.654043  5953 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:34.654989  1749 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:34.655314  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49681.5us
I20260709 12:59:34.655901  6088 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:34.596856  6100 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.659070  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:34.659991  1598 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:34.661444  6081 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:34.662248  6081 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.665460  6081 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:34.661635  6041 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:34.669762  6138 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.817s	user 0.002s	sys 0.000s
W20260709 12:59:34.672073  6145 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.719s	user 0.003s	sys 0.000s
I20260709 12:59:34.690554  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2145) took 1153 ms. Trace:
I20260709 12:59:34.691213  1748 rpcz_store.cc:276] 0709 12:59:33.537077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.538804 (+  1727us) service_pool.cc:224] Handling call
0709 12:59:34.335692 (+796888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.380918 (+ 45226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.690280 (+309362us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b540013b350. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.690466 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831624448}
I20260709 12:59:34.694890  1599 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:59:34.695381  1599 pending_rounds.cc:85] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 8
I20260709 12:59:34.695691  1599 pending_rounds.cc:107] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:59:34.695977  1599 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.661648  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.700121  1672 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:34.701293  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:34.704874  6147 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.706312  1602 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:34.711090  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.711932  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:34.712884  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.713481  1597 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:34.714298  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.715339  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.722033  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2184) took 1501 ms. Trace:
I20260709 12:59:34.722640  1599 rpcz_store.cc:276] 0709 12:59:33.220550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.637376 (+1416826us) service_pool.cc:224] Handling call
0709 12:59:34.637761 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.721794 (+ 84033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.721973 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:34.723999  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 62445.3us
I20260709 12:59:34.725941  1672 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:34.729126  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.737463  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.739053  1599 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:34.719283  1603 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:34.743887  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:34.746570  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.748023  1597 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:34.749260  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.697604  6100 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.753593  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:34.607383  6012 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:34.754786  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.615739  6089 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:34.753784  1603 pending_rounds.cc:85] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
I20260709 12:59:34.731788  5953 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.765501  1597 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:34.767055  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.756122  6098 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.766152  1603 pending_rounds.cc:107] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:34.768512  1603 raft_consensus.cc:2889] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.769215  1599 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:34.769296  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.771014  1597 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:34.753187  6088 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.773226  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.774812  1597 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 3.
I20260709 12:59:34.741125  6094 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:59:34.718077  6063 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.785440  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1708) took 1623 ms. Trace:
I20260709 12:59:34.798137  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.798377  1603 rpcz_store.cc:276] 0709 12:59:33.162377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.422928 (+1260551us) service_pool.cc:224] Handling call
0709 12:59:34.423242 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.785013 (+361771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.785346 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.799891  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:34.800431  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.804209  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:34.804909  1599 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
W20260709 12:59:34.801611  6096 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:59:34.809258  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 80277.4us
I20260709 12:59:34.810493  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:34.799985  6116 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:59:34.814795  1599 raft_consensus.cc:2376] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8. Re-sending same reply.
I20260709 12:59:34.772449  6098 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:34.808115  6063 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.815863  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.819530  1599 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:34.808456  6147 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:34.811901  5991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.008s	sys 0.015s
I20260709 12:59:34.835100  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:34.835965  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 100436us
I20260709 12:59:34.836962  1603 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 12:59:34.838378  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:34.826612  5991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.008s	sys 0.015s
I20260709 12:59:34.839784  1599 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:59:34.839710  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2182) took 1654 ms. Trace:
I20260709 12:59:34.843261  1595 rpcz_store.cc:276] 0709 12:59:33.185058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.599302 (+1414244us) service_pool.cc:224] Handling call
0709 12:59:34.633516 (+ 34214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.633765 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:34.753089 (+119324us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.839319 (+ 86230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.839380 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:34.839427 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.839495 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.839649 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122643,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1222,"thread_start_us":85765,"threads_started":1}
I20260709 12:59:34.840306  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:34.844261  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:34.844642  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.845181  1677 raft_consensus.cc:606] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:34.845577  1677 raft_consensus.cc:614] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:34.846441  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.847180  1599 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:34.848126  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.848732  1599 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:34.849428  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.850059  1599 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:34.857605  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:34.857856  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:34.858258  1595 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:34.858588  1603 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:34.856985  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2185) took 1622 ms. Trace:
I20260709 12:59:34.859130  1599 rpcz_store.cc:276] 0709 12:59:33.234533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.855993 (+1621460us) service_pool.cc:224] Handling call
0709 12:59:34.856402 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.856594 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.856621 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.856684 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:34.856715 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.856771 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.856922 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.861832  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2188) took 1307 ms. Trace:
I20260709 12:59:34.862396  1599 rpcz_store.cc:276] 0709 12:59:33.554614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.860025 (+1305411us) service_pool.cc:224] Handling call
0709 12:59:34.860439 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.860698 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.860740 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.860808 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:34.861319 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.861578 (+   259us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.861752 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:34.866595  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.852320  6147 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:34.867697  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.870520  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:34.871604  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.871902  1603 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:34.872606  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2187) took 1329 ms. Trace:
I20260709 12:59:34.872927  1603 rpcz_store.cc:276] 0709 12:59:33.543681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.859357 (+1315676us) service_pool.cc:224] Handling call
0709 12:59:34.871320 (+ 11963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.872334 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.872535 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.874519  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2193) took 1257 ms. Trace:
I20260709 12:59:34.874866  1603 rpcz_store.cc:276] 0709 12:59:33.616982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.873700 (+1256718us) service_pool.cc:224] Handling call
0709 12:59:34.874000 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.874180 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.874206 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.874252 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:34.874285 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.874339 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.874464 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.865686  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2191) took 1296 ms. Trace:
I20260709 12:59:34.877853  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.878690  1599 rpcz_store.cc:276] 0709 12:59:33.569231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.864291 (+1295060us) service_pool.cc:224] Handling call
0709 12:59:34.864889 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.865097 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.865143 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.865208 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:34.865258 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.865364 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.865601 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.880764  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.861449  6148 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:34.883805  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:34.891426  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:34.895720  6148 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:34.896317  6148 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.896715  6148 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.883674  5991 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:34.870191  6012 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:34.881625  6108 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:34.915078  1595 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 12:59:34.916792  1595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:34.917696  1595 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.918247  1595 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.881369  6089 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:34.894212  5549 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:34.893949  6149 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:34.880517  6147 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:34.934010  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.940613  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1704) took 1942 ms. Trace:
I20260709 12:59:34.950829  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.951449  1601 rpcz_store.cc:276] 0709 12:59:32.997962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.318766 (+1320804us) service_pool.cc:224] Handling call
0709 12:59:34.319300 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.448281 (+128981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.940244 (+491963us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001b4254. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:34.940530 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263995776}
W20260709 12:59:34.951988  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.941403  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2147) took 1403 ms. Trace:
I20260709 12:59:34.941646  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1672) took 2245 ms. Trace:
I20260709 12:59:34.953953  1596 rpcz_store.cc:276] 0709 12:59:32.696263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.550870 (+854607us) service_pool.cc:224] Handling call
0709 12:59:34.558880 (+1008010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.563401 (+  4521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.941410 (+378009us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000794d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.941574 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317170944}
W20260709 12:59:34.942298  6052 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.003s
W20260709 12:59:34.944763  6171 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 12:59:34.964146  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.964427  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:34.965523  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.966053  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:34.966598  1677 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:34.904814  5991 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.942349  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1682) took 2238 ms. Trace:
I20260709 12:59:34.971218  1600 rpcz_store.cc:276] 0709 12:59:32.704007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.228152 (+1524145us) service_pool.cc:224] Handling call
0709 12:59:34.519244 (+291092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.537232 (+ 17988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.942095 (+404863us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54004088d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.942284 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668561792}
I20260709 12:59:34.953481  1745 rpcz_store.cc:276] 0709 12:59:33.537733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.549051 (+ 11318us) service_pool.cc:224] Handling call
0709 12:59:33.560275 (+ 11224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:33.561051 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.941199 (+1380148us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54000d3250. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:34.941339 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24695168}
I20260709 12:59:34.957784  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2194) took 1336 ms. Trace:
I20260709 12:59:34.973851  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:34.973240  1603 rpcz_store.cc:276] 0709 12:59:33.621673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.875824 (+1254151us) service_pool.cc:224] Handling call
0709 12:59:34.876117 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.876327 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:34.888294 (+ 11967us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.957302 (+ 69008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.957361 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:34.957409 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.957527 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.957698 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8808,"prepare.queue_time_us":11705,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":1197,"thread_start_us":68579,"threads_started":1}
W20260709 12:59:34.940883  6173 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:59:34.945561  6122 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.691s	user 0.004s	sys 0.003s
I20260709 12:59:34.921787  6108 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:34.975853  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2200) took 1303 ms. Trace:
I20260709 12:59:34.978396  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.953428  6142 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.985430  1603 rpcz_store.cc:276] 0709 12:59:33.672474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.974757 (+1302283us) service_pool.cc:224] Handling call
0709 12:59:34.975265 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.975477 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.975517 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.975583 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:34.975616 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.975688 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.975791 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:34.990064  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:34.991499  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:34.984285  1595 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.001987  1603 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:35.002776  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2201) took 1293 ms. Trace:
I20260709 12:59:35.003644  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.003094  1603 rpcz_store.cc:276] 0709 12:59:33.708943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.001414 (+1292471us) service_pool.cc:224] Handling call
0709 12:59:35.001793 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.002486 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.002709 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.004972  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.006548  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.010286  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:34.977855  5991 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:34.976445  6088 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:35.017688  1595 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:34.985085  6098 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:34.980824  5549 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:34.985977  6108 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.989882  6094 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:35.026559  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54670 (request call id 2196) took 1383 ms. Trace:
W20260709 12:59:35.005705  6172 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:59:34.979717  6176 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.038985  1603 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:35.013715   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:35.032645  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:34.987844  5944 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.962229  6089 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:59:35.049942  1595 rpcz_store.cc:276] 0709 12:59:33.635103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.916406 (+1281303us) service_pool.cc:224] Handling call
0709 12:59:35.018295 (+101889us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:35.057264  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 91815.9us
I20260709 12:59:34.972108  6052 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.012863  5953 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.010869  6166 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.013936  6081 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:35.054291   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:35.017354  6054 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.031373  6088 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:35.018040  6100 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.084760  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.026705  6178 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:35.063274  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58363.5us
I20260709 12:59:35.044355  6084 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.109586  6084 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:35.117295  6179 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:35.076045  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.005851  6175 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:59:35.123272  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:35.123736  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 113585us
I20260709 12:59:35.124169  1677 raft_consensus.cc:2368] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:35.124640  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.125027  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.048273  6124 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:35.082010  1595 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:59:35.082257  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.026762  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:35.086038  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:35.086582  1675 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.051322  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:35.088124  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.049814  6094 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.089309  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2198) took 1436 ms. Trace:
W20260709 12:59:35.076617  6177 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:59:35.078926  6081 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.138600  6081 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:35.137255  1596 rpcz_store.cc:276] 0709 12:59:33.652814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.954974 (+1302160us) service_pool.cc:224] Handling call
0709 12:59:34.955319 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.955588 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:34.993215 (+ 37627us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.088843 (+ 95628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.088901 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.088962 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.089068 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.089228 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19703,"prepare.queue_time_us":71020,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":12085,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":95141,"threads_started":1}
I20260709 12:59:35.080785  6088 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.141656  6088 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:35.088583  6174 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 12:59:35.101393  6036 consensus_meta.cc:287] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.665s	user 0.002s	sys 0.012s
I20260709 12:59:35.147686  6036 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.102891  6052 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.104456  6147 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:35.107625  6180 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:35.125934  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.134677  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.152061  6188 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:35.152623  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.153730  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.154037  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.154702  6188 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.155582  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.157065  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.158347  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.159745  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.161171  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.163194  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.162564  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.137735  1677 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
W20260709 12:59:35.165469  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.164352  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.164947  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.168094  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.169350  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.169620  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.127420  6089 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.126688  6124 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:35.171263  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:35.166988  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57351.7us
I20260709 12:59:35.136011  6054 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.163585  6094 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.176796  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.189147  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2195) took 1563 ms. Trace:
I20260709 12:59:35.172281  5953 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:35.186398  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.190593  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.192862  1595 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:35.163393  5549 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:35.195734  6188 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:35.200229  6012 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.174103  6124 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.180902  6176 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:35.207630  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.213107  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.187747  6098 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.220784  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.223322  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2199) took 1568 ms. Trace:
I20260709 12:59:35.226011  5972 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:35.205143  5953 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.234367  5953 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:35.217064  6176 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.235885  6176 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.239874  1598 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:35.226589  5972 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:35.221192  6012 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:35.244659  6012 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.245114  6012 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:35.246754  5991 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.209935  6188 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:35.249202  6188 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:35.249645  6188 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.250041  6188 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.256178  5972 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.225474  1600 rpcz_store.cc:276] 0709 12:59:33.654697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.972286 (+1317589us) service_pool.cc:224] Handling call
0709 12:59:34.972643 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.972873 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:35.139689 (+166816us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.222867 (+ 83178us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.223045 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.223093 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:35.223133 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.223181 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.223273 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20206,"prepare.queue_time_us":55773,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":179,"thread_start_us":203544,"threads_started":2}
I20260709 12:59:35.228976  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:35.257463  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.184880  6054 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:35.259828  1669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 2021) took 2161 ms (client timeout 1913 ms). Trace:
W20260709 12:59:35.262423  1669 rpcz_store.cc:269] 0709 12:59:33.072205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.072428 (+   223us) service_pool.cc:224] Handling call
0709 12:59:35.228341 (+2155913us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400193554. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:35.228460 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642960768}
I20260709 12:59:35.235322  6057 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:35.272713  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.188128  6148 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.273869  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:35.288921  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.290403  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.274269  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 756) took 1190 ms. Trace:
I20260709 12:59:35.295661  1743 rpcz_store.cc:276] 0709 12:59:34.084188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.233719 (+149531us) service_pool.cc:224] Handling call
0709 12:59:34.259421 (+ 25702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.349885 (+ 90464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.273903 (+924018us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54000fa354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:35.274179 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157362944}
I20260709 12:59:35.276954  5991 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.300836  5985 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:35.303165  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 82449.4us
I20260709 12:59:35.227687  6084 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:35.307093  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:35.318219  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.286062  6057 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.320824  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.321456  1673 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:35.324856  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:35.304948  5972 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.331943  1669 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:35.332863  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.333341  1669 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:35.335420  1669 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:35.335289  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.321300  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:59:35.338724  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.325129  6057 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.345698  6098 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.349733  1595 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:35.309818  6081 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:35.311053  6108 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.350912  1669 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.362654  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.365633  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2197) took 1723 ms. Trace:
W20260709 12:59:35.369329  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.319877  6176 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.396968  1669 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:59:35.372833  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.376145  6148 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.377306  6054 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.324798  6195 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:35.341143  6196 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:35.397384  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51125.3us
I20260709 12:59:35.372347  6125 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.396931  1601 rpcz_store.cc:276] 0709 12:59:33.642169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.952551 (+1310382us) service_pool.cc:224] Handling call
0709 12:59:34.952935 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.953193 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:34.974987 (+ 21794us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.364963 (+389976us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b18002b2220. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a
0709 12:59:35.365219 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.365281 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:35.365334 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.365409 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.365564 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39815,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":5477,"raft.queue_time_us":19031,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":120,"spinlock_wait_cycles":6021376,"thread_start_us":68264,"threads_started":1,"wal-append.queue_time_us":105407}
I20260709 12:59:35.407912  1677 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:35.409082  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:35.410163  1598 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 12. Ops: []
I20260709 12:59:35.397719  6005 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:35.416710  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:35.416939  1669 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:35.420768  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:35.397069  6089 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:35.421700  1595 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:35.427433  1598 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:35.421640  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:35.428800  1598 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:35.445766  1598 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:35.440622  1669 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:35.444252  6178 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:35.451844  1595 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:35.399755  6088 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.456773  6063 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:35.457484  6012 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:35.451007  6195 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:35.405323  6094 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.462872  6081 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.464385  6108 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.425498  6054 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.416275  6196 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.471333  6067 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.488651  6196 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:35.490355  6094 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.478020  6063 consensus_queue.cc:1243] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:35.495863  6012 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.482642  6176 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.488250  6088 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.477329  6195 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.441260  5953 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.500152  6195 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.501942  5953 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.502965  6054 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.505455  6054 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.475167  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:35.507267  1595 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:35.508329  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:35.509299  6124 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.509872  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 1710) took 2332 ms. Trace:
I20260709 12:59:35.510438  1594 rpcz_store.cc:276] 0709 12:59:33.177512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.446036 (+1268524us) service_pool.cc:224] Handling call
0709 12:59:34.480995 (+ 34959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.543064 (+ 62069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.509552 (+966488us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b5400039154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:35.509793 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85841792}
I20260709 12:59:35.481515  6188 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.512293  6124 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:35.513437  6188 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.514866  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2177) took 2335 ms. Trace:
I20260709 12:59:35.515200  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:35.515954  1595 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:35.516916  6098 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.520624  6057 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.523000  6057 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.524811  1672 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:35.528198  6094 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:35.529003  6125 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:35.528887  6094 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.529747  6125 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.531311  6094 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:35.537031  6091 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:35.538089  6091 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:35.534854  6195 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.539644  6196 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.541774  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 786) took 1370 ms. Trace:
I20260709 12:59:35.542430  1675 rpcz_store.cc:276] 0709 12:59:34.171292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.171440 (+   148us) service_pool.cc:224] Handling call
0709 12:59:34.171808 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.134244 (+962436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.541395 (+407151us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400432454. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:35.541681 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103005056}
I20260709 12:59:35.545840  6196 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.536490  1595 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:35.505350  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 2005) took 2159 ms. Trace:
I20260709 12:59:35.567750  1747 rpcz_store.cc:276] 0709 12:59:33.345535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.345693 (+   158us) service_pool.cc:224] Handling call
0709 12:59:33.424715 (+ 79022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.440518 (+1015803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.936060 (+495542us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400075420. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481404dc0 00007f9481490a02 00007f948148cdd6 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 12:59:35.504960 (+568900us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000d4154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:35.505252 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2657299072}
I20260709 12:59:35.515450  1602 rpcz_store.cc:276] 0709 12:59:33.179488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.447223 (+1267735us) service_pool.cc:224] Handling call
0709 12:59:34.480186 (+ 32963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.706756 (+226570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.514527 (+807771us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000785d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:35.514783 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519504128}
I20260709 12:59:35.547119  6027 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:35.549011  6182 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:35.549209  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71633.9us
I20260709 12:59:35.551087  6195 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:35.552513  6170 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.716s	user 0.004s	sys 0.000s
I20260709 12:59:35.496387  6036 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:35.578868  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:35.618227  5549 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:35.580031  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:35.584566  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.502559  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:35.627054  5549 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:35.627823  5549 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:35.627367  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47478.7us
I20260709 12:59:35.594729  6147 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.633446  1566 leader_election.cc:400] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
W20260709 12:59:35.628257  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47048.6us
I20260709 12:59:35.593950  6182 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:35.632498  5549 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.639920  5549 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.617515  6192 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:59:35.636871  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 220245us
I20260709 12:59:35.644182  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:35.628011  5894 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:35.651134  5894 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.652438  6195 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:35.653043  6195 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:35.654071  6195 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.631722  6116 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:35.630702  6036 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.656044  6180 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:35.636987  6147 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.624708  6178 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:59:35.658635  6178 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:35.659020  6178 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:35.659580  6005 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:35.659994  6178 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.661381  6178 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:35.662722  6175 consensus_queue.cc:1175] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1a40ab12c220464db732562e88c32c11" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 6 } }
I20260709 12:59:35.664659  6182 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.644714  6192 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:35.667060  6192 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:35.655530  6125 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:35.671420  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.659303  6147 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:35.645426  6196 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.680409  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.681996  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.679383  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.683120  1745 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:35.683964  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.684593  1748 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:35.685065  1751 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:35.686131  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.681838  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.687045  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.634582  6124 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:59:35.692292  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.704456  1597 pending_rounds.cc:85] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:35.693819  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:35.675050  6057 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:35.651590  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.695457  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.696071  1752 raft_consensus.cc:1217] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Deduplicated request from leader. Original: 11.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 12:59:35.692935  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.701311  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:35.706529  1752 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:35.689038  6148 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:35.704380  1747 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:35.676734  6098 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.704963  1597 pending_rounds.cc:107] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:35.712010  1597 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.687817  5894 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:35.710876  1745 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:35.678342  5898 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:59:35.721710  5898 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:35.722115  5898 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:35.695138  5991 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.724454  1752 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:35.722949  5898 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:35.716045  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.725003  6098 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.697919  6192 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:35.702937  1641 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43001 timed out after 1.921s (SENT) [suppressed 40 similar messages]
I20260709 12:59:35.700137  6202 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:59:35.679348  6196 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.680473  5972 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.727892  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.727952  6094 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:59:35.728356  5972 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.725729  5898 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.728812  1745 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:35.717425  6036 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.729364  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.732401  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:35.730475  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83913.2us
I20260709 12:59:35.733287  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.716809  1748 raft_consensus.cc:2410] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:59:35.727276  6098 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.699999  5920 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:59:35.734205  1743 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:35.728035  1749 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:35.708173  6125 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:35.738268  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.745442  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.697202  6027 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:35.748029  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.755111  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.755841  1748 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.756311  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.759220  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.701393  5896 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:59:35.729372  6196 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.761803  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.761269  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 359) took 1438 ms. Trace:
I20260709 12:59:35.762547  1603 rpcz_store.cc:276] 0709 12:59:34.322809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.057400 (+734591us) service_pool.cc:224] Handling call
0709 12:59:35.254262 (+196862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.254494 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.254521 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.254565 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:35.254599 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.254659 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.761058 (+506399us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54003b3650. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:35.761196 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451727744}
I20260709 12:59:35.776535  1744 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:35.711086  6057 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:35.779183  1746 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:35.744830  6125 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:35.783571  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.754149  6166 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:35.761264  5944 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.761750  6036 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.794787  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.788275  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:35.793313  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 152262us
W20260709 12:59:35.805523  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 102614us
I20260709 12:59:35.808374  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:35.808650  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:35.809087  1669 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:35.790143  6125 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.822042  1669 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:35.827710  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:59:35.853787  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.866259  1748 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:35.787117  6196 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:59:35.868578  1673 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:59:35.872123  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.814742  1752 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:35.873869  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:35.875355  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:59:35.881309  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 93092.8us
I20260709 12:59:35.882838  2313 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:35.883666  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.886575  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:35.895505  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:35.899231  1744 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:35.822463  6108 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.889525  6148 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:59:35.908571  1603 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:59:35.909965  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.815824  6091 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:59:35.882057  6036 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:35.873206  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:35.883912  5972 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:35.888676  6111 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:35.929474  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:35.958348  1744 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:35.918799  6166 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:35.914295  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 12:59:35.965540  6206 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 12:59:35.969237  5930 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:59:35.971715  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.919660  6098 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.973832  1743 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:35.917062  6124 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:59:35.980301  1747 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:35.983047  2309 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:35.993206  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 65330.9us
I20260709 12:59:35.996073  1751 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:59:36.007320  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.015478  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.017095  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.018575  1751 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:36.019861  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.021162  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:35.975103  6221 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:36.023718  6166 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.024658  6221 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:36.043974  6216 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:59:36.044216  6221 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.045626  6123 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:36.046103  6123 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:35.983431  6219 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:36.066941  6091 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:59:35.978941  6098 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:59:36.073382  6201 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.443s	user 0.002s	sys 0.000s
W20260709 12:59:36.075448  6213 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:59:36.056636  6208 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:59:35.992547  6036 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:59:36.084583   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:36.093633  1744 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:36.032753  5991 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:59:36.095304  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 188209us
I20260709 12:59:36.046988  6123 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.101838  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:36.082195  6057 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:36.080724  6219 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:36.112166  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:36.113664  1744 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 6: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:36.100037  6211 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:59:36.114770  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:36.115590  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.077836  5972 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:59:36.129765  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.130759  1603 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:36.131910  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.134814  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.136390  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.134305  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1843) took 1838 ms. Trace:
I20260709 12:59:36.137926  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.140765  1603 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:36.117358  6222 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:36.141489  6222 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:36.141742  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.142488  6222 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.143074  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.138082  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:36.138262  6100 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:36.122697  6188 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.139008  1676 rpcz_store.cc:276] 0709 12:59:34.296103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.609574 (+313471us) service_pool.cc:224] Handling call
0709 12:59:34.610009 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.615068 (+  5059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.615105 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.632501 (+ 17396us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.547357 (+914856us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003236e0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 12:59:35.749449 (+202092us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.749514 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.749583 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.126957 (+377374us) raft_consensus.cc:1685] finished
0709 12:59:36.126987 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.134229 (+  7242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4603,"raft.queue_time_us":5247,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":26355,"spinlock_wait_cycles":23155456,"thread_start_us":201787,"threads_started":1,"wal-append.queue_time_us":1167637}
I20260709 12:59:36.139243  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:36.161993  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.154170  1744 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:36.147666  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.160312  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.165169  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.168293  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.170656  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.179719  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.179719  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.181533  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.183209  1744 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:36.186719  1744 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:36.189203  1744 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:36.191428  1744 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:36.148605  6202 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:36.219393  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.232577  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.137398  6225 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:59:36.254041  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:36.258855  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.168426  6188 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.209810  6202 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:36.261611  6216 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:59:36.139971  6219 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.288164  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.268155  6147 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.309247  1749 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:36.324049  1749 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:36.337373  6023 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:36.387781  6023 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:36.387979  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.335286  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:36.390309  1677 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:36.390914  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55757.2us
I20260709 12:59:36.344026  6202 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.346067  5930 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:36.403288  6027 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:36.403756  6124 consensus_queue.cc:1059] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:36.404181  5930 tablet_bootstrap.cc:492] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 12:59:36.403983  6027 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.405037  6124 raft_consensus.cc:3055] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:36.405404  5930 ts_tablet_manager.cc:1403] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.911s	user 0.058s	sys 0.019s
I20260709 12:59:36.350884  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.353394  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:36.398622  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.356648  1750 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:36.408023  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:36.360615  6188 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:36.363932  2316 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEARNER]: Advancing to term 12
I20260709 12:59:36.365459  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:36.368036  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.420073  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.423635  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.423982  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:36.425226  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.425642  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:36.322036  6178 consensus_meta.cc:287] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.002s
I20260709 12:59:36.371848  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:36.377278  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.379305  6210 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:59:36.384438  6148 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:36.384943  6094 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.385926  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.392195  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:36.450671  1676 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:36.394738  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.396160  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.397121  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:36.404278  5898 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.000s
I20260709 12:59:36.412756  6027 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:36.405416  6124 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:36.414314  6182 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.415068  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.406574  6221 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:36.482748  1669 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:36.417510  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.439059  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.468546  1600 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:36.490191  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.444419  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.406854  6084 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.446908  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:36.493736  1749 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 7: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:36.473920  1745 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:36.473608  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81526.2us
I20260709 12:59:36.496309  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:36.421334  6063 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.476020  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.452092  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.416599  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:36.498335  1745 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:36.503453  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.506528  1745 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:36.506601  1749 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:36.503947  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.505697  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:36.511086  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:36.512825  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.513931  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.514127  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.514225  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.509609  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:36.516829  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.516351  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:36.499562  1750 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:59:36.520838  1750 pending_rounds.cc:85] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 8
I20260709 12:59:36.484447  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.521138  1750 pending_rounds.cc:107] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:59:36.521442  1750 raft_consensus.cc:2889] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:36.522904  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:36.450920  6202 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:36.527129  1745 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:36.527276  1751 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:36.472245  6108 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:36.520362  1675 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:36.476264  6220 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:36.528862  1600 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:36.446549  6192 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:59:36.525693  6111 consensus_meta.cc:287] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.004s
I20260709 12:59:36.493053  6221 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:36.530848  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:36.537819  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:36.545148  5930 raft_consensus.cc:359] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:36.512665  6084 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.546941  6096 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.548213  2316 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:59:36.554042  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.475250  6094 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.560838  1675 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:36.388842  6023 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.569219  6005 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.572057  6240 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:36.573431  6226 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:36.512189  6200 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:36.482049  6225 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.471614  6148 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:36.580852  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50070.5us
I20260709 12:59:36.581419  1678 raft_consensus.cc:2410] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:36.526001  6100 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:36.536613  6125 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.007s
I20260709 12:59:36.584909  1751 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:36.559662  6108 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.513245  5944 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:36.582357  6221 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.601830  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:36.583361  5930 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 12:59:36.599767  6067 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.612958  6067 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.615998  6108 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:36.598951  6023 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.600895  6226 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:36.623221  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.590288  6124 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.625653  6124 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.616204  5972 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.593658  6096 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:36.657996  6096 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:36.627413  6098 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:36.660441  6084 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:36.598565  6240 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.659091  6096 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.665174  6240 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:36.667032  6094 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:36.667515  6226 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:36.594064  6175 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:59:36.596928  6100 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:36.669595  6100 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:36.630077  6180 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:36.608701  6125 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.685925  6180 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:36.693789  6178 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:59:36.681928  6222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.037s
W20260709 12:59:36.718230  6222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.038s
I20260709 12:59:36.717437  6225 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:36.722572  6221 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.592182  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:36.776684  1600 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:36.789363  1746 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:36.687276  5930 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:59:36.789440  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.800962  5930 ts_tablet_manager.cc:1434] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.395s	user 0.011s	sys 0.004s
I20260709 12:59:36.809921  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-60a0f19eac6047fdb1fd191d07ab7355 received from {username='slave'} at 127.0.0.1:38702
I20260709 12:59:36.810767  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-60a0f19eac6047fdb1fd191d07ab7355 on tablet 60a0f19eac6047fdb1fd191d07ab7355 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:36.825012  5985 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.864980  5985 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.831678  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:36.867102  1675 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:59:36.835423  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:36.842152  6027 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:36.843928  5896 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:36.870133  5896 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:36.870940  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:36.878460  1671 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:36.879163  1671 pending_rounds.cc:85] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 5
I20260709 12:59:36.851238  6125 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:36.853667  6148 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:36.854411  1677 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:36.706418  6178 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:36.871243  5896 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:36.884723  5896 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:36.885315  1671 pending_rounds.cc:107] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:36.885883  1671 raft_consensus.cc:2889] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:36.856302  6180 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.880563  6175 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.883090  6178 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.887527  6041 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:36.894734  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.894927  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.890561  6175 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:36.897290  5985 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:36.886653  5896 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.895511  6041 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.902392  6041 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:36.890784  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 791) took 2627 ms (client timeout 1824 ms). Trace:
W20260709 12:59:36.904469  1678 rpcz_store.cc:269] 0709 12:59:34.263637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.299424 (+ 35787us) service_pool.cc:224] Handling call
0709 12:59:36.875194 (+2575770us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b5400323cd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:36.890469 (+ 15275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5202215296}
I20260709 12:59:35.189702  1599 rpcz_store.cc:276] 0709 12:59:33.625975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.881975 (+1256000us) service_pool.cc:224] Handling call
0709 12:59:34.882507 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.882838 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:34.994402 (+111564us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.187096 (+192694us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.188705 (+  1609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.188767 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:35.188828 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.188910 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.189076 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8858,"prepare.queue_time_us":59985,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":48,"raft.queue_time_us":3152,"spinlock_wait_cycles":5720320,"thread_start_us":252290,"threads_started":2}
I20260709 12:59:36.910351  6175 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:36.915475  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:36.917047  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.894182  6178 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:36.927335  5894 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:36.928939  5896 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:36.929549  5894 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:36.929880  6094 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.930119  5894 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:36.930641  6094 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:36.931679  5894 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:36.934324  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.933637  6094 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:36.889844  6180 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:36.920285  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 805) took 1690 ms. Trace:
I20260709 12:59:36.990924  1671 rpcz_store.cc:276] 0709 12:59:35.229759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.229917 (+   158us) service_pool.cc:224] Handling call
0709 12:59:36.875466 (+1645549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.886703 (+ 11237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.919975 (+ 33272us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400323cd0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:36.920179 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3723964160}
I20260709 12:59:36.933718  5894 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.003935  6148 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.052506  5944 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:37.025600  5985 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.060716  1600 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:37.071126  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.071480  6123 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.071367  5985 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.072309  5991 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.074674  5985 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:37.075659  1602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.020s	sys 0.039s
I20260709 12:59:37.076696  5920 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:37.077023  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 762) took 1106 ms. Trace:
I20260709 12:59:37.077505  1746 rpcz_store.cc:276] 0709 12:59:35.970173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.971641 (+  1468us) service_pool.cc:224] Handling call
0709 12:59:35.972036 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.790323 (+818287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.076659 (+286336us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400283a54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:37.076925 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877547520}
I20260709 12:59:37.077560  5920 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.078553  5944 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.079174  5944 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.081730  5944 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.083184  6067 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.084210  6166 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:37.077755  1597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.006s
W20260709 12:59:37.087312  1597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.008s	sys 0.006s
I20260709 12:59:37.090123  6214 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:37.092362  1595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.009s
W20260709 12:59:37.096148  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 180896us
I20260709 12:59:37.102816  6067 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.110244  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2163) took 1130 ms. Trace:
I20260709 12:59:37.112522  6108 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:37.114193  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:37.114533  6182 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.019s
I20260709 12:59:37.115509  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:37.115972  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 514055us
I20260709 12:59:37.116981  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2167) took 1105 ms. Trace:
I20260709 12:59:37.120698  6214 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:37.123302  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 585330us
I20260709 12:59:37.091667  6250 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:59:37.148976  1595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.009s
I20260709 12:59:37.156510  6250 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.123670  6195 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.157178  6234 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:59:37.181723  6067 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.182552  5920 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.184448  6067 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.129454  6108 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:37.165243  1594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.011s	sys 0.004s
I20260709 12:59:37.160512  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:37.170038  6124 consensus_meta.cc:287] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.014s
I20260709 12:59:37.168232  6210 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.159495  6250 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:37.207907  1594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.011s	sys 0.004s
I20260709 12:59:37.135300  1747 rpcz_store.cc:276] 0709 12:59:36.011038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.022158 (+ 11120us) service_pool.cc:224] Handling call
0709 12:59:36.022479 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.022724 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:36.115617 (+ 92893us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.371130 (+255513us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:59:37.107767 (+736637us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.116270 (+  8503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.116377 (+   107us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:37.116527 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.116631 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.116796 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625300,"prepare.queue_time_us":972407,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":28573,"raft.queue_time_us":9398,"raft.run_cpu_time_us":1464,"raft.run_wall_time_us":91274,"spinlock_wait_cycles":11148032,"thread_start_us":416391,"threads_started":3,"wal-append.queue_time_us":256958}
I20260709 12:59:37.172027  6221 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:37.217501  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.161176  5985 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:37.226131  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.227582  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.229015  6096 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.230049  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.231842  5985 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.235005  5985 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:37.236469  6244 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.596s	user 0.005s	sys 0.000s
I20260709 12:59:37.238803  6188 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:37.241127  6100 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.010s
I20260709 12:59:37.241734  6100 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.247697  6100 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.248657  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 764) took 1168 ms. Trace:
I20260709 12:59:37.249284  1749 rpcz_store.cc:276] 0709 12:59:36.080172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.507495 (+427323us) service_pool.cc:224] Handling call
0709 12:59:36.507797 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.508525 (+   728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.508556 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.521023 (+ 12467us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.913273 (+392250us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b180020dbe0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 12:59:37.154456 (+241183us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:37.201365 (+ 46909us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.211772 (+ 10407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.222811 (+ 11039us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.222887 (+    76us) raft_consensus.cc:1685] finished
0709 12:59:37.248113 (+ 25226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.248384 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1556,"prepare.queue_time_us":19503,"raft.queue_time_us":11329,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":17127,"spinlock_wait_cycles":9092224,"thread_start_us":147799,"threads_started":1,"wal-append.queue_time_us":510950}
I20260709 12:59:37.128640  1748 rpcz_store.cc:276] 0709 12:59:35.979591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.979721 (+   130us) service_pool.cc:224] Handling call
0709 12:59:36.351454 (+371733us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368eee 0000000000375939 00007f94863dc1e0 00007f94864a50c4 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 12:59:36.351667 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.351929 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:36.885901 (+533972us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.109491 (+223590us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.109585 (+    94us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:37.109708 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.109818 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.110033 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":533408,"prepare.queue_time_us":675904,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":5178,"raft.queue_time_us":47614,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":6122112,"thread_start_us":171603,"threads_started":1}
I20260709 12:59:37.168980  6195 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.257229  6108 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:37.278299  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 117928us
I20260709 12:59:37.263998  5896 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.282131  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.287834  6063 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.288640  6063 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.292472  6195 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.251840  6210 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.263103  5985 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.291303  6063 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.284832  6108 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.306631  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.308605  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.309332  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.311662  1677 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:37.319887  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.320910  1670 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:37.321861  6147 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.327728  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.328641  1673 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:59:37.329771  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 133311us
W20260709 12:59:37.331053  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.327240  2316 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:59:37.341960  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.344295  1748 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:37.351965  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.353870  6182 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:37.354446  6182 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:37.354499  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:37.356261  6116 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.356362  6210 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.356956  6116 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.358124  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.358964  1673 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 5.
I20260709 12:59:37.359704  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:37.352077  5894 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.361042  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:37.361279  5894 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:37.354455  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 124649us
I20260709 12:59:37.362964  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:37.364084  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.311127  6166 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.367802  6147 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:37.368412  6067 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:37.367832  6063 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:37.369302  6195 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.370193  6063 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:37.370035  6067 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:37.370712  6063 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.370064  6195 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.371773  5896 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:37.372252  5896 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.373126  6195 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.373057  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:37.373950  6195 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.373482  5896 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.376027  6220 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:37.375118  6057 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.376786  6220 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:37.376818  6188 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:37.377532  6057 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.368680  6091 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:37.380101  6091 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.380613  6091 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.382773  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:37.382773  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.384491  6116 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.385532  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:37.378482  6220 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.374722  6195 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.385995  2315 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 12:59:37.367349  6202 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.835s	user 0.004s	sys 0.012s
I20260709 12:59:37.375377  5896 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:37.371441  6067 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:37.396919  6166 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.395072  6067 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.402299  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.393074  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.404296  1671 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:37.397778  6166 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.399816  6182 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.405395  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.403378  1749 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:37.411391  1748 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:59:37.407764  5985 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:37.420674  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.420902  6180 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.421700  6067 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.422273  6259 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.423306  6259 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.424733  6250 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:37.425637  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.417347  6147 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:37.423237  6067 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.429425  6096 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.417338  5894 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.411753  6178 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:59:37.397506  6063 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.415428  6100 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:37.442292  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 65712.4us
I20260709 12:59:37.430604  6250 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.440997  6259 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:37.471134  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81453.8us
W20260709 12:59:37.450187  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 74723.9us
I20260709 12:59:37.443763  6147 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:37.472774  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:37.449208  6057 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.473507  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:37.481590  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56152.4us
I20260709 12:59:37.487614  6084 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:59:37.489416  6084 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:37.489928  6084 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.492686  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.493517  6123 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.494127  6123 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.494969  6260 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.494432  6195 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.495661  6260 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.496229  1752 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:37.496785  6123 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:37.497612  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.473853  6100 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.505194  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.506708  6100 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.513020  6166 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.476661  6180 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:37.515646  6091 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.517146  6180 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.517764  6180 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:37.531142  6063 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.536441  6147 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.539994  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.540938  1671 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
W20260709 12:59:37.541911  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68483.3us
I20260709 12:59:37.542479  6195 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.542805  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:37.542604  6057 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:37.491173  6084 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:37.543313  6195 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.543992  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:37.544705  6084 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:37.545223  6094 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:37.546528  6094 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.546798  6091 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.546926  6094 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.548144  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:37.548959  1748 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:37.550024  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 71651.7us
I20260709 12:59:37.551095  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.552671  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:37.543762  6057 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.545849  6195 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.545800  6125 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:37.498034  6260 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.553471  6250 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.562863  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:37.564109  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:37.555120  6057 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.564810  1673 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.561801  5920 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.565508  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:37.565557  5920 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.558648  6166 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.559405  5985 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.557920  6125 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:37.576182  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 83717.5us
I20260709 12:59:37.567446  6091 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:37.571059  6100 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:37.571178  6125 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.570823  6259 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.574431  5985 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.585071  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:37.591430  1748 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:59:37.578239  6091 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:37.594581  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.595089  5985 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.593871  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:37.600255  2309 raft_consensus.cc:2393] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 7: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:37.593616  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:37.602946  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.588359  5920 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.587531  6259 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.608332  6259 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.605685  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.615638  6116 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:37.616379  6116 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:37.617597  6116 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.592906  6100 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:37.620540  6100 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.628203  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.632301  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.630517  6108 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:59:37.636467  6108 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:37.636952  6108 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.637024  6182 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.638017  6108 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.596069  6091 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:37.646816  1752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46136 (request call id 760) took 1677 ms (client timeout 1576 ms). Trace:
W20260709 12:59:37.647382  1752 rpcz_store.cc:269] 0709 12:59:35.969496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.971641 (+  2145us) service_pool.cc:224] Handling call
0709 12:59:36.353221 (+381580us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800105998. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368eee 0000000000375939 00007f94863dc1e0 00007f94864a50c4 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 12:59:37.646550 (+1293329us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540029e854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:37.646701 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309241472}
I20260709 12:59:37.647684  1673 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
W20260709 12:59:37.656445  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.660151  6258 raft_consensus.cc:2764] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Leader election decision vote started in defunct term 11: won
W20260709 12:59:37.660552  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 80268.5us
I20260709 12:59:37.661780  6258 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:37.661923  6091 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.664371  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 97) took 4144 ms. Trace:
I20260709 12:59:37.660699  6094 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.686223  6094 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.668197  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:37.668773  6180 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.676043  5991 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:37.687178  1673 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.687664  2316 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 12:59:37.676877  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44900.4us
I20260709 12:59:37.689407  5920 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:37.690570  5920 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:37.690977  5920 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.692267  5896 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:37.692130  5920 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.693212  5896 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:37.687772  5991 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:37.694110  5991 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.695116  5991 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.696398  5991 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.696640  6180 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:37.700390  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.700500  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:37.701221  1748 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:37.693622  5896 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:37.702634  5896 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:37.704229  5896 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.679768  1501 rpcz_store.cc:276] 0709 12:59:33.520002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.520365 (+   363us) service_pool.cc:224] Handling call
0709 12:59:35.118898 (+1598533us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b5400002490. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368e9c 00007f947e3690f6 00007f94872e2a89 00007f948727ada6 00007f948724c088 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc
0709 12:59:37.664076 (+2545178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:35.919740 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:36.083812 (+164072us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:36.085287 (+  1475us) write_op.cc:435] Acquired schema lock
0709 12:59:36.092488 (+  7201us) tablet.cc:662] Decoding operations
0709 12:59:36.127054 (+ 34566us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:36.132776 (+  5722us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:36.137791 (+  5015us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:36.173892 (+ 36101us) tablet.cc:701] Row locks acquired
0709 12:59:36.177459 (+  3567us) write_op.cc:260] PREPARE: finished
0709 12:59:36.212198 (+ 34739us) write_op.cc:270] Start()
0709 12:59:36.231619 (+ 19421us) write_op.cc:276] Timestamp: P: 1783601976208010 usec, L: 0
0709 12:59:36.240612 (+  8993us) op_driver.cc:348] REPLICATION: starting
0709 12:59:36.327945 (+ 87333us) log.cc:844] Serialized 599 byte log entry
0709 12:59:37.417000 (+1089055us) op_driver.cc:464] REPLICATION: finished
0709 12:59:37.584657 (+167657us) write_op.cc:301] APPLY: starting
0709 12:59:37.584831 (+   174us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:37.635103 (+ 50272us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:37.635357 (+   254us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:37.636305 (+   948us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:37.636572 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:59:37.636640 (+    68us) write_op.cc:312] APPLY: finished
0709 12:59:37.637050 (+   410us) log.cc:844] Serialized 25 byte log entry
0709 12:59:37.646321 (+  9271us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:37.646462 (+   141us) write_op.cc:454] Released schema lock
0709 12:59:37.646525 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:37.647168 (+   643us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:37.647206 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":8767232,"child_traces":[["op",{"apply.queue_time_us":144379,"apply.run_cpu_time_us":5670,"apply.run_wall_time_us":62544,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":244899,"prepare.run_cpu_time_us":21587,"prepare.run_wall_time_us":801872,"raft.queue_time_us":151088,"raft.run_cpu_time_us":64546,"raft.run_wall_time_us":172022,"replication_time_us":1147527,"thread_start_us":519044,"threads_started":4,"wal-append.queue_time_us":795255}]]}
I20260709 12:59:37.693620  5920 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.711910  6148 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:37.712460  6259 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.718806  6259 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.722160  6259 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.639475  6108 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.722494  1748 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:37.732723  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:37.733788  6180 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:37.733547  6057 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.734323  6180 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:37.735404  6180 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.738847  1673 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:37.710214  1496 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:37.751698  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:37.752672  6182 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:37.751804  1496 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.742676  6094 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.754472  6094 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.754781  1496 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.755964  1675 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:37.753225  6182 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:37.739938  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:37.758780  6182 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.759691  6259 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:37.760175  6259 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.760545  6259 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:37.757668  6094 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:37.764845  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.764431  1496 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 4 to 5, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.666260  6091 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.773448  6258 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:37.775126  1496 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:37.767762  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53605.5us
W20260709 12:59:37.780211  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 211820us
W20260709 12:59:37.811681  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.739218  6125 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.813004  6057 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:37.815557  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.820537  6125 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.814254  6258 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:37.825408  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.825959  6094 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.828034  1594 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:37.832475  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:37.834424  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:37.835268  1598 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:37.810678  6259 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.847473  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.848186  1748 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:37.829603  6166 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.851826  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.852161  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:37.857524  1670 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.854583  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:37.858307  1669 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.861132  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:37.862032  1677 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.852232  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:37.865619  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:37.866544  2316 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.846510  6125 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:37.872748  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.879488  1594 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:37.845219  6258 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.886366  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.859781  6188 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.863304  6094 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.901222  1600 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:37.902675  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.904520  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.905238  1752 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:37.909165  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.909678  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.910116  1748 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:37.912182  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.912819  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.913017  1749 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:37.919509  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.874990  6166 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.925737  6188 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.927870  2316 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:37.928195  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:37.928789  6188 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.932090  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:37.932972  6094 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.906298  6125 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.936712  6166 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:37.937481  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:37.937706  6125 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:37.938380  1596 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:37.942199  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.942870  1752 raft_consensus.cc:2368] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7.
I20260709 12:59:37.947394  1748 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:37.947598  1677 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 12:59:37.948793  2309 raft_consensus.cc:1217] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:59:37.951493  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:37.953801  2315 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:37.955005  1669 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:37.956697  6219 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:37.954881  1744 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:37.957440  6219 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:37.961723  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:37.962497  1750 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:37.963192  6219 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:37.964830  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.973419  6084 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:59:37.959764  5896 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.977021  6219 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:37.977635  6219 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.975471  5896 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:37.979404  1670 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:37.979867  6219 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.971916  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46970
I20260709 12:59:37.981056  1669 raft_consensus.cc:606] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Received request to transfer leadership
I20260709 12:59:37.983634  1751 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:37.983461  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:37.984530  6084 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:37.984974  6084 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.985348  6084 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.968365  5991 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.984548   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.973677  6259 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:37.998023  6258 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.000218  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.002228  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:38.003502  6123 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:38.005231  6258 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.005935  6258 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.010730  6057 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.011426  6057 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:38.013447  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.015846  5896 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.016146  6057 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.017328  6259 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:38.018215  1745 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:38.018019  6259 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.020522  6259 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:38.044464  6288 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:38.044740  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.048064  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:37.994557  5991 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.037664  6258 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.055233  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.050225  6108 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:38.063447  5896 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:38.064766  5896 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:38.065055  5896 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:38.065814  5896 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.066757  5896 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:38.071616  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.081414  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.082366  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.075609  6057 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.085218  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.093488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.090600  6125 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:38.095737  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.095793  6125 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.102838  1673 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:38.104789  1602 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:38.107298  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.107164  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.113461  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:38.106523  6125 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.117858  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.121456  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.092072  6057 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.127740  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.128379  6094 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.132845  6094 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.134946  6094 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.136976  6063 raft_consensus.cc:993] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:38.137602  6063 raft_consensus.cc:1081] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:38.142794  1743 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:38.124998  6188 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.129653  6195 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:38.144501  6195 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.118181  6123 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:59:38.144960  6195 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.144821  6057 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.130729  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.148253  1745 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:38.149528  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:38.182099  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50287.3us
I20260709 12:59:38.183681  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.185547  6305 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:38.186693  6305 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:38.185611  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.176347  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.200999  6057 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:38.201887  6057 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:38.203241  6057 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.208344  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.209698  6188 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:38.210446  6188 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:38.211454  6188 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:38.215605  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.218602  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.218698  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.219250  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.221957  1602 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:38.164014  5920 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:38.225365  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60439.1us
I20260709 12:59:38.234910  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:38.199992  6166 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:38.200122  5991 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.200214  6123 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.247855  2315 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:38.224933  5920 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:38.228127  5896 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.255888  5920 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.274892  6147 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.288765  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.260677  6166 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:38.293546  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.251506  6123 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.294355  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:38.296420  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.296994  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.292505  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:38.293692  6296 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
I20260709 12:59:38.268236  5896 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.188009  6305 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.315018  1748 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:38.301635  6297 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:59:38.318840  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.321221  1678 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:38.322371  1743 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:38.319900  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:38.324630  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.320482  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.328552  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.333773  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:38.334882  6259 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:38.304271  5985 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:59:38.335448  6259 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.336185  5896 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:38.337548  1745 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:38.292613  6147 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.338521  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.346004  1671 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:38.346067  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.336395  6258 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.336560  5985 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:38.365233  5985 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:38.366521  5985 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.352073  6023 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:38.352887  6259 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.345302  6219 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.368053  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.367269  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.339202  6148 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:38.384841  6166 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.378690  6148 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:38.385730  6148 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:38.340816  6100 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:38.392213  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47198us
I20260709 12:59:38.372689  6023 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:38.427955  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.375573  6258 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:38.424026  5985 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.421461  6023 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.422564  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
W20260709 12:59:38.443480  6306 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 12:59:38.448939  6084 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.406106  6219 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.451642  6123 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.439625  6147 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.426132  6100 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.453472  6219 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.455466  6100 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:38.467998  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.477123  1673 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 12:59:38.478965  1748 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:38.472473  6125 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.481513  1750 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:38.482692  6125 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.482312  6148 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.461306  6258 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.471097  5920 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.484941  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.486249  6147 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:38.486982  1597 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:38.486807  6147 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.489197  6147 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.489759  6147 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:38.490288  6147 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.492722  6180 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:38.493086  1748 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:38.474255  6084 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:38.474169  6195 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.486784  5920 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.495229  1746 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:38.495885  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:38.496042  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.496888  1743 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:38.497386  6116 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:38.496417  6195 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.497884  6116 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.498291  6116 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.499159  6147 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:38.502717  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 84025.8us
I20260709 12:59:38.506412  1600 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:38.506927  1600 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.501271  6023 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.511395  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.512692  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.513422  1595 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 6.
W20260709 12:59:38.514065  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.516435  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.516832  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.530786  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:38.532753  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.534777  1596 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.534997  1747 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:38.552809  1671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:38.553870  1671 raft_consensus.cc:606] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:38.534416  1501 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.560165  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.560730  1501 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 16 to 17, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:38.575686  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.569468  1501 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index -1 to 8, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:38.583376  1501 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.587980  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.559396  6125 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:38.591310  6313 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:38.590992  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:38.591423  6091 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.558730  6318 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:59:38.596369  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.599115  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:38.603765  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81265.1us
I20260709 12:59:38.603904  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 186) took 10987 ms. Trace:
W20260709 12:59:38.603724  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 80191.8us
I20260709 12:59:38.604028  1501 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.604485  1496 rpcz_store.cc:276] 0709 12:59:27.598548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.598777 (+   229us) service_pool.cc:224] Handling call
0709 12:59:38.585799 (+10987022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:37.963311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:37.969594 (+  6283us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:37.973610 (+  4016us) write_op.cc:435] Acquired schema lock
0709 12:59:37.986039 (+ 12429us) tablet.cc:662] Decoding operations
0709 12:59:38.015187 (+ 29148us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:38.015319 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:38.015348 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:38.016112 (+   764us) tablet.cc:701] Row locks acquired
0709 12:59:38.016172 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:59:38.016382 (+   210us) write_op.cc:270] Start()
0709 12:59:38.016570 (+   188us) write_op.cc:276] Timestamp: P: 1783601978016296 usec, L: 0
0709 12:59:38.016608 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:59:38.017394 (+   786us) log.cc:844] Serialized 2089 byte log entry
0709 12:59:38.259424 (+242030us) op_driver.cc:464] REPLICATION: finished
0709 12:59:38.383836 (+124412us) write_op.cc:301] APPLY: starting
0709 12:59:38.383940 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:38.414718 (+ 30778us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:38.414847 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:38.418466 (+  3619us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:38.418739 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:59:38.418799 (+    60us) write_op.cc:312] APPLY: finished
0709 12:59:38.419104 (+   305us) log.cc:844] Serialized 57 byte log entry
0709 12:59:38.420102 (+   998us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:38.424197 (+  4095us) write_op.cc:454] Released schema lock
0709 12:59:38.427483 (+  3286us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:38.443095 (+ 15612us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:38.443134 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147579,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":124093,"apply.run_cpu_time_us":9654,"apply.run_wall_time_us":59213,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":116930,"prepare.run_cpu_time_us":4720,"prepare.run_wall_time_us":54449,"replication_time_us":242634,"thread_start_us":191822,"threads_started":2}]]}
I20260709 12:59:38.609294  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:38.610479  1501 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:38.626415  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.652071  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.662194  1602 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:38.656499  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.663832  1595 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:38.662330  6057 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:38.667045  6023 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.670701  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.671468  1597 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:38.672555  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.666029  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.676847  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.678494  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.685702  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.686246  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.685811  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.690482  6148 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.690888  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:38.693459  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.609393  6091 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.704207  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.704803  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.705003  1603 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:38.702410  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.709524  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.710057  5991 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.710539  5991 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.711637  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.712538  1602 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:38.712709  5991 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:38.709444  6320 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:59:38.713372  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.707439  1600 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:38.714182  1602 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:38.715143  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.715924  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.711671  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.717062  6188 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.731987  6188 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.734923  6188 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:38.726102  6325 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:38.736945  6091 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.737943  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.728401  1597 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:38.739682  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.722659  6116 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.729120  1670 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:38.730346  1599 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:38.730449  1596 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 12:59:38.741518  1601 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.747506  1598 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:38.741778  1603 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:38.748728  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.748824  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.757339  1670 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:38.760172  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.761557  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.762533  1598 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 12:59:38.764739  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.766117  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.767364  1676 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:38.768901  6116 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.744280  6180 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.787477  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:38.787992  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.787735  6180 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.787468  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.790666  1746 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:38.790841  6180 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.770665  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.792685  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.793437  1676 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.793484  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.794348  1599 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 12:59:38.771145  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.771633  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.771684  1602 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:38.773321  2316 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 8: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:38.798228  1602 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:38.774566  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.799499  1602 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.778210  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.801753  1602 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:38.807789  1597 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:38.808830  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:38.809909  1596 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:38.810899  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.780251  6315 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.811967  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:38.812031  6315 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.746671  5920 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.816191  1599 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.785526  1669 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:38.778507  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.817553  6314 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:38.817955  6314 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.818300  6314 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.815194  6315 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.815989  5920 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.782564  1600 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.820708  1675 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:38.821250  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.822849  1595 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:38.826817  1746 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:38.827347  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.831938  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:38.835913  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.839836  1602 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:59:38.840658  1602 pending_rounds.cc:85] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 12:59:38.841579  1602 pending_rounds.cc:107] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:59:38.841933  1669 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:38.841933  1602 raft_consensus.cc:2889] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.841231  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.843333  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.844154  1743 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:38.846899  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.847393  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.847744  1749 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:38.847839  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.848081  2309 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:38.848582  6125 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:38.849478  6125 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:38.849807  6125 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:38.851743  1744 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:38.850827  6125 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.852880  6125 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:38.858130  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.859349  2309 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:38.831177  6057 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:59:38.831499  6180 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:38.843490  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.850750  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.866514  1674 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:38.868238  1677 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:38.870875  1670 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:38.868695  6180 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.877633  6180 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:38.868188  6330 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:59:38.878242  6057 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:38.878743  6057 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:38.880256  1748 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:38.879856  6057 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.869710  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.881779  6057 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.882479  6329 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:38.882992  6329 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.883350  6329 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:38.885603  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.889326  1669 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:38.890318  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.891040  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
W20260709 12:59:38.861963  6332 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.114s	user 0.000s	sys 0.003s
I20260709 12:59:38.868045  2309 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:38.898617  5920 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:38.901510  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.901968  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.902761  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.903154  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.904186  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.903424  1671 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:38.905256  1746 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:38.906451  1677 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:38.910487  1601 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:38.911511  1603 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:59:38.912658  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.911176  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:38.912490  1599 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:38.915050  6322 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:38.916214  6314 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:38.917346  1750 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:38.918424  6314 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:38.927645  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.926918  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.919489  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.932783  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.923458  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.928651  1675 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:38.929497  1676 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 12:59:38.930393  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.934734  1673 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:38.921506  6329 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.922598  6180 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.939002  2316 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:38.937842  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.939844  1676 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:38.944324  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:38.948829  1676 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:38.950387  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:38.951104  2316 raft_consensus.cc:2368] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:38.923789  6322 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:38.952574  6313 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:38.953079  6313 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:38.954007  6313 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:38.955981  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.956645  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.958698  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.960676  1744 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:38.961273  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:38.963117  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:38.960459  6322 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:59:38.970491  1675 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:38.959743  6314 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:59:38.974871  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.977074  1676 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:38.977898  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.978188  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.978725  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.978986  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.980506  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.981681  1674 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:38.983623  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:38.962059  6125 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:38.987439  1678 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:38.985296  1744 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.980785  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.980633  6318 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:38.994817  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:38.998467  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.998709  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:38.999202  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:38.999356  1675 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:38.999918  1675 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:39.001933  1674 raft_consensus.cc:2368] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:38.994261  6182 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.996848  6318 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:39.006569  6318 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:39.000412  6188 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:39.007512  6188 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:39.009158  6329 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:39.003063  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.003577  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:39.008687  6188 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.011701  1673 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.006560  6182 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.019790  1675 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:39.021194  1675 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.997824  6180 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:39.026026  6182 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.030460  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.035281  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.036520  5920 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:39.037015  5920 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:39.037446  5920 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.042181  6314 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:39.048205  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.048708  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.049016  1746 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 12:59:39.050041  1675 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:39.050104  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:39.056131  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.057063  1750 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.058678  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.051455  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.059836  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.063181  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:39.067428  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.070902  1673 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:39.073916  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.074393  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.077648  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.079104  1566 leader_election.cc:400] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:39.080125  1641 leader_election.cc:400] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7.
I20260709 12:59:39.080032  1566 leader_election.cc:403] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:39.080626  1641 leader_election.cc:403] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:39.075434  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:39.082978  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.056111  6260 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:39.064983  6314 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:39.084950  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.085556  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.062041  6147 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:39.069402  6305 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.065287  6091 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:39.079151  5991 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:39.069607  6084 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.081359  6125 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:39.090396  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 12:59:39.088973  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.085994  6322 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:39.069600  6315 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:39.083657  5985 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 6. Current term is 7.
I20260709 12:59:39.081710  6108 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.085779  6180 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:39.087951  6250 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:39.097716  6023 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:39.100687  5991 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:39.097841  6091 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.099190  6147 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:39.095641  6314 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.106698  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.196820  6344 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.113641  6180 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 12:59:39.110086  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.179981  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 73358.3us
I20260709 12:59:39.184907  1750 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 12:59:39.223276  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.103291  6125 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.234997  6344 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:39.241935  6345 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:39.242918  6345 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:39.243316  6344 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.243624  6345 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.246753  6345 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:39.175788  6337 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:39.124578  1744 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:39.105662  6148 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:39.253510  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.254691  6182 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:39.109424  6250 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.255873  6057 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:39.256201  6250 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.237947  6314 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:39.236110  6023 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:39.256971  6180 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.259706  6148 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.238075  6091 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.255264  6182 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:39.261720  6182 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.174029  5920 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.192746  5985 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.263855  5985 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.265009  5920 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.266266  5985 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.237914  5991 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.240557  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.268680  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.270228  6084 raft_consensus.cc:2764] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:59:39.248111  6125 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.271752  6084 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:39.108913  6318 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.272287  6084 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.272497  6148 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:39.273056  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 166434us
I20260709 12:59:39.272794  6084 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.273938  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.275070  6057 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.279954  6318 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.281322  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.283226  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:39.239988  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 193834us
I20260709 12:59:39.284451  6057 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.285418  6345 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:39.286756  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.288846  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.300338  6057 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.289713  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.175055  6305 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.289978  6023 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:39.310281  6057 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.295745  5985 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.325398  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.107615  6315 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.238966  6147 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:39.109231  6260 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.101518  6063 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.311693  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:39.311147  1744 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:39.315521  6351 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:39.328869  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.329658  1748 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:39.331674  6305 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:39.331902  6315 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.332360  6305 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.331606  5985 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.332883  6315 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:39.333876  6315 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:39.334463  5985 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.335383  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.336112  1750 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
W20260709 12:59:39.336992  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.319361  6345 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:39.332840  6305 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:39.346062  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 87332.8us
I20260709 12:59:39.340750  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.352140  1746 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:39.360296  6091 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.352301  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.362967  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.363197  1599 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:39.364424  1750 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:39.364373  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.365442  1601 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.338068  6148 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.369284  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.341470  6345 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:39.371021  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.393663  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.371794  6057 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.377889  6314 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.382613  6147 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.357676  5991 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.392566  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.393846  1603 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:59:39.372598  6349 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:59:39.404872  5991 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.411808  1752 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:39.416940  6352 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:39.417623  6352 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:39.418678  6352 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.327147  6084 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:39.396818  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56197.5us
I20260709 12:59:39.389240  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.344882  6250 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.361536  6063 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.399705  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.400082  1744 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:39.392947  6347 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:39.401854  6148 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.402485  6147 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:39.390362  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:39.419725  6180 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.428550  6063 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.432075  6180 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.433774  2310 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.433952  6084 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.434103  6063 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.433820  6250 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.427703  6347 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:39.436141  6347 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.437525  6347 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.444541  6180 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.445274  6352 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.445909  6057 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.446434  6057 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.448999  6057 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:39.450497  6305 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.383504  1601 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:39.452889  6305 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:39.456741  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:39.457881  1600 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 12:59:39.420442  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 99768.9us
I20260709 12:59:39.421540  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46970
I20260709 12:59:39.459069  1678 raft_consensus.cc:606] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:39.424222  1599 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.412075  6125 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.460678  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:39.461133  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 98) took 1390 ms. Trace:
I20260709 12:59:39.462800  6125 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:39.423771  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:39.463163  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:39.463946  1595 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:39.464582  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.425629  1603 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:39.426759  1747 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.393599  6345 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:39.391655  6351 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:39.424762  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:39.419529  6314 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:39.385917  6091 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.423004  6023 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.460280  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.460712  1678 raft_consensus.cc:614] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:39.469256  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:39.469708  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45042.9us
I20260709 12:59:39.472278  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.470140  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:39.473063  1602 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:39.475301  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.476109  1744 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:39.461705  1501 rpcz_store.cc:276] 0709 12:59:38.098033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.098216 (+   183us) service_pool.cc:224] Handling call
0709 12:59:39.460002 (+1361786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:38.914240 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:38.914858 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:38.914894 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:59:38.914914 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:38.915801 (+   887us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:38.915890 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:38.915932 (+    42us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:38.916624 (+   692us) tablet.cc:701] Row locks acquired
0709 12:59:38.916644 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:38.916811 (+   167us) write_op.cc:270] Start()
0709 12:59:38.916941 (+   130us) write_op.cc:276] Timestamp: P: 1783601978916761 usec, L: 0
0709 12:59:38.916962 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:38.963719 (+ 46757us) log.cc:844] Serialized 2894 byte log entry
0709 12:59:39.101259 (+137540us) op_driver.cc:464] REPLICATION: finished
0709 12:59:39.246162 (+144903us) write_op.cc:301] APPLY: starting
0709 12:59:39.246244 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:39.314173 (+ 67929us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:39.314302 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:39.436693 (+122391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:39.436931 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:59:39.436978 (+    47us) write_op.cc:312] APPLY: finished
0709 12:59:39.437267 (+   289us) log.cc:844] Serialized 73 byte log entry
0709 12:59:39.442423 (+  5156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:39.442573 (+   150us) write_op.cc:454] Released schema lock
0709 12:59:39.442635 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:39.443155 (+   520us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:39.443186 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18511,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":141894,"apply.run_cpu_time_us":13961,"apply.run_wall_time_us":196943,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":214364,"prepare.run_cpu_time_us":4559,"prepare.run_wall_time_us":59249,"replication_time_us":171411,"thread_start_us":151510,"threads_started":2}]]}
I20260709 12:59:39.477243  6314 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.487743  5991 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:39.488818  6315 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:39.482378  1599 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:39.489122  5991 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:39.490628  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.492981  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:39.469796  6125 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:39.477939  6347 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:39.497761  6347 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.498173  6347 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.498266  5920 raft_consensus.cc:993] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:39.498879  6344 raft_consensus.cc:1081] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:39.499243  1600 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:39.496770  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.469053  6351 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:39.502353  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.477895  6147 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.471586  6250 raft_consensus.cc:2764] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:39.504539  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.505517  6108 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:39.501155  6318 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:39.507213  6067 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:39.511081  6067 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.486971  6023 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.511454  6067 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.506095  6108 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:39.512786  2310 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:39.512648  6108 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.513018  1497 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 10 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.507694  5985 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:39.515038  1497 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.516180  5985 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.516641  5985 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.517596  1497 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.507941  6314 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:39.520097  6314 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:39.519519  1497 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:39.521042  6314 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.522281  6352 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.522897  6352 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.523645  6318 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.524151  6318 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.525121  6352 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.526011  1497 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:39.491902  6353 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:59:39.527660  1497 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.530611  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.525451  6067 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.492349  5991 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:39.534719  5991 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.535652  6067 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.535198  1497 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.552439  5991 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:39.553555  1497 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 9, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.508639  6345 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.557204  1497 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.560425  1497 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 5 to 6, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.565908  1497 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.536473  6351 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.572522  6351 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.502976  6125 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:39.550227  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.576270  6125 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:39.547398  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54499.2us
I20260709 12:59:39.506178  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.582640  6067 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:39.583715  6067 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:39.585148  6067 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.590580  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:39.591792  6305 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:39.592450  6305 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:39.592631  6345 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.593683  6305 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 12:59:39.582425  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 76324.8us
I20260709 12:59:39.596410  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.597983  6084 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:39.598474  6084 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.598838  6084 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.605041  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.606218  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:39.606989  6250 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:39.607879  6250 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:39.609323  6250 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:39.640157  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49683.3us
I20260709 12:59:39.641479  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:39.643484  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.673334  1678 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:39.663452  1747 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 12:59:39.667320  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 186644us
W20260709 12:59:39.676013  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 69894us
I20260709 12:59:39.690475  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:39.691619  1600 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:39.693017  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.695341  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.697005  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.698912  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.700917  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.701924  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:39.702189  1750 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:39.702627  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.702610  1600 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:39.704245  1600 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.706409  1752 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:39.719578  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.719718  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:39.721796  1598 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.680656  6067 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:39.686242  6057 raft_consensus.cc:2764] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:59:39.726102  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:39.726048  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.728657  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:39.733973  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90649.8us
I20260709 12:59:39.735016  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.736300  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.736979  1748 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.731390  1601 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 12:59:39.708555  6260 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:39.666860  6347 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.688139  6351 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:59:39.756251  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.735706  6353 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.738684  6352 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:39.766885  1600 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:39.759512  6355 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 12:59:39.750041  1598 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:39.791236  6354 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:39.792881  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57992.2us
W20260709 12:59:39.773945  6356 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
W20260709 12:59:39.797128  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 86636.4us
I20260709 12:59:39.797435  1600 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.774747  6147 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.778939  6305 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.816668  1748 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
W20260709 12:59:39.811147  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 110607us
I20260709 12:59:39.761459  6318 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.810170  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.815034  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.823148  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:39.832653  2310 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:39.833212  6315 raft_consensus.cc:476] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:39.834293  6084 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:39.836333  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.838541  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.840026  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:39.840809  1752 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:39.841765  6063 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:59:39.841979  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 85865.2us
I20260709 12:59:39.842274  6063 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.842554  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.842990  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:39.843920  6322 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.844239  1745 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:39.844414  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:39.846061  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.847182  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.839303  1748 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.842778  6063 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:39.849241  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:39.850572  6315 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:39.859985  6315 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.857220  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.858541  1744 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.820103  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.873234  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:39.875602  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.876781  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56822.4us
I20260709 12:59:39.876953  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:39.861500  6147 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.868896  6315 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:39.910126  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.911607  1748 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:39.913879  1675 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:39.916142  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:39.917583  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:39.919303  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.920118  6360 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:39.924245  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:39.925560  1549 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1a40ab12c220464db732562e88c32c11 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 12:59:39.926105  1549 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:59:39.926438  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:39.929757  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:39.931645  1744 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:39.936691  2316 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 14: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:39.879606  6352 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:39.897845  6180 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:39.888670  6361 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:39.939414  6315 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.907892  5985 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.940102  6364 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:39.943337  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 120322us
I20260709 12:59:39.961580  1678 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:39.945647  6354 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.953380  6361 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:39.952656  6363 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.966885  6361 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.971200  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:39.959939  6364 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:39.952734  6180 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:39.972234  6364 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.973470  6344 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:39.973337  6180 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:39.973981  6344 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.974349  6344 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.977835  6352 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:39.980469  6084 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.984086  6125 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.989130  6347 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.992807  5985 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.953531  6315 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.944398  6147 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:39.996584  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.996529  6147 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:39.998090  6318 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:39.997851  6147 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.990808  6344 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:39.952816  6067 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.001849  6344 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:40.003216  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:40.004539  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:40.007660  6125 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:40.008123  6108 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:40.008823  6108 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:40.009087  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 98300.6us
I20260709 12:59:39.991057  6260 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:40.010317  6108 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.011771  1749 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
W20260709 12:59:40.016474  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.020220  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:40.020537  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:40.021466  1744 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:40.020299  1676 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:40.031735  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:40.044494  1745 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:40.044821  1750 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:40.044273  1748 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:40.048897  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:40.049665  1743 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:40.050216  1600 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:40.044269  1599 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:40.015264  6344 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:40.001062  6067 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.063151  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:40.066304  1676 raft_consensus.cc:606] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:40.066777  1676 raft_consensus.cc:614] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:40.071348  1603 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:40.074774  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.075891  1596 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:40.077622  1744 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 12:59:40.077796  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:40.078423  1749 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:40.072206  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.045759  5985 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:40.040112  6148 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:40.086555  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.087412  1598 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:40.081063  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 163593us
I20260709 12:59:40.078239  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.065362  6344 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.093706  1594 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:40.092693  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:40.094849  1748 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:40.098881  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.113355  1596 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:40.136736  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:40.037055  6023 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 12:59:40.146952  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67800.3us
I20260709 12:59:40.149395  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.151440  1598 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:40.113021  6344 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:40.150338  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 185950us
I20260709 12:59:40.096786  5985 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.134383  6250 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:40.163141  1748 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:40.161581  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.091181  6091 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:59:40.166086  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.141543  6372 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:40.113427  6364 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:40.169900  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71712.5us
I20260709 12:59:40.175076  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.174960  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.152711  6370 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:40.160082  6347 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:40.165072  6345 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:40.186415  5985 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.187971  6345 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:40.178489  6354 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:40.189380  6354 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:40.190568  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:40.190691  6354 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.191761  6378 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:40.192312  6116 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:40.192953  6116 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:40.193969  6116 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:40.203958  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.204972  6372 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:40.205456  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.206355  6372 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:40.169978  6351 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:40.169490  6148 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.179914  6370 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.167598  6063 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.214839  6084 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:40.233939  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.249019  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:40.244709  6371 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:40.244410  6367 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:40.221465  6351 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:40.252576  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.181964  6363 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:59:40.236621  6370 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:40.285495  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.253964  6352 raft_consensus.cc:2764] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:59:40.253839  6347 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:40.257239  6084 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.318123  6345 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:40.267695  6351 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:40.338501  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79966.4us
I20260709 12:59:40.360882  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:40.258652  6125 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:59:40.246980  6376 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:59:40.362107  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:40.362843  1743 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:40.256832  6372 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 12:59:40.382296  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 167644us
I20260709 12:59:40.344871  6347 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:40.384389  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:40.406147  1599 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:40.406586  6361 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:40.376861  5991 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:40.381723  6345 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.393280  6108 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.444875  1598 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:40.355738  6380 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 12:59:40.388427  6385 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:40.418680  6361 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.470199  1594 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:40.471901  1749 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:40.364218  6148 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:40.483440  6384 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:59:40.484266  6377 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:59:40.438279  6345 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:40.445215  6180 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:40.499817  6386 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.455632  6108 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.428980  6084 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.425422  5991 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.555284  5991 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:40.501111  6379 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:59:40.464184  6364 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:40.553565  6125 consensus_queue.cc:1243] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:59:40.507812  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 124670us
I20260709 12:59:40.473182  6390 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:40.480842  6367 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:59:40.562049  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 276610us
I20260709 12:59:40.518728  6063 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:40.568907  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 95469.1us
I20260709 12:59:40.569422  1566 leader_election.cc:400] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 7. Current term is 8.
I20260709 12:59:40.560129  2310 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:59:40.573973  1715 leader_election.cc:336] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.687s (SENT)
I20260709 12:59:40.597086  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:40.510713  6250 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:59:40.594769  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:40.603657  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.674676  1594 raft_consensus.cc:2368] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
I20260709 12:59:40.580224  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:40.677798  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70504.7us
I20260709 12:59:40.682374  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:40.687920  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.601922  6353 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:40.695379  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.700994  1594 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:40.552145  6180 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:40.713706  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:40.715123  1594 raft_consensus.cc:2368] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13.
W20260709 12:59:40.718595  6381 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:59:40.721015  6388 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 12:59:40.722568  6399 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:40.723204  6399 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:40.724948  6382 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:59:40.701481  6393 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:59:40.732936  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 141229us
W20260709 12:59:40.722851  6383 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:59:40.756127  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:40.757004  1601 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:40.591383  6314 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
W20260709 12:59:40.768211  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 194242us
I20260709 12:59:40.566083  6386 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:40.737816  6315 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.744s	user 0.013s	sys 0.001s
W20260709 12:59:40.784961  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.555s (SENT)
W20260709 12:59:40.786738  1715 leader_election.cc:336] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.015s (SENT)
I20260709 12:59:40.774887  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:40.702124  6353 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:40.778797  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.779462  1599 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:40.775014  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.792831  1594 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:59:40.787519  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:40.592156  6361 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.812713  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.814011  1596 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:40.871196  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:40.872161  1596 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:40.814265  6385 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.879613  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:40.879763  1599 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:40.797045  6315 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:40.883780  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 97074.7us
I20260709 12:59:40.884017  1594 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:40.849437  6393 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:40.885151  1596 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:59:40.885524  1596 pending_rounds.cc:85] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 5
W20260709 12:59:40.884582  1715 leader_election.cc:336] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.023s (SENT)
I20260709 12:59:40.885756  1596 pending_rounds.cc:107] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:59:40.886000  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:40.886014  1596 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:40.937569  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 53009.2us
I20260709 12:59:40.945785  1598 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:40.950445  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.958033  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79262.9us
I20260709 12:59:40.902501  6390 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:40.959201  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:40.963657  1594 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:59:40.965498  1594 pending_rounds.cc:85] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 6
I20260709 12:59:40.965883  1594 pending_rounds.cc:107] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:40.966212  1594 raft_consensus.cc:2889] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:40.955804  6345 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:40.982744  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:40.939798  6125 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:40.966323  6344 consensus_meta.cc:287] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.798s	user 0.020s	sys 0.000s
I20260709 12:59:40.848976  6399 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.001322  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 12:59:41.001780  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.054s (SENT)
I20260709 12:59:41.007040  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:40.879243  6353 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:40.975257  6147 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.023417  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.977372  6408 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:59:41.041937  1594 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
W20260709 12:59:41.037449  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.107s (SENT) [suppressed 27 similar messages]
I20260709 12:59:41.049422  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.050282  1594 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
W20260709 12:59:41.035759  6404 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 12:59:40.999981  6412 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:59:41.031744  6067 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:41.006199  6344 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.072240  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.031091  6397 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:41.036221  6353 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:41.058187  6406 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:59:41.036582  6415 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:41.098593  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.099949  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.101426  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.102317  1601 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:41.103585  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.105728  1601 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:41.110416  1597 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:41.111661  1669 raft_consensus.cc:606] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:41.112334  1669 raft_consensus.cc:614] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:41.071496  6365 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.069083  6067 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:41.032625  6147 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.086772  6386 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:40.999981  6385 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.123459  1597 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:41.135650  6419 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.136570  6419 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.138811  6415 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:41.124365  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.047501  6390 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.143168  1600 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:41.076619  6380 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:59:41.140038  6415 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:59:41.155174  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.155874  6352 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.126564  6067 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:41.126415  6315 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:41.155386  6394 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:59:41.185691  6416 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 12:59:41.176220  6352 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.189440  6352 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.126086  6365 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:41.194815  6365 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.200736  1676 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:59:41.201056  6370 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.861s	user 0.013s	sys 0.003s
I20260709 12:59:41.202512  1678 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:41.174455  6386 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.208412  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 173836us
I20260709 12:59:41.210180  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.199018  6397 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.211359  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 173930us
W20260709 12:59:41.215113  1715 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.115s (SENT)
I20260709 12:59:41.201797  6370 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.210287  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:41.208204  6365 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.219422  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:41.226227  1603 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:41.228049  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.237648  1597 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:41.238312  1597 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:41.240679  6147 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:41.241932  6410 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.393s	user 0.000s	sys 0.005s
I20260709 12:59:41.242113  6147 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:41.248417  1601 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:41.249166  1601 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:41.265556  1603 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:41.267681  1602 raft_consensus.cc:2368] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13.
W20260709 12:59:41.277418  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62295.7us
I20260709 12:59:41.226862  6361 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:41.250437  1601 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.242693  6147 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.232802  6125 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:41.239406  1597 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.210758  6386 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.287058  1597 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:41.284541  1601 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:41.283183  5920 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.292201  5920 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.293865  6419 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.294484  6419 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.294621  5920 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:41.292587  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.295033  6419 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.297704  6419 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.218080  6397 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:41.305691  1715 leader_election.cc:336] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.134s (SENT)
I20260709 12:59:41.311229  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:41.286448  6429 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.233141  6365 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:41.292665  6425 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:59:41.317904  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.324906  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.313323  6344 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.328635  1601 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:59:41.329180  1601 pending_rounds.cc:85] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 6
I20260709 12:59:41.329597  1601 pending_rounds.cc:107] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:59:41.331171  1601 raft_consensus.cc:2889] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:41.331573  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.332228  1599 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:41.332643  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.333796  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.334488  1596 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:41.336872  6322 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:41.337319  6322 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:41.338219  6322 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.339300  6322 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:41.343091  6362 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:41.317206  6361 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:41.344219  6362 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:41.322481  6385 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.346287  1599 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:41.325506  6125 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:41.363211  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 140807us
W20260709 12:59:41.363291  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83816.3us
I20260709 12:59:41.366554  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.349231  6395 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.369100  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.188s (SENT)
I20260709 12:59:41.356220  6385 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:41.367256  1677 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:41.369661  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:41.382139  1715 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.216s (SENT)
W20260709 12:59:41.390295  2279 leader_election.cc:336] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.592s (SENT)
I20260709 12:59:41.326239  6429 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.378582  6125 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:41.384271  5985 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:41.409392  5985 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:41.418349  6431 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.419010  6431 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.419250  5985 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.422166  6431 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:41.423942  6434 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:59:41.430120  6430 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:41.436448  6376 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.437424  6376 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.440641  6385 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.448678  1597 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:59:41.449507  1597 pending_rounds.cc:85] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
W20260709 12:59:41.411755  6351 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.049s	user 0.013s	sys 0.005s
I20260709 12:59:41.393704  6182 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Committing config change with OpId 11.10: config changed from index 5 to 10, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:41.396107  6361 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:41.484035  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 101935us
W20260709 12:59:41.487203  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.488332  6393 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:41.488555  6429 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.451532  1597 pending_rounds.cc:107] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:59:41.453441  6397 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.452672  6365 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.455282  6386 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.488989  6393 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.455796  6370 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:41.458616  6067 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.401454  6362 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.455423  6023 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:41.380869  6395 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.491506  6393 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.496763  6395 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.499218  6314 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:41.500375  6376 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:41.501994  6402 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.624s	user 0.000s	sys 0.002s
I20260709 12:59:41.471993  6180 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.473605  1594 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:41.475871  6147 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.467101  6351 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.450763  6431 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:41.507056  1595 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 12:59:41.509936  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.519392  1595 pending_rounds.cc:85] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:41.520438  1595 pending_rounds.cc:107] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:59:41.520771  1595 raft_consensus.cc:2889] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:41.511401  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.514427  2316 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:41.517060  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:41.527489  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.531880  1671 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:41.491917  1597 raft_consensus.cc:2889] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:41.519349  1677 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 5 to 10, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:41.535182  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.538534  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.491806  6067 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.492341  6362 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:41.493964  6023 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:41.549077  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.544102  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:41.524446  6376 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:41.530551  6125 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:41.549993  1670 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:41.536718  6386 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:41.552102  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:41.560654  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.519093  6431 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:41.564309  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47275.3us
I20260709 12:59:41.543809  6322 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:41.552860  6147 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:41.569814  6322 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.561635  6125 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.568302  6386 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.590967  6431 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:41.591518  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.568295  6376 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.600577  6351 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.582820  6147 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.585669  6314 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:59:41.582520  6397 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:41.624641  6397 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.628829  6386 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.587368  6322 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:41.627224  6397 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:41.640436  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.647248  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.653888  1594 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:41.651535  1601 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:41.661094  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.665526  1596 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:41.662744  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.664381  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:41.673564  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 104601us
I20260709 12:59:41.682688  6451 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:41.674485  6395 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.683398  6451 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.677556  6386 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:41.672868  6067 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:59:41.701062  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.704896  1743 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:59:41.705286  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.702518  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.708990  1599 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:41.688222  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:41.714502  6057 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:41.715001  6057 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:41.715968  6057 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.726408  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:41.724530  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:41.727593  1743 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:41.728585  1745 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:59:41.729372  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.738608  5896 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:41.739744  6456 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:41.740293  6456 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.702160  6386 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.740691  6456 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:41.744326  6147 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:41.748955  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:41.750800  2279 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.549s (SENT)
W20260709 12:59:41.753146  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.696425  6395 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.725508  6314 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:41.764690  6063 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:41.766736  6395 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.767374  1748 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:41.768972  6389 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:41.760448  6351 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.770897  6351 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.772905  1750 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:41.773207  6351 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.774374  1744 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:41.775909  1747 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:41.776007  6023 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.777138  6023 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:41.778795  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.779098  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.779857  1746 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:41.780295  1744 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:41.781414  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:41.781625  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.782454  1747 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:41.783488  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.784260  1750 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:41.787039  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.758383  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:41.795778  1743 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:41.802011  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:41.804096  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.803141  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:41.809485  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:41.809834  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.754753  6147 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.810971  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.828028  1596 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:41.811527  5920 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:41.812053  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:41.812278  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:41.812947  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.760917  6314 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.797719  6057 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:41.823494  1748 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:41.826779  1601 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:41.829106  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.844043  1745 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:41.829764  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:41.860145  6426 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:59:41.863703  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.864728  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.861006  1751 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:41.876562  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:41.874121  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:41.863597  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.887758  1595 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:41.872599  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.892509  1597 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:41.876235  2315 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEARNER]: Advancing to term 13
I20260709 12:59:41.894137  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.872313  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.896265  1601 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:41.897682  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.898547  1601 raft_consensus.cc:2376] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8. Re-sending same reply.
I20260709 12:59:41.877157  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:41.827617  6067 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:41.906862  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.906069  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.872251  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:41.867668  5920 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.910554  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:41.861935  6314 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:41.911849  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.913123  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.828085  6393 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:59:41.917434  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.879290  6057 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:41.828676  6431 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:59:41.892509  1596 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:41.928435  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.905751  6182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51110 (request call id 1) took 9186 ms. Trace:
I20260709 12:59:41.929445  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.916352  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:41.926101  1595 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:41.831048  6147 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.927628  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.918255  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.862104  6454 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:59:41.944715  1745 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:41.945305  6419 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:41.945842  6419 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.946259  6419 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:41.948107  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:41.953233  1750 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:41.927574  6057 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.959671  6386 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.960196  6057 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:41.965229  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.914644  6345 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.966735  6345 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:41.862229  6116 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:59:41.969218  6345 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:41.930473  6182 rpcz_store.cc:276] 0709 12:59:32.699093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.706009 (+  6916us) service_pool.cc:224] Handling call
0709 12:59:32.913758 (+207749us) log.cc:844] Serialized 501 byte log entry
0709 12:59:33.258502 (+344744us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b540069eea0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481406142 00007f94813e6eaa 00007f94813edd53 00007f94813edcd9 00007f94813edc69 00007f94813edc31 00007f94813ecdfd 000000000038f354 000000000038f199 00007f947e3a0475
0709 12:59:33.411977 (+153475us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b180028b7c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 12:59:33.506579 (+ 94602us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b180028b7c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f94813e6b0b 00007f948146bb63 00007f9481493752
0709 12:59:34.060943 (+554364us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b540069eea0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948140db26 00007f948140749a 00007f9481406714 00007f94813e6eaa 00007f94813edd53 00007f94813edcd9 00007f94813edc69 00007f94813edc31 00007f94813ecdfd 000000000038f354
0709 12:59:41.860940 (+7799997us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50752,"raft.queue_time_us":110509,"raft.run_cpu_time_us":15370,"raft.run_wall_time_us":955103,"spinlock_wait_cycles":56685312,"thread_start_us":311228,"threads_started":2,"wal-append.queue_time_us":304501,"wal-append.run_cpu_time_us":1812,"wal-append.run_wall_time_us":1004052}
I20260709 12:59:41.969228  1597 raft_consensus.cc:2376] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12. Re-sending same reply.
I20260709 12:59:41.972743  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.973811  6322 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.974073  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.976382  1744 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:41.976909  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.977276  1748 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:41.977617  1601 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:41.915601  6429 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 12:59:41.978153  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.926162  6385 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:41.914340  6067 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:41.967764  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.978586  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.982753  1600 raft_consensus.cc:2376] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10. Re-sending same reply.
I20260709 12:59:41.982838  1601 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:41.915153  5920 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:41.986289  6067 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:41.979146  6385 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.987862  6385 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:41.976411  6108 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.980595  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:41.967092  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.993253  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.993920  1603 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:41.994867  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.979439  1594 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:41.996560  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.997850  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:41.937111  6451 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:41.983929  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:41.978610  6376 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:41.985086  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0193c6e20d1c4a33997d268895b8c083 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:41.985282  1669 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:42.003760  1594 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:41.985857  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.004257  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.009707  1601 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 12:59:42.012156  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.000380  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:42.013765  1597 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:42.000764  5920 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.004240  1600 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:41.986531  6389 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:42.005661  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.015508  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.006678  6147 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:41.934355  6456 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.020851  1594 raft_consensus.cc:2376] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10. Re-sending same reply.
I20260709 12:59:41.991886  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:42.010728  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 179987us
I20260709 12:59:42.017786  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:42.019069  2315 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:42.030162  1596 raft_consensus.cc:2376] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8. Re-sending same reply.
W20260709 12:59:42.031836  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.032168  1746 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:42.032961  1750 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:42.033349  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.021929  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.025322  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:42.033816  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.023854  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.027961  1669 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:42.031216  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:42.026424  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:42.036828  1596 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:42.035560  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.034821  1603 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:42.038391  1595 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:42.038533  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.041244  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.042969  1678 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:42.030697  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:42.044307  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.045279  1600 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:42.045655  1751 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:42.048354  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:42.049823  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.051087  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:42.052363  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.052634  1595 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:42.053467  1749 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:42.054545  1601 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:42.055819  1600 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:42.057628  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.054358  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.058049  1672 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:59:42.059755  1596 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:42.060949  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.062361  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.061703  1745 raft_consensus.cc:2368] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14.
I20260709 12:59:42.066210  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.091688  1603 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:42.093904  1752 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.020177  6345 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:42.092579  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:42.099757  1745 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:42.061681  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.094324  1677 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:42.094585  1673 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:42.091976  1669 raft_consensus.cc:2368] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:42.065063  6450 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.057585  6462 raft_consensus.cc:2764] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:59:42.104101  1676 raft_consensus.cc:1217] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:59:42.112329  1672 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:42.113001  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.115581  1748 raft_consensus.cc:1217] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Deduplicated request from leader. Original: 10.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:59:42.116093  1748 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:59:42.117126  1676 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:59:42.117864  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.118848  1749 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.107182  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.049153  6389 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.122396  1744 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:59:42.123173  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:42.124004  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62425us
I20260709 12:59:42.126585  1745 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.130335  1597 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:42.060544  6147 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:59:42.133852  6456 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:42.135941  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.137233  1744 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:42.137750  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.138425  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.140655  5920 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.103669  6386 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.148305  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:42.091203  6057 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:59:42.148305  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.158962  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.160494  1749 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.160526  1678 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:42.102240  6345 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.148383  6322 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:42.173780  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.176647  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.174306  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.168403  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:42.179914  1678 raft_consensus.cc:606] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.162084  6461 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.191913  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.180430  1678 raft_consensus.cc:614] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:42.192798  1751 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:42.192641  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.180596  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.186734  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.195729  1672 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:42.199023  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.200757  1744 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.172731  6386 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:42.171097  6315 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.165923  6456 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:59:42.209126  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.230779  1749 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:42.194384  6322 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:42.165557  6314 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.208393  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:42.237210  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.238497  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.240068  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.205924  6367 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:42.171773  6385 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:42.284447  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 271445us
I20260709 12:59:42.242460  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.252830  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.290131  1747 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.254978  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.175271  6063 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:59:42.293712  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51336.5us
I20260709 12:59:42.198642  6250 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:59:42.295223  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:42.232844  6315 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.228369  6386 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:42.256650  6057 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:42.199004  6380 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:59:42.199358  6426 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:59:42.259714  6399 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.260177  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.308007  1746 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:42.296289  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.264223  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.309580  1749 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:42.191342  5920 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:59:42.269395  6397 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.270466  6147 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:42.274446  1674 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:42.275760  6460 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.278895  6456 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.279373  1743 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:42.280460  6314 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:42.281644  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.172224  6084 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:59:42.282855  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44092.1us
W20260709 12:59:42.293267  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 1811) took 1604 ms (client timeout 2054 ms). Trace:
I20260709 12:59:42.294590  6398 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:59:42.305574  2279 leader_election.cc:336] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.245s (SENT)
W20260709 12:59:42.322193  1598 rpcz_store.cc:269] 0709 12:59:40.687177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.687477 (+   300us) service_pool.cc:224] Handling call
0709 12:59:42.290256 (+1602779us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54000d9b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:42.290489 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590352640}
I20260709 12:59:42.326726  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.287772  6421 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:42.288595  6367 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.265681  6389 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.309695  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.284492  6322 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 12:59:42.311658  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 144797us
I20260709 12:59:42.317893  6147 consensus_queue.cc:1243] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:42.306097  6057 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:42.322504  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:42.328433  1596 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:59:42.333249  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.317765  6454 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.355379  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:42.335412  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.304572  6395 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:42.330622  6116 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:42.329273  6421 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.334224  6367 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.372815  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:42.229581  6461 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:59:42.353338  6057 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:42.351842  6398 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:42.379878  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44384.3us
I20260709 12:59:42.386173  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:42.328131  6456 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:42.332118  6419 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.362113  6460 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.361824  6395 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.374678  6422 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:42.365813  6314 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.378530  6421 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:42.356649  6250 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.410097  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:42.410884  1602 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:42.407334  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.361486  6063 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:59:42.361016  6322 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:42.334910  6386 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.434032  1675 raft_consensus.cc:2368] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 12:59:42.372450  6431 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:59:42.392019  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:42.408535  6395 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.446182  6315 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:42.451189  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.400789  6180 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:59:42.408214  6182 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:42.418036  6314 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.418263  6398 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:42.463671  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 64218us
I20260709 12:59:42.423382  6390 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:59:42.414150  6472 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:59:42.465739  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.473511  1751 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:42.487594  1751 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
W20260709 12:59:42.488479  6467 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:59:42.489004  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.489784  1751 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:42.490845  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:42.486953  1602 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:42.498652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:42.499591  1602 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:42.504869  6474 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:42.507243  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:42.508328  6419 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.516047  6456 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:42.485802  6067 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:42.522218  6415 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:42.522958  6415 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.526568  6422 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:42.527307  6422 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.472443  6398 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.533035  1751 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:59:42.546996  1603 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:42.547644  1603 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:42.547730  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:42.549579  1602 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:42.549916  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:42.577212  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:42.577973  1602 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.583070  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.548521  1603 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.586856  1603 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.585785  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:42.588352  1602 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:42.591068  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:42.599191  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:42.600462  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:42.600639  1672 raft_consensus.cc:606] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:42.601114  1672 raft_consensus.cc:614] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:42.602926  1677 pending_rounds.cc:85] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 7
I20260709 12:59:42.603370  1677 pending_rounds.cc:107] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:42.603741  1677 raft_consensus.cc:2889] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:42.574312  6344 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.590178  6456 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.590885  6063 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.614166  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:42.614892  1747 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:42.581070  6390 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:42.607074  6365 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:42.609175  6361 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:42.542703  6067 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:42.641728   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:59:42.673496  6477 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.202s	user 0.000s	sys 0.002s
I20260709 12:59:42.692643  6125 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:42.699975  5985 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.708066  6385 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.775669   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:42.803349  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.623288  6344 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.647675  6390 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:42.810496  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:42.628774  6456 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:42.849260  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55778.3us
I20260709 12:59:42.785768  6365 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:42.869170  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 482993us
I20260709 12:59:42.799919  6398 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:42.858577  6484 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.372s	user 0.005s	sys 0.000s
I20260709 12:59:42.854084  6314 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:42.875929  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:42.857710  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:42.913496  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.861229  6362 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:59:42.881870  6345 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.912098  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:42.902313  6415 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.909291  6431 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.936918  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:42.948189  6369 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:42.956415  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.957018  6344 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:42.956517  6369 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:42.957928  6369 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.961395  6067 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:42.932826  6365 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:42.964965  6057 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.006s
I20260709 12:59:42.965536  6057 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:42.967870  6456 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:42.918295  6390 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:42.973945  6369 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:42.984476  6492 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:42.950495  6116 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:43.025225  6495 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:43.015758  6489 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:59:43.026503  6481 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
W20260709 12:59:43.045631  6500 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:42.985884  6180 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:59:42.985198  6492 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:43.054636  6485 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
W20260709 12:59:43.056977  6493 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.117s	user 0.000s	sys 0.002s
W20260709 12:59:43.060492  6494 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.147s	user 0.000s	sys 0.002s
I20260709 12:59:43.057972  6361 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:43.047528  6426 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:43.090207  6490 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:59:43.100536  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2351) took 1150 ms. Trace:
I20260709 12:59:43.053170  6116 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:59:43.095814  6421 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.007s
I20260709 12:59:43.118749  6421 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.121133  6421 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.124584  6492 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.125279  6322 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.126184  6361 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.128543  6422 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:43.133334  6488 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.371s	user 0.001s	sys 0.003s
I20260709 12:59:43.101058  1601 rpcz_store.cc:276] 0709 12:59:41.950120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.056064 (+105944us) service_pool.cc:224] Handling call
0709 12:59:42.098619 (+ 42555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.307476 (+208857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.307514 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.313150 (+  5636us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.374219 (+ 61069us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:42.380170 (+  5951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.380256 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.100297 (+720041us) raft_consensus.cc:1685] finished
0709 12:59:43.100323 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.100468 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61453,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":4740,"thread_start_us":242144,"threads_started":2,"wal-append.queue_time_us":261477}
I20260709 12:59:43.050902  6495 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.112884  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:43.141752  6495 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:43.118175  6399 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.005s
W20260709 12:59:43.144291  6395 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 12:59:43.144847  6395 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.145581  6471 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:43.146999  6395 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:43.147897  1745 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:43.148317  1743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 2278) took 1220 ms (client timeout 1568 ms). Trace:
W20260709 12:59:43.148880  1743 rpcz_store.cc:269] 0709 12:59:41.927771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.928177 (+   406us) service_pool.cc:224] Handling call
0709 12:59:43.147972 (+1219795us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400420754. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:43.148201 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804842240}
I20260709 12:59:43.150283  5991 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.151400  1671 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
W20260709 12:59:43.156378  6499 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:59:43.156739  1744 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
W20260709 12:59:43.159102  6367 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.005s
I20260709 12:59:43.111414  6057 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:43.162210  1752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 2272) took 1383 ms (client timeout 1789 ms). Trace:
I20260709 12:59:43.162451  6315 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:43.162698  1752 rpcz_store.cc:269] 0709 12:59:41.778392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.778522 (+   130us) service_pool.cc:224] Handling call
0709 12:59:43.161995 (+1383473us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002e7054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:43.162147 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719138688}
I20260709 12:59:43.163008  6315 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.163823  6147 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.164371  6147 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:43.164875  6468 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.165045  6469 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:43.165432  6468 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.165890  6482 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:43.165681  6469 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.166615  6147 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:43.166441  6482 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.167676  1748 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:43.170051  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.170773  6482 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.106338  6426 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.150987  5991 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.175984  1674 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:43.176530  6369 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:43.177335  6367 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:43.180087  6469 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.182803  6468 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.165338  6315 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.183871  6508 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.184381  6367 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.185101  6367 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:43.185151  6084 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:43.185700  6367 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.185860  6084 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.188262  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.188184  6426 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.190891  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.191859  1675 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:43.184407  6508 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.194875  6084 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.196067  6508 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.198370  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.204923  6386 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.208312  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.210152  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.211021  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.212558  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1950) took 2641 ms. Trace:
I20260709 12:59:43.213343  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:43.212994  1673 rpcz_store.cc:276] 0709 12:59:40.570633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.571806 (+  1173us) service_pool.cc:224] Handling call
0709 12:59:40.599388 (+ 27582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.102006 (+1502618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.212312 (+1110306us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400433854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:43.212453 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3437731712}
I20260709 12:59:43.213975  6376 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:43.214529  6376 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.214985  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:43.215188  1671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 2109) took 1190 ms (client timeout 1585 ms). Trace:
I20260709 12:59:43.215639  1678 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:43.215606  1671 rpcz_store.cc:269] 0709 12:59:42.025202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.026105 (+   903us) service_pool.cc:224] Handling call
0709 12:59:43.214980 (+1188875us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540036ecd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:43.215095 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504136576}
I20260709 12:59:43.217595  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 2090) took 1041 ms. Trace:
I20260709 12:59:43.218163  1748 rpcz_store.cc:276] 0709 12:59:42.176139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.176279 (+   140us) service_pool.cc:224] Handling call
0709 12:59:43.167425 (+991146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.168111 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.217375 (+ 49264us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54002e7050. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:43.217517 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278233472}
I20260709 12:59:43.206781  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:43.222887  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52912.7us
I20260709 12:59:43.227785  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:43.230602  1748 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:43.228960  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.236692  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.239850  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.244783  1743 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:43.183298  6023 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:43.270291  1671 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:43.272567  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:43.247808  6250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.007s	sys 0.015s
I20260709 12:59:43.279294  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:43.280373  1752 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:43.281790  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.250630  6421 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:43.217643  6376 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:43.286235  1678 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:43.291488  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.292285  6469 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.292791  6468 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:43.293401  6315 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:43.315920  1752 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:43.318859  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.319191  1752 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:43.286921  6482 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.323230  1750 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:43.352483  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:43.353318  1750 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.333081  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.349480  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.286733  6023 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.358948  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.371436  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.379586  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.385020  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.386030  1747 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 12:59:43.394754  6486 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.395592  6486 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.369875  6367 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.320616  6468 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.309360  6469 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.320292  6315 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.373049  6365 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:43.401682  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.400597  1748 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:43.404107  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.383338  6250 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:43.411993  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.412102  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:43.414443  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.396771  5991 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.363283  6482 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.423969  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.416576  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.425272  6482 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.425575  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.426267  1594 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:43.427312  6450 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.428126  6450 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.428858  6495 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:43.433625  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.434419  1599 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:43.435462  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.436960  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.437727  1599 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:43.440012  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.440542  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.440936  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:43.442355  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.444036  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.445972  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.451071  1598 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:43.452762  1598 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:59:43.454141  1598 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:43.458612  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.462529  1594 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:43.422180  6315 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.470762  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.471623  1594 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
W20260709 12:59:43.472432  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.414762  6367 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:59:43.488260  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:43.489064  1744 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:43.489310  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.490612  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:43.422857  6511 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:43.474910  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:43.481370  1599 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:43.419663  1750 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:43.457661  5991 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:59:43.486593  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 486845us
I20260709 12:59:43.422180  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.472553  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.505065  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:43.508019  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.509258  1599 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 12:59:43.510291  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.522393  1594 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:43.528877  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.457190  6442 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:43.415881  6365 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.534762  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.457031  6492 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:59:43.544238  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.550989  1749 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:43.554190  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60755.5us
I20260709 12:59:43.557880  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.521377  5991 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.560180  5991 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:43.562748  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.542455  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:43.521242  6450 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:43.606828  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44158.1us
I20260709 12:59:43.613211  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.535323  6399 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:43.525605  6398 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:43.627211  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.627391  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.627700  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.628283  1597 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:43.535884  6369 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 12:59:43.640339  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 97973.8us
W20260709 12:59:43.608134  6485 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:59:43.640867  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 160021us
I20260709 12:59:43.568413  6511 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:43.568034  6315 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:43.654346  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:43.654472  6344 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:43.641377  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:43.626631  6498 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:59:43.667488  1566 leader_election.cc:400] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14.
I20260709 12:59:43.667326  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:43.539273  6514 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 12:59:43.607879  6469 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.674131  1566 leader_election.cc:403] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:43.551713  6442 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:43.659590  6510 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.290s	user 0.000s	sys 0.002s
I20260709 12:59:43.638140  6399 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.621737  6519 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:43.681372  6067 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:43.657089  6486 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.605376  6520 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:59:43.702539  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:43.640877  6023 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.691681  6057 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.727152  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.728951  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:43.633862  6398 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.740428  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.742133  1599 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:43.713721  6067 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.702720  6469 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14.
I20260709 12:59:43.746232  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.747068  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:43.743933  1596 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:43.760011  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.762383  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:43.735710  2310 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:43.764437  6472 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:43.765311  6472 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:43.765743  6472 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:43.766145  6472 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:43.763841  6520 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:43.767745  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 126443us
I20260709 12:59:43.769121  6367 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:43.769673  6367 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:43.770138  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:43.755662  6067 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:43.771790  6520 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:43.772274  6520 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:43.772903  6520 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:43.767143  6180 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:59:43.755839  1777 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:44561 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:44561 timed out after 15.000s (SENT)
I20260709 12:59:43.771415  6367 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:43.779532  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:43.732354  6521 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:59:43.681985  6344 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.793259  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:43.797459  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.804498  6480 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:43.805501  6480 raft_consensus.cc:2764] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:59:43.806859  6398 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:43.808080  6517 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 12:59:43.809917  6524 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:59:43.786103  6147 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:59:43.812803  6147 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:43.751389  6511 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.813263  6147 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:43.813970  6515 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:59:43.814360  6147 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:43.804100  6518 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 12:59:43.803802  6471 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.791494  6469 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:59:43.818068  6469 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:43.818506  6469 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:43.779348  6315 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:43.819522  6469 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.821071  6469 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.823613  6351 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:43.807435  6527 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:59:43.828299  6365 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.751971  6486 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:43.829537  6486 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.831789  6399 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.791703  6345 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:43.832563  6442 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.799077  6514 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:43.833060  6345 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:43.833565  6514 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:43.834692  6514 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:43.837844  6344 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:43.811790  6523 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:43.838557  5991 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:43.845559  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 163910us
W20260709 12:59:43.843497  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 112985us
I20260709 12:59:43.846550  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:43.813097  6516 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:59:43.855023  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:43.835402  6345 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:43.876410  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 79027.4us
I20260709 12:59:43.941824  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.943463  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:43.944696  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 94657.2us
I20260709 12:59:43.946854  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.948247  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:43.952651  1566 leader_election.cc:400] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:43.953099  1566 leader_election.cc:403] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:59:43.954237  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:43.850562  6147 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:43.849323  6398 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.845824   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:43.993434  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:43.956111  6345 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:43.984853  6421 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.006s
I20260709 12:59:43.955760  6365 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.986721  6395 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.999929  6545 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 12:59:43.982657  6480 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:43.950337  6523 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.029685  5991 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.009946  6421 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.008265  6471 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:44.032358  6471 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:44.033411  6471 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:44.040593  6386 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.000s
I20260709 12:59:44.041923  1752 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:59:44.042327  1752 pending_rounds.cc:85] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 7
I20260709 12:59:44.042539  1752 pending_rounds.cc:107] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:44.043084  1752 raft_consensus.cc:2889] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:43.957057  2310 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:43.998517  6486 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:43.986372  6450 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.042438  1566 leader_election.cc:400] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 12:59:44.048686  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:44.049098  1566 leader_election.cc:403] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:59:44.052366  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48421.2us
I20260709 12:59:44.053625  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:44.054661  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:44.054064  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 203232us
I20260709 12:59:44.059429  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.060441  1751 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:44.063031  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.066633  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.056983  6523 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 12:59:44.070791  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.061360  6545 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:44.077658  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.012699  6365 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.060236  6486 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:44.087574  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.079638  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.094337  1748 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:44.096349  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.081591  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.090190  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.050866  6472 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:44.090993  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.104430  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:44.104821  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.105777  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.106031  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:44.107828  1750 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:59:44.105142  1594 raft_consensus.cc:2376] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14. Re-sending same reply.
I20260709 12:59:44.095022  6486 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.098440  6147 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.098771  6469 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.110482  6523 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.081871  6067 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.085970  6468 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:44.110685  6545 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:44.117717  6486 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:44.079493  6520 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:44.168877  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 75905.8us
I20260709 12:59:44.130286  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.196692  6365 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.182217  6545 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.210845  6559 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.211650  6559 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.214112  6559 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.170545  6472 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:44.234489  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 280264us
I20260709 12:59:44.165724  6469 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.163394  6147 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 12:59:44.242595  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 135096us
I20260709 12:59:44.167963  6523 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.244447  6559 raft_consensus.cc:1064] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:59:44.259493  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.259486  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.260543  1750 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 12:59:44.260902  2310 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:44.262619  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.263618  6548 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.266376  6067 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.266525  6520 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.267323  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.268702  6523 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.269081  6549 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.270860  6520 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:44.271389  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.271488  6520 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.274350  6520 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.274590  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:44.275799  6549 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:44.277385  6552 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:44.277848  6552 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:44.278913  6552 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.280673  6552 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:44.254781  6559 raft_consensus.cc:1068] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Unable to promote non-voter 570958eb733a4af7ae16ae020998c8b4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:44.287655  6450 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.288326  6450 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:44.290627  6522 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.686s	user 0.002s	sys 0.000s
I20260709 12:59:44.290791  6450 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:44.301939  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:44.299585  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:44.305087  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:44.307643  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.320931  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.339391  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2367) took 1746 ms. Trace:
I20260709 12:59:44.339910  1602 rpcz_store.cc:276] 0709 12:59:42.590506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.593362 (+  2856us) service_pool.cc:224] Handling call
0709 12:59:42.593726 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.225281 (+631555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.225312 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.225861 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.294591 (+ 68730us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 12:59:43.397044 (+102453us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:43.397116 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.397228 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.289894 (+892666us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:44.336778 (+ 46884us) raft_consensus.cc:1685] finished
0709 12:59:44.336802 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.336966 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":683560,"raft.queue_time_us":656445,"raft.run_cpu_time_us":1258,"raft.run_wall_time_us":43073,"spinlock_wait_cycles":47200256,"thread_start_us":107549,"threads_started":1,"wal-append.queue_time_us":198500}
I20260709 12:59:44.341609  6557 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:44.348120  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:44.349100  1678 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:44.350637  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.350937  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:44.304193  6450 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.340754  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:44.353914  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.352137  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.338080  6395 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:44.364161  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:44.339316  6386 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:44.286487  6486 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.339042  6462 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.368230  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:44.369889  6376 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.356933  6057 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:59:44.371127  6562 log.cc:927] Time spent T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:59:44.372689  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.373457  1750 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:44.367901  6559 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:44.378599  6559 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:44.378703  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:44.379107  6559 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:44.380716  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:44.387665  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.388643  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.365006  6469 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.389724  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:44.394472  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.395274  1750 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:44.396565  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:44.385149  6386 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:44.359619  6450 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.366205  6315 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:59:44.408823  6483 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:44.375295  6462 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.419519  6462 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:44.411599  6486 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.397220  6557 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:44.416164  6483 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:44.424860  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:44.402689  6469 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:44.428361  1750 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:44.422597  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70569us
I20260709 12:59:44.424072  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 1977) took 1233 ms. Trace:
I20260709 12:59:44.429967  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:44.431649  2316 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEARNER]: Advancing to term 13
I20260709 12:59:44.431731  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.429096  1669 rpcz_store.cc:276] 0709 12:59:43.190469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.195825 (+  5356us) service_pool.cc:224] Handling call
0709 12:59:43.196184 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.393886 (+197702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.393940 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.394019 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:43.394068 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.423803 (+1029735us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003237d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:44.423855 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.424005 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453823232}
I20260709 12:59:44.422492  6557 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.442703  6483 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.445076  6483 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:44.445247  6566 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:44.451834  6569 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:44.458947  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2365) took 1912 ms. Trace:
I20260709 12:59:44.441857  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.463320  1750 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:59:44.464901  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.465390  6512 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.047s	user 0.003s	sys 0.003s
I20260709 12:59:44.466965  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2129) took 1883 ms. Trace:
I20260709 12:59:44.468271  2316 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:44.427965  6469 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.476858  6469 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:44.467358  1677 rpcz_store.cc:276] 0709 12:59:42.583455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.586341 (+  2886us) service_pool.cc:224] Handling call
0709 12:59:42.602641 (+ 16300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:42.907003 (+304362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.907035 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:42.907658 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 12:59:43.308216 (+400558us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:43.308263 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.308335 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.459666 (+1151331us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 12:59:44.466609 (+  6943us) raft_consensus.cc:1685] finished
0709 12:59:44.466632 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.466896 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135768,"raft.queue_time_us":37283,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":99423,"spinlock_wait_cycles":34708864,"thread_start_us":675749,"threads_started":2,"wal-append.queue_time_us":462881}
I20260709 12:59:44.460181  1603 rpcz_store.cc:276] 0709 12:59:42.546143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.546497 (+   354us) service_pool.cc:224] Handling call
0709 12:59:42.546859 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.415938 (+869079us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:43.676497 (+260559us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.458290 (+781793us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b180011d520. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a
0709 12:59:44.458533 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.458592 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:44.458641 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.458715 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.458875 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":641727,"prepare.queue_time_us":259087,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":658625,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":17993,"spinlock_wait_cycles":55968128,"thread_start_us":464599,"threads_started":3,"wal-append.queue_time_us":135003}
I20260709 12:59:44.423154  6545 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:44.470041  6386 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.470784  1750 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:59:44.468516  6557 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:44.475793  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2316) took 1157 ms. Trace:
I20260709 12:59:44.476138  6450 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:44.487895  1752 rpcz_store.cc:276] 0709 12:59:43.318469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.356092 (+ 37623us) service_pool.cc:224] Handling call
0709 12:59:43.358109 (+  2017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.044943 (+686834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.475522 (+430579us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b540029e354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:44.475724 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571525504}
W20260709 12:59:44.488919  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47193.4us
I20260709 12:59:44.491194  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:44.492094  6486 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:44.493048  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.495146  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.493194  6322 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:44.504048  6147 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:44.517460  6514 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:44.521339  1602 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:44.493752  6482 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:59:44.497354  6450 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:44.537268  6147 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.538259  6147 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:44.541332  6147 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:44.543601  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.544575  2316 raft_consensus.cc:2393] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 12:59:44.547444  6322 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.551126  6395 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:44.551100  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56028.1us
I20260709 12:59:44.488292  6545 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:44.557570  6545 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:44.552734  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:44.560096  6545 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:44.567010  6519 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:44.567703  6519 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:44.568850  6519 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.574018  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:44.595885  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.596976  6462 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.606041  6395 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:44.608892  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:44.633260  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:44.643532  1603 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
W20260709 12:59:44.643675  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 69788.2us
W20260709 12:59:44.634188  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 79496.2us
I20260709 12:59:44.651678  1596 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:44.496300  6552 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:59:44.660243  6561 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.272s	user 0.000s	sys 0.004s
I20260709 12:59:44.693135  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.649966  6057 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:44.650074  6395 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:44.699798  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.703310  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.704164  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:44.675812  6552 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.718325  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2325) took 1258 ms. Trace:
I20260709 12:59:44.718976  1743 rpcz_store.cc:276] 0709 12:59:43.459381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.459867 (+   486us) service_pool.cc:224] Handling call
0709 12:59:43.460234 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.460527 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:44.514026 (+1053499us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.717854 (+203828us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.717920 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:44.717973 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.718058 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.718247 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1053120,"prepare.queue_time_us":1053781,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":203263,"threads_started":1}
I20260709 12:59:44.698185  6519 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:44.659003  6462 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.740710  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2310) took 1431 ms. Trace:
I20260709 12:59:44.722043  6552 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:44.767959  5920 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.719622  6544 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:44.779603  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:44.784435  6528 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.101s	user 0.003s	sys 0.000s
I20260709 12:59:44.792135  6508 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:44.733819  6057 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.794292  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:44.801127  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:44.806077  1594 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:59:44.804382  1599 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:44.815725  1599 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:44.818717  1598 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:59:44.819222  1598 pending_rounds.cc:85] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 12:59:44.819525  1598 pending_rounds.cc:107] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:59:44.819859  1598 raft_consensus.cc:2889] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.820267  6344 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.821025  6569 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.821616  6569 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:44.822335  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.822929  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:44.823647  1599 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:44.827864  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:44.832425  6344 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:44.741271  1745 rpcz_store.cc:276] 0709 12:59:43.309930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.310117 (+   187us) service_pool.cc:224] Handling call
0709 12:59:43.310544 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.310844 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:43.332059 (+ 21215us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.512489 (+1180430us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b1800293860. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 12:59:44.512743 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.740266 (+227523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.740334 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:44.740392 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.740471 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.740633 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1171278,"prepare.queue_time_us":1258037,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":2610,"raft.queue_time_us":14973,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13368,"spinlock_wait_cycles":10068864,"thread_start_us":212670,"threads_started":1}
I20260709 12:59:44.794114  5920 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.827135  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:44.808561  6508 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:44.846817  6508 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:44.790089  6545 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.753791  6559 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:44.838341  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:44.858850  1594 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 12:59:44.850530  6344 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.846266  6557 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.843163  6057 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:44.866876  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.870136  1600 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:44.863199  1599 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:44.962486  6469 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:44.967134  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 2326) took 1507 ms. Trace:
I20260709 12:59:44.967799  6462 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:44.968096  6482 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.970046  6559 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:44.866385  6545 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.875066  6569 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:44.873418  6148 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:44.982462  1746 rpcz_store.cc:276] 0709 12:59:43.459769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.492043 (+ 32274us) service_pool.cc:224] Handling call
0709 12:59:43.492508 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.493122 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:44.519479 (+1026357us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.747832 (+228353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.754891 (+  7059us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.755103 (+   212us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:44.755144 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.755232 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.966822 (+211590us) raft_consensus.cc:1685] finished
0709 12:59:44.966854 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.967047 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028073,"prepare.queue_time_us":1026146,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":15253,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":34009,"thread_start_us":227787,"threads_started":1,"wal-append.queue_time_us":400306}
I20260709 12:59:44.955929  6147 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:44.990474  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115990us
I20260709 12:59:44.918737  6345 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:44.875226  6108 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
W20260709 12:59:45.012531  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 276046us
I20260709 12:59:44.875133  6361 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 12:59:44.896771  6344 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.010852  6495 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:45.021843  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 376101us
I20260709 12:59:45.012738  6559 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.995046  6482 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:44.996711  5920 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.024789  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:45.050010  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:45.052058  1601 raft_consensus.cc:2955] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 5 to 10, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:45.020895  6541 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.014994  6345 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.015407  6147 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.055625  6376 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:45.092475  2310 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Advancing to term 14
I20260709 12:59:45.024547  6495 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:45.058398  6386 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:45.110493  6469 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.065851  6541 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.043134  6559 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:45.128511  6574 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:59:45.115401  6386 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.133749  6386 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:45.155772  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.159615  6361 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.160508  6361 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.166062  6351 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.204636  1750 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:59:45.197214  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 147250us
I20260709 12:59:45.216094  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:45.216341  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:45.217006  2313 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 12:59:45.223455  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.233462  6543 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.242679  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:45.246269  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 234392us
I20260709 12:59:45.244288  6543 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.214890  6521 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.176586  6480 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:45.250023  1743 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:45.251672  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:45.261515  1752 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:59:45.203780  6469 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.258108  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 51477.7us
I20260709 12:59:45.270473  6541 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.254627  6429 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:59:45.271530  6590 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.263723  6480 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.275638  6545 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.275902  6480 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.276733  6361 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.282938  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.284056  6559 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.284513  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.285923  6345 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.286298  6482 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.247117  6549 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.289933  6495 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.255910  6344 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.250351  6462 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.235293  6351 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.296418  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:45.263487  6584 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:45.295418  6395 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.012s
I20260709 12:59:45.309507  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.310909  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.302042  1751 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:45.300607  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.303951  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.304072  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.314782  1672 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:45.315773  1671 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:45.300951  1752 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:45.254361  5920 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:59:45.268283  6469 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.302140  6557 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.265527  6521 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.294968  6552 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.329937  6147 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.304786  6462 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.299048  6549 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.342548  6521 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.343966  6543 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.310467  6584 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.337934  6462 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.354674  1751 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 12:59:45.358256  1750 raft_consensus.cc:2368] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 12:59:45.324154  6057 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.311164  6395 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.363440  6386 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.365686  6395 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:45.365899  6386 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.366724  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:45.367307  6549 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.367486  1743 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:45.369112  6552 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:45.331943  6557 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:45.370008  6557 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.366775  1745 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:45.363791  6351 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:45.377625  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 127561us
I20260709 12:59:45.360409  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.378463  1751 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:45.380896  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:45.380895  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 129314us
I20260709 12:59:45.385465  1752 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:45.387745  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:45.386780  1743 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
W20260709 12:59:45.384619  6508 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.521s	user 0.015s	sys 0.000s
I20260709 12:59:45.393509  1752 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:45.394223  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.395085  1750 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:45.386125  6584 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.398906  6508 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.400233  6557 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.400559  1677 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:45.401372  6508 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.406325  6469 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.411347  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.415524  1744 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:45.418327  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.419026  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.421372  6351 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:45.419996  1750 raft_consensus.cc:2410] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:45.426772  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.427150  1566 leader_election.cc:400] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 12:59:45.427560  1566 leader_election.cc:403] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:59:45.428577  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:45.429276  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.429571  1744 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:45.430672  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.432828  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.433713  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.401695  6057 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.436674  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.437354  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.402223  5920 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:45.439657  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.440080  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:45.440457  1599 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:45.417786  6557 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.443742  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.444459  1598 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:45.442991  1751 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:45.403302  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:45.448549  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.433872  6108 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:59:45.434399  6351 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:45.430634  6584 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.454399  6584 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.457484  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.459875  1596 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 12:59:45.460453  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 57103.3us
I20260709 12:59:45.460860  1596 pending_rounds.cc:85] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 8
I20260709 12:59:45.461251  1596 pending_rounds.cc:107] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:59:45.461589  1596 raft_consensus.cc:2889] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:45.463234  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.464211  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:45.430198  6469 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:45.472481  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.450094  6557 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.446134  6419 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:45.443929  6057 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.448204  6590 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:59:45.467801  6543 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:45.446485  6429 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:59:45.462464  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:45.489464  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:45.502017  1744 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
W20260709 12:59:45.520133  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74778.4us
W20260709 12:59:45.521800  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60523.3us
I20260709 12:59:45.544430  6057 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.544620  6557 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.545972  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.550637  1751 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:45.497038  6575 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.495864  6419 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:45.496976  6594 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.552577  6543 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.602607  6419 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:45.610613  6521 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.613548  6108 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.614224  6108 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.604008  6593 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:45.624933  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 2393) took 1004 ms. Trace:
I20260709 12:59:45.620332  6543 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:45.633728  6469 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:45.634208  6469 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:45.634662  6469 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:45.637101  6584 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:45.624166  6521 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:45.638561  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 149185us
I20260709 12:59:45.624565  6593 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.643709  6108 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.644598  6593 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:45.646234  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 183828us
I20260709 12:59:45.652451  6108 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:45.645116  6521 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.602793  6575 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.652941  6584 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.656742  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:45.669420  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:45.671046  6521 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:45.671262  6575 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:45.672140  6322 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:45.672585  6322 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.672982  6322 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:45.673447  6351 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 12:59:45.671738  6395 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:45.683101  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.683133  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.679085  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:45.682966  6148 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:45.671082  6590 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:59:45.685322  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:45.685335  6148 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:45.671765  6521 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.682240  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.688791  6351 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.689368  6351 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.676225  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.687182  6148 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.689672  6521 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:45.695399  6351 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.695386  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:45.696672  2313 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:45.678910  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:45.711134  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.717832  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.718320  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:45.718896  6508 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:59:45.720329  6594 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:59:45.724318  6469 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.720134  6419 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.719353  6429 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:45.733698  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:45.733794  2313 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 12:59:45.625856  1602 rpcz_store.cc:276] 0709 12:59:44.620925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.621997 (+  1072us) service_pool.cc:224] Handling call
0709 12:59:44.646991 (+ 24994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.647300 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:44.670360 (+ 23060us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.416096 (+745736us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800415360. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 12:59:45.610044 (+193948us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.624421 (+ 14377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:45.624500 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:45.624565 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.624666 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.624855 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132726,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":5263,"raft.queue_time_us":13416,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":2088,"spinlock_wait_cycles":10490624,"thread_start_us":171316,"threads_started":2,"wal-append.queue_time_us":928608}
I20260709 12:59:45.740414  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:45.742820  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:45.743232  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:45.744053  6351 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.744148  6344 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.744761  6351 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.747066  6351 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.753274  6508 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:45.754247  6429 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:45.755261  6429 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.755949  1671 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:45.758020  6419 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:45.771185  6361 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:45.771925  6361 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:45.772877  6361 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.774077  6361 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:45.777870  2310 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.685s	user 0.016s	sys 0.000s
I20260709 12:59:45.778764  2310 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:59:45.779176  2310 pending_rounds.cc:85] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 9
W20260709 12:59:45.780390  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.789328  1745 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:45.789776  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:45.802958  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.803189  1744 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:45.790879  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.791771  1751 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:45.807171  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.807864  1751 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:45.795375  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.809345  1595 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
W20260709 12:59:45.809458  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 66730.4us
I20260709 12:59:45.798166  1600 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:59:45.810873  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:45.799994  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.791843  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.812179  1596 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 12:59:45.800717  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:45.790771  1601 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 12:59:45.818194  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:45.819491  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:45.820291  1601 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:45.782366  2310 pending_rounds.cc:107] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:59:45.823288  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.825932  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:45.789179  5920 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.831074  1678 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:59:45.831333  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.832224  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.830736  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:45.832558  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.833505  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.826051  6593 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.835026  1676 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:59:45.816272  6583 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:45.834915  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:45.835714  1497 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 199) took 17556 ms (client timeout 15000 ms). Trace:
I20260709 12:59:45.838307  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.854610  1674 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:45.840116  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:45.829718  6552 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:45.802639  6590 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:59:45.857812  6595 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:45.827040  2310 raft_consensus.cc:2889] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.802428  6419 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:59:45.855983  1597 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 12:59:45.835530  6575 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.836170  6395 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:45.875185  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.875419  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.771440  6543 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.876703  1670 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:45.894620  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 251833us
I20260709 12:59:45.894717  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:45.853609  1497 rpcz_store.cc:269] 0709 12:59:28.272210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.344329 (+ 72119us) service_pool.cc:224] Handling call
0709 12:59:45.828585 (+17484256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:39.789416 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:39.914712 (+125296us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:39.939344 (+ 24632us) write_op.cc:435] Acquired schema lock
0709 12:59:39.941576 (+  2232us) tablet.cc:662] Decoding operations
0709 12:59:39.988752 (+ 47176us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:39.988829 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:39.988855 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:59:39.989878 (+  1023us) tablet.cc:701] Row locks acquired
0709 12:59:39.989892 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:59:39.990071 (+   179us) write_op.cc:270] Start()
0709 12:59:39.990199 (+   128us) write_op.cc:276] Timestamp: P: 1783601979990009 usec, L: 0
0709 12:59:39.990242 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:59:39.991072 (+   830us) log.cc:844] Serialized 4810 byte log entry
0709 12:59:40.254984 (+263912us) op_driver.cc:464] REPLICATION: finished
0709 12:59:40.723277 (+468293us) write_op.cc:301] APPLY: starting
0709 12:59:40.723383 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:41.066053 (+342670us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:41.066218 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:41.502513 (+436295us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:41.502870 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:59:41.502928 (+    58us) write_op.cc:312] APPLY: finished
0709 12:59:41.503338 (+   410us) log.cc:844] Serialized 113 byte log entry
0709 12:59:41.558070 (+ 54732us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.558272 (+   202us) write_op.cc:454] Released schema lock
0709 12:59:41.558334 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:41.579195 (+ 20861us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.581858 (+  2663us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21184,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":425020,"apply.run_cpu_time_us":42115,"apply.run_wall_time_us":842825,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":151863,"prepare.run_cpu_time_us":6485,"prepare.run_wall_time_us":226355,"replication_time_us":252812,"thread_start_us":311260,"threads_started":3,"wal-append.queue_time_us":54851,"wal-append.run_cpu_time_us":1236,"wal-append.run_wall_time_us":1013542}]]}
I20260709 12:59:45.881829  6599 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:45.898573  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.884965  6469 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:45.885560  1597 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:45.872617  1601 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:45.890493  1672 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:45.887074  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.867815  6552 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.854077  6593 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.896894  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.896871  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:45.918574  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:45.907352  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.920250  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.903304  1501 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.892583  6514 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:45.906406  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.925323  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:45.925468   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:45.897830  6521 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:45.938059  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:45.938335  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.939617  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.885672  6595 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:45.925714  1501 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 7 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:45.898844  6599 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:45.932291  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.932840  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:45.918605  6552 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:45.942265  1501 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 12, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:45.943394  1672 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:45.926646  1594 pending_rounds.cc:85] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:45.948495  1594 pending_rounds.cc:107] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:45.948812  1594 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.944377  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:45.948524  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.893909  6575 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:45.951699  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:45.955063  1674 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:45.953014  1671 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:45.945554  6057 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:45.946424  6521 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:45.949479  1501 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:45.952370  6450 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:46.065106  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:45.958029  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:46.022841  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:45.937146  6514 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:46.014780  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.032196  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.030634  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.020473  6584 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.036023  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:46.029502  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 77687.4us
I20260709 12:59:46.083070  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.041620  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.099361  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.100277  1595 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:46.030637  6322 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.046164  6580 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:46.046397  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.036090  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.020802  6565 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:46.022159  6607 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.075s	user 0.002s	sys 0.009s
I20260709 12:59:46.052115  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:46.061280  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 164438us
I20260709 12:59:46.075030  1743 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:46.034752  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.063745  1501 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 11, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.116583  1501 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.118234  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 11, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.100167  1677 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:46.108927  1673 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:46.079689  6462 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.083158  6147 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:46.122010  1501 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:59:46.102723  6609 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:59:46.096474  5920 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:46.129776  1501 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.100416  6386 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.138163  1746 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:46.098893  6450 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:46.113871  6608 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:59:46.137192  1501 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.145546  1670 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:46.150884  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.175460  1501 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 13, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.178028  1501 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 12, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.162372  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.083012  6108 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:59:46.180866  1501 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.109887  6565 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:46.185770  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.187666  1501 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.134671  6462 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:46.206679  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 79441us
I20260709 12:59:46.147125  6557 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:46.134948  6558 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 12:59:46.229383  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67136.8us
I20260709 12:59:46.128988  6147 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:46.229108  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.209175  6543 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.189483  1501 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.220472  6593 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.236557  6429 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:46.177603  6386 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.237498  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.239771  6514 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.223806  6591 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.248521  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:46.248955  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.235797  6147 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.230815  6617 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:46.267424  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.524s (SENT) [suppressed 15 similar messages]
I20260709 12:59:46.266335  6575 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.258625  6593 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:46.104918  6599 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.228636  6557 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.281843  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:46.281985  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44597.9us
I20260709 12:59:46.278914  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.276122  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:46.283461  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.283720  1743 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.284791  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.284878  1501 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.287281  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.287029  1501 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.260897  6569 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.289644  1501 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.292805  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.292613  1501 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.296713  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.298622  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.300659  1745 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 12:59:46.298599  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:46.302167  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.302376  1601 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:46.304131  6593 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:46.304406  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:46.306841  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.277596  6575 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.320801  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.279738  6595 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.277431  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:46.314949  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.328213  1601 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:46.329241  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.315855  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.329983  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:46.316432  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.276382  6618 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:46.323046  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.323930  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.245316  6450 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.325610  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.296811  6569 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:46.393880  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 68344.4us
I20260709 12:59:46.326607  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.327205  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.395624  6569 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:46.396399  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69283.8us
W20260709 12:59:46.397545  6614 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:59:46.290460  5920 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:46.331751  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.400084  6495 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.287660  6521 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:46.400974  6610 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:46.401226  6521 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.352154  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.401778  6521 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.330366  1744 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:46.305533  6593 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.333295  1752 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:46.360831  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.296319  1501 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 14, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.330013  1601 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.399094  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.407584  1501 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 11, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.408717  6595 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:46.409130  6595 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:46.321929  6613 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:59:46.409516  6595 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:46.274624  6617 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.312258  6344 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.407377  6521 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.361389  6618 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.367322  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.412353  6617 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:46.412470  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45232.9us
I20260709 12:59:46.413025  6617 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:46.413378  6617 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.413553  6618 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:46.413717  6617 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:46.414390  1595 raft_consensus.cc:1813] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Handling vote request from an unknown peer fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.415050  1595 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:59:46.361300  1743 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
W20260709 12:59:46.415704  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.376336  6462 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.409371  1501 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.417861  1501 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:46.424096  6462 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.424832  6462 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.424284  1501 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.425709  6565 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.427350  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:46.427268  6462 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.430717  1751 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:46.268108  6591 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:46.390550  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:46.294945  6625 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:46.322949  6514 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.386047  6147 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.352489  6361 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:59:46.404935  6558 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.328500  6575 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.384641  6386 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.327713  6351 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:46.372220  6180 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:46.426833  1501 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 8 to 9, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.483572  1501 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 10 to 12, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.427147  6565 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:46.438175  1601 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:46.438467  1597 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:46.453547  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.430316  6590 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:59:46.455092  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.461512  6108 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:46.471429  6625 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.463896  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:46.470345  6344 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:59:46.468073  6591 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.472273  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:46.474347  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.470470  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.513513  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.379189  6557 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:46.479076  1598 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
W20260709 12:59:46.481202  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 343505us
I20260709 12:59:46.497856  1752 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:46.494508  6351 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.510098  6147 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.515172  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.540822  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.541880  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:46.516726  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50197.6us
I20260709 12:59:46.542873  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.487768  6180 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:46.548831  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.478089  6514 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.558496  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.561903  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.563251  1676 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:59:46.564101  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:46.564965  1669 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.512235  6625 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:46.571415  6395 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.517030  6623 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:46.572751  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.576126  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.520088  6628 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:46.576659  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.593348  1669 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:46.519105  6558 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:46.575721  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:46.595361  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.551278  6619 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:46.550491  6557 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:46.551342  6621 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:46.566625  6148 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:46.538079  6462 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:59:46.590543  6623 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.617067  6351 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:46.593144  6628 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.557264  6620 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:59:46.604038  6619 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.600147  6395 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.606912  6558 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:46.607900  6148 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.641799  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.637805  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:46.638262  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.645951  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:46.653249  1744 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.647599  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:46.630385  6552 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.676s	user 0.018s	sys 0.001s
I20260709 12:59:46.647605  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:46.634354  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62744.6us
I20260709 12:59:46.649353  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:46.632086  6630 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:59:46.647920  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.655789  1599 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:46.696069  1595 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:46.656126  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.620090  6180 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.664525  6395 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.666960  6558 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:46.654596  6148 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.683215  6552 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.609697  6627 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:59:46.641525  6619 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:46.705746  1744 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:46.629381  6623 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.650421  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.697355  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:46.688578  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 121441us
I20260709 12:59:46.695322  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.703256  6641 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:46.709833  6575 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.632733  6628 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.718454  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.726001  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.723124  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.722486  6395 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:46.736189  6395 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.736735  6395 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.737543  6552 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.741981  6344 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:46.743922  6557 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:46.744737  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.751645  6620 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:59:46.753415  6620 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:46.753921  6620 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:46.755976  6583 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:46.758865  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:46.766449  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.769927  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.747206  6637 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:46.712504  6595 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.722646  6621 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:46.795137  6583 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:46.799700  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.803871  6322 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.806273  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.807116  6627 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:46.776038  6386 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:46.809082  6386 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.809478  6386 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.781183  6057 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:46.818555  6180 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.776576  6593 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:46.773811  6575 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:46.822202  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.792472  6621 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.824546  6621 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.825423  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:46.829939  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.830950  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:46.832132  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:46.744745  6557 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:46.823884  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:46.818373  6627 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:46.818222  6619 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.777626  6637 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:46.851531  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.848994  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:46.825466  6599 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:46.861446  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 137663us
I20260709 12:59:46.863866  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:46.788522  6617 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.871495  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:46.876277  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.841837  6469 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:59:46.893926  6617 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.863596  6640 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.898734  1602 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:46.791945  6620 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.873457  6646 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:46.907729  6646 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:46.908187  6646 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:46.909689  2316 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:46.860318  6625 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.918020  1744 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:59:46.878299  6647 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:46.901399  5920 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:46.905498  6640 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.934475  6627 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.934942  5920 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:46.935451  5920 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:46.935097  6627 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.936725  6640 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.936590  5920 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.937664  6627 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.937932  5920 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.920554  6351 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:46.939466  6628 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.919255  6584 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:46.921407  6619 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:46.921852  6636 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.350s	user 0.004s	sys 0.000s
I20260709 12:59:46.941123  6584 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.941931  6628 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.925294  6625 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.924767  6148 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.871558  6557 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.930734  6646 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.933967  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:46.931509  6395 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.952478  1744 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:46.923317  6595 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:46.943508  6584 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.955444  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:46.964308  1743 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.915215  6617 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:46.974889  6617 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:46.896274  6637 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:46.976527  6637 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:46.986785  1743 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:46.973188  6395 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:46.962862  1744 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 12:59:46.930016  6623 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.990017  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:46.944639  6148 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.004474  6351 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:47.005138  6646 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.005467  6351 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:47.007099  6351 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:46.959384  6591 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:47.010452  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:47.001792  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:47.013283  1751 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:59:47.011844  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.009725  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 140482us
I20260709 12:59:47.016407  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.019730  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:47.014853  6628 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:47.024120  6628 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:47.025091  6628 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.027418  6593 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:47.028028  6593 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:47.028442  6593 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.042506  6514 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.038008  1751 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 12:59:46.976022  6617 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.013820  6591 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:47.054335  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.052042  1676 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.052723  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.057247  6584 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:47.057873  6584 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:47.058961  6584 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.059829  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.062341  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:46.965991  6621 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.061226  6569 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.064085  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.065551  6629 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:47.068279  6591 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.069773  6591 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.052037  6653 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:47.068862  6623 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.072501  1669 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:47.074316  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.082707  6386 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.086112  6386 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.079802  6617 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.075814  6653 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.079384  6569 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:47.104390  1676 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:47.106881  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.109262  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:47.113612  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.114794  6569 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.113278  6514 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:47.115754  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.116223  6514 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.115427  6569 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.119655  6514 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:47.118335  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 240620us
I20260709 12:59:47.122349  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:47.121299  6569 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.125752  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.128499  6637 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:47.129220  6637 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:47.130405  6637 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.138787  6583 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.141702  6583 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.144269  6583 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.138928  6569 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.144958  6569 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.148106  6593 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:47.147265  6569 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.139901  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:47.151160  6599 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:47.153368  6620 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:47.159318  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 111967us
I20260709 12:59:47.161304  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:47.168722  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.169562  6569 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:47.169754  1602 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:47.170068  6569 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.171271  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.172289  6395 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.171728  6569 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.161453  6583 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:47.180584  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.181006  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.174922  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.156570  6621 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.192613  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:47.193763  1744 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.195670  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:47.196339  1743 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.199036  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.201776  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.202672  1670 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 12:59:47.203012  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.203289  1603 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:47.204154  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.212067  2313 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:59:47.193333  6641 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.214082  6593 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:47.217334  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.224493  1743 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:47.226944  1744 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
W20260709 12:59:47.235217  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.235620  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:47.236374  1595 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.237572  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.238951  1597 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:47.240223  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.240913  1599 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:59:47.245106  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:47.249807  1751 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:59:47.257795  1750 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 12:59:47.260151  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.264007  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:47.265448  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:47.205317  6653 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.266188  1600 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.269996  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.274425  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.279413  1745 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.272450  1744 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:47.286007  1594 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:47.201581  6583 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.289361  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:47.290149  1746 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:47.290295  1599 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.271158  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.300015  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:47.301064  1596 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:59:47.305284  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.272701  6593 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:47.336678  1747 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:47.272780  6575 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 12:59:47.310331  6627 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:47.350462  6659 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:59:47.338318  6593 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:47.332938  6514 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:47.375627  6629 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:47.281975  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:47.417033  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 139382us
I20260709 12:59:47.419066  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:47.426887  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.424528  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.448701  1594 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:47.436296  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:47.436398  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:47.445204  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:47.446965  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.431028  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:47.454829  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:47.376633  6583 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:47.574666  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.578069  6623 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:47.583881  6623 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:47.580796  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:47.577600  6351 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.602968  1676 raft_consensus.cc:606] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.586840  6593 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:47.620028  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 175450us
I20260709 12:59:47.620437  6469 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:47.620880  6514 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.619628  6620 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:47.650197  6661 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.315s	user 0.003s	sys 0.003s
W20260709 12:59:47.619741  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.652164  6351 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.587239  6623 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.667771  6625 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.623708  1751 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
W20260709 12:59:47.619838  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.693113  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.682418  6469 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:47.668684  6625 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:47.702106  2313 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:47.704806  6508 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:47.711668  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.712072  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.712747  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.713914  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.714687  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.716670  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.716579  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.715063  1673 raft_consensus.cc:2368] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11.
I20260709 12:59:47.737790  1675 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:47.740595  6469 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.741271  6557 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.742250  6557 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.745047  6351 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.745623  6592 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.746510  6592 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:47.732746  6569 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.005s
I20260709 12:59:47.749161  6625 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:47.753057  6386 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.761001  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.762460  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.764957  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.766758  6677 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.767851  6677 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.770749  6677 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.780844  6386 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:47.783759  6672 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 12:59:47.763967  6569 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.796192  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.801272  6592 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:47.804404  6617 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.712s	user 0.016s	sys 0.007s
W20260709 12:59:47.805332  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.806809  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.811852  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.813017  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.817852  1596 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:47.819190  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.823489  6663 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.448s	user 0.000s	sys 0.003s
I20260709 12:59:47.824759  6557 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.828092  1672 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:47.837186  6641 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.796254  6569 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.838097  6641 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.850261  6641 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.852170  6351 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.853871  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:47.858667  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49471.6us
I20260709 12:59:47.862435  1674 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:47.853235  6386 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.866631  1676 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:47.867292  6450 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:47.868016  6450 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.869865  1746 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:47.866674  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.875023  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.873934  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.855481  6351 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:47.890029  1751 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:59:47.887224  1672 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.891669  1752 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:59:47.895533  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.897289  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.908440  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:47.904388  1600 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.583s	user 0.016s	sys 0.009s
I20260709 12:59:47.916023  1743 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:47.918916  1743 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:47.923571  1746 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.914450  1669 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 12:59:47.912683  6583 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.927490  6351 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:47.917330  1600 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:47.933607  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.934422  6583 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.935281  1601 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.937005  6583 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.937677  6322 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:59:47.922946  6450 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:47.944340  6351 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:47.947744  6557 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:47.947885  6351 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:47.948856  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:47.957598  6557 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:47.952608  6684 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:59:47.959451  6683 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:59:47.962016  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.962311  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:47.963219  1743 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:47.964553  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.966068  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:47.967089  1746 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:47.968114  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.969112  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:47.969884  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:47.971204  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.968053  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:47.978507  1749 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:47.981899  6450 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:47.984722  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.985100  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:47.985531  1596 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:47.985700  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.984743  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:47.987349  1670 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:47.991717  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.992024  6322 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:47.992136  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:47.992873  6569 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:47.993281  6641 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:47.993763  6641 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:47.995355  6641 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:47.996667  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:47.997313  6641 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:47.998391  6450 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:48.001483  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:48.002337  1601 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:48.003924  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:48.005121  6450 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:48.007050  6450 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.007714  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:48.007777  6450 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:47.951033  6351 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:48.011277  6450 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:48.014925  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:48.016644  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:48.017299  6450 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:48.019835  6583 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:48.020900  1747 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:59:48.026553  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.027639  6386 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:48.030390  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.031219  6558 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.034775  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.036373  1672 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:48.034933  6386 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:48.034607  6558 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.040619  6386 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.041566  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.042061  6558 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:48.042766  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.042974  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.043383  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.044082  1674 raft_consensus.cc:2376] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13. Re-sending same reply.
I20260709 12:59:48.044436  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.045310  1669 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 12:59:48.045565  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.046115  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.046211  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.047073  1669 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:48.048002  1752 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:59:48.049105  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.049468  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.049930  1746 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:48.050338  1669 raft_consensus.cc:2410] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:59:48.051169  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.052551  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.053124  1673 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:59:48.056350  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.056686  1750 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:48.057332  1677 raft_consensus.cc:2410] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:59:48.059677  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.067268  1749 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:48.071288  1601 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:48.071586  1671 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:48.076261  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.077303  1746 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:48.076403  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.077862  1750 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 12:59:48.078006  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:48.078269  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.078719  2310 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:48.079599  6351 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:48.080581  1747 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:59:48.082100  6685 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 12:59:48.084997  1677 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 4. (term mismatch)
I20260709 12:59:48.089335  1677 pending_rounds.cc:85] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 3
I20260709 12:59:48.088456  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.090426  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.093108  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.089612  1677 pending_rounds.cc:107] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 10.4
I20260709 12:59:48.094431  1677 raft_consensus.cc:2889] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:48.094583  1750 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 12:59:48.095505  6322 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:48.090878  6469 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:59:48.096101  6322 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.098483  6322 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:48.098793  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 82281.3us
I20260709 12:59:48.099391  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:48.100775  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:48.092504  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.101646  6469 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:48.102449  1749 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:48.106385  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.107380  1674 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:48.110061  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:48.111718  1596 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:48.116250  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.116750  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.120091  1601 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 12:59:48.123231  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:48.130244  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.131081  1671 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:48.132036  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.133872  6617 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:48.135114  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.134303  6617 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.140177  6617 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:48.130309  6469 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:48.141657  6469 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.142377  6592 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:48.137053  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.144829  1596 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:48.145548  6116 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:48.146377  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.127612  6351 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:48.148129  6351 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:48.148429  1603 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:59:48.148633  6351 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:48.148849  1603 pending_rounds.cc:85] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 12:59:48.149178  1603 pending_rounds.cc:107] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:59:48.149420  1603 raft_consensus.cc:2889] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:48.137144  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.152433  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.154901  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.160233  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.163070  1674 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:48.160813  1600 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:48.172009  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.172897  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.173977  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:48.162209  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:48.190066  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.193822  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.196583  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:48.188720  1566 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.503s (SENT)
W20260709 12:59:48.199685  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.200781  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:48.202232  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:48.211709  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52662.9us
I20260709 12:59:48.215970  5920 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.216646  5920 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.219051  5920 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:48.219409  6450 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.224643  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:48.206260  6322 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:48.229708  1677 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:48.237262  1672 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:59:48.234535  1677 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:48.244786  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 105061us
I20260709 12:59:48.243222  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:48.253434  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:48.250530  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:48.227821  6469 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:48.261399  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.257660  1671 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:48.275342  6180 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:48.275913  6180 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.276077  5920 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.276358  6180 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:48.276775  5920 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:48.259236  6322 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:48.283349  1673 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 12:59:48.287714  6322 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.266018  6386 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:59:48.298955  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 124049us
I20260709 12:59:48.273252  1677 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.279904  6583 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:48.300246  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.312783  6180 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.280362  5920 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:48.336840  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.327898  6386 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.350579  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 97240us
I20260709 12:59:48.352275  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:48.347653  6558 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:48.356873  1677 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:48.347383  6386 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:59:48.361302  6686 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:59:48.359678  1566 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.504s (SENT)
W20260709 12:59:48.363189  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.363999  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:48.380249  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.375665  6592 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:48.395602  1566 leader_election.cc:336] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.524s (SENT)
I20260709 12:59:48.396148  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:48.397018  6592 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.398350  1678 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:48.398651  1676 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:48.398986  1676 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:48.400233  1596 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:48.400137  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.401093  1672 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:48.401713  1600 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:48.404078  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.404974  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.333877  6617 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.399952  1676 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.393051  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:48.408406  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.408668  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:48.406891  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 156440us
I20260709 12:59:48.376572  6558 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:48.413955  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.415622  1675 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:59:48.418680  1676 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:48.417166  6569 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:48.450878  1669 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
W20260709 12:59:48.452816  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.488854  1677 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:48.445729  6180 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:48.493786  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 96194.1us
I20260709 12:59:48.479424  6569 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:48.498690  6669 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:59:48.507144  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.519627  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 100419us
I20260709 12:59:48.533726  1601 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:48.539184  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:48.539898  1743 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:48.561878  1602 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:48.567730  1676 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:48.566963  1750 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:59:48.574800  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.589650  1566 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.633s (SENT)
W20260709 12:59:48.596215  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.584430  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.589701  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.600751  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:48.553025  6629 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 12:59:48.605818  1594 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:48.608726  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.530609  6558 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.616268  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:48.630673  1599 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:48.636147  1752 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:48.634608  1751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:48.638692  1751 raft_consensus.cc:606] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
W20260709 12:59:48.640055  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.641669  6690 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
I20260709 12:59:48.643755  1598 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:48.641544  6575 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.651896  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.616189  6592 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.635182  6617 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:48.668013  6386 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:48.671953  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 84482.9us
I20260709 12:59:48.672868  6575 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.616321  6569 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:48.706207  6692 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 12:59:48.709421  1743 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
W20260709 12:59:48.706892  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 165724us
I20260709 12:59:48.711876  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.712129  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.733777  1751 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:48.714157  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:48.738916  1594 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
W20260709 12:59:48.712879  6691 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.345s	user 0.000s	sys 0.006s
I20260709 12:59:48.743750  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:48.746651  1750 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:48.748391  1752 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:48.748870  1566 leader_election.cc:336] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.657s (SENT)
W20260709 12:59:48.749706  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 169776us
I20260709 12:59:48.750407  1602 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:48.765487  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:48.752600  6575 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.772066  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:48.764848  6351 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.002s
I20260709 12:59:48.776648  1715 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:48.781893  6322 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:48.782792  6322 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.770995  6569 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:48.786353  6569 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.772783  6450 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:48.790048  6322 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.794757  6702 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:48.802512  6557 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:48.778120  6693 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:48.803360  6557 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.804217  6693 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.806850  6693 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.807916  6386 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.777081  6351 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.810482  6351 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:48.811499  6557 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:48.790683  6575 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:48.795997  6617 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.818537  1566 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.671s (SENT)
I20260709 12:59:48.820833  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:48.797777  6558 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:48.826992  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.815760  6322 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:48.841377  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.839241  6557 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.851601  6557 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:48.854029  1566 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.625s (SENT)
I20260709 12:59:48.854501  6557 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:48.854573  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:48.857702  1566 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.714s (SENT)
I20260709 12:59:48.826395  6450 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:48.838495  6569 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.865613  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:48.842851  6558 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:48.867002  6351 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.873912  1670 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:48.874359  1670 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:48.875128  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.879197  6713 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:48.861752  6557 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:48.843065  6617 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.875313  1670 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:48.888025  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.893359  1670 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:48.845886  6322 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:48.858861  6709 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:59:48.905105  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.891360  5920 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:59:48.912474  6558 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:48.916621  6450 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.891844  6351 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.919932  5920 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:48.927197  6617 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:48.929803  6322 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:48.932937  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:48.934175  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.934777  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 77101.4us
W20260709 12:59:48.935593  1566 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.721s (SENT)
W20260709 12:59:48.936942  1566 leader_election.cc:336] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.745s (SENT)
I20260709 12:59:48.937400  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:48.950457  1670 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:48.958287  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:48.962109  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:48.982977  6583 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.983278  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:48.986615  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.010690  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48711us
W20260709 12:59:48.988893  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.008951  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56964.2us
I20260709 12:59:48.948805  6351 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:49.047350  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.076783  6583 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.048362  6322 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:49.129050  6322 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:49.129592  6322 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:49.047829  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 161626us
I20260709 12:59:49.133064  6723 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:49.135761  5920 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:49.136274  5920 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.137290  5920 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.138728  5920 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:49.143592  6583 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.073302  6724 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:59:49.025120  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.122196  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74336us
I20260709 12:59:49.148088  6724 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.158419  1496 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.159926  6724 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.161514  6724 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:49.163643  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.165908  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.161069  1496 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.168848  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.169956  1670 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:49.173261  6701 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:49.174786  6701 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.176802  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.177317  6701 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.178632  6701 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:49.179423  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.179834  6557 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:49.179515  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.183744  6557 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:49.184891  6322 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.185674  6450 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:49.183441  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.192296  1674 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:49.196177  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.205374  1675 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:49.207487  1674 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.217576  6557 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:49.214454  6715 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:59:49.219810  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:49.222234  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.210628  6450 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.228154  6557 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.228274  1496 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 5 to 10, term changed from 11 to 13, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 13 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.234462  6617 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.250785  6723 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:49.252151  6723 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:49.252578  6723 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.252660  6351 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:49.253614  6723 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.232810  6450 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:49.235826  1674 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.258579  1674 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:49.260452  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.270591  1496 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 12 to 14, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.255228  6723 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:49.277626  1496 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.258538  6322 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.287961  1674 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:49.284264  1496 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 5 to 7, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:59:49.291674  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.290994  1496 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:49.292511  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 70363.6us
I20260709 12:59:49.293597  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.294590  6351 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:49.295163  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.297183  1677 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:49.297724  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:49.296190  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52544.3us
I20260709 12:59:49.300388  6351 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:49.300477  6322 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:49.301481  6583 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.313736  1752 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:49.313269  6386 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 12:59:49.326998  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.305296  6583 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.320564  6715 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:49.321619  6351 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:49.331722  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.335168  6728 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:49.335886  6351 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:49.336512  6728 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:49.336963  6728 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.337929  6728 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.338439  6351 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:49.346643  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.339403  6728 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.357405  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 169) took 7516 ms. Trace:
I20260709 12:59:49.359108  6583 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.353849  6351 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:49.329704  6450 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:49.371793  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45990us
I20260709 12:59:49.380885  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:49.371445  6732 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:49.373136  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.393980  6731 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:49.394655  6731 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.395705  6731 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:49.398434  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.401141  6351 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:49.358289  1501 rpcz_store.cc:276] 0709 12:59:41.798825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.806608 (+  7783us) service_pool.cc:224] Handling call
0709 12:59:43.139745 (+1333137us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:59:49.307964 (+6168219us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:46.909057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:46.909804 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:46.909868 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:59:46.909895 (+    27us) tablet.cc:662] Decoding operations
0709 12:59:46.915706 (+  5811us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:46.915796 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:46.915840 (+    44us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:59:47.067526 (+151686us) tablet.cc:701] Row locks acquired
0709 12:59:47.071577 (+  4051us) write_op.cc:260] PREPARE: finished
0709 12:59:47.071769 (+   192us) write_op.cc:270] Start()
0709 12:59:47.071921 (+   152us) write_op.cc:276] Timestamp: P: 1783601987071712 usec, L: 0
0709 12:59:47.071947 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:59:47.091440 (+ 19493us) log.cc:844] Serialized 10630 byte log entry
0709 12:59:47.362262 (+270822us) op_driver.cc:464] REPLICATION: finished
0709 12:59:47.561944 (+199682us) write_op.cc:301] APPLY: starting
0709 12:59:47.562221 (+   277us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:48.075053 (+512832us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:48.093885 (+ 18832us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:49.005209 (+911324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:49.005761 (+   552us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 12:59:49.005843 (+    82us) write_op.cc:312] APPLY: finished
0709 12:59:49.006890 (+  1047us) log.cc:844] Serialized 236 byte log entry
0709 12:59:49.075164 (+ 68274us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.075662 (+   498us) write_op.cc:454] Released schema lock
0709 12:59:49.075773 (+   111us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:49.094395 (+ 18622us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.094441 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":410,"reported_tablets":47,"spinlock_wait_cycles":16982272,"child_traces":[["op",{"apply.queue_time_us":197614,"apply.run_cpu_time_us":59789,"apply.run_wall_time_us":1532561,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117149,"num_ops":27,"prepare.queue_time_us":247288,"prepare.run_cpu_time_us":32920,"prepare.run_wall_time_us":309566,"raft.queue_time_us":153195,"raft.run_cpu_time_us":16057,"raft.run_wall_time_us":226583,"replication_time_us":273228,"thread_start_us":572887,"threads_started":5,"wal-append.queue_time_us":178173,"wal-append.run_cpu_time_us":14758,"wal-append.run_wall_time_us":1145883}]]}
I20260709 12:59:49.377524  6450 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.402252  6351 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:49.405833  6351 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.408298  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.407982  6709 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:49.409237  6724 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:49.409695  6724 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.410069  6724 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:49.383364  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:49.408421  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58407.7us
I20260709 12:59:49.417240  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:49.417928  1674 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:49.423372  6583 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.424075  6583 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.426321  6583 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.428519  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.429579  1673 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:59:49.432269  1674 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:49.433113  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.435873  6617 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.438197  6728 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:49.439636  6709 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:49.440013  6709 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.440881  6709 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.441649  6724 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:49.443001  6709 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:49.444044  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 60756.6us
I20260709 12:59:49.444887  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.444970  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:49.447932  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.448436  6583 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.452337  6583 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.453374  6575 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:49.454581  6575 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:49.454938  6583 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.456126  6617 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:49.455778  6575 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.456650  6723 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:49.458914  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.459750  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.460111  6617 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:49.460666  6617 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:49.463320  6723 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:49.463900  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.464589  1677 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:49.461591  6617 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.473768  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.474757  6723 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.479108  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.476534  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.480674  6701 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:49.485426  6709 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:49.493557  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.492887  6701 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.495304  6701 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:49.495800  6728 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:49.498176  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.499799  6709 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.500219  6724 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:49.505532  6557 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:49.506242  6557 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.511109  6557 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:49.516157  6557 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:49.528878  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.529948  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.549440  6728 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:49.549683  6557 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.550244  6724 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:49.553175  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.553458  6583 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:49.567581  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 99) took 6027 ms. Trace:
I20260709 12:59:49.568336  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet 0193c6e20d1c4a33997d268895b8c083 with delete_type TABLET_DATA_TOMBSTONED (TS fab19506de7242869c29d70c9fffb739 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48436
I20260709 12:59:49.561864  6701 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.578358  6641 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:49.580224  6724 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:49.584827  6709 raft_consensus.cc:1064] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:59:49.590121  1603 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:59:49.591089  1751 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:59:49.591696  6583 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.595707  6617 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:49.635340  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:49.635524  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.636004  1676 raft_consensus.cc:606] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:49.636406  1676 raft_consensus.cc:614] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:49.596598  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 43526.6us
I20260709 12:59:49.636684  1674 raft_consensus.cc:2410] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:49.637321  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.608099  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:49.638168  1594 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:49.610383  6557 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:49.625628  6701 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.632252  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:49.640973  1669 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:49.633435  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:49.633526  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.641317  1675 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:49.633483  5920 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.634302  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.646670  5920 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.649381  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:49.650120  1751 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:49.652988  5920 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:49.615317  1496 rpcz_store.cc:276] 0709 12:59:43.540104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.540280 (+   176us) service_pool.cc:224] Handling call
0709 12:59:49.567488 (+6027208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:49.389794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:49.390504 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:49.390553 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:59:49.390587 (+    34us) tablet.cc:662] Decoding operations
0709 12:59:49.391532 (+   945us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:49.391673 (+   141us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:49.391710 (+    37us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:49.392480 (+   770us) tablet.cc:701] Row locks acquired
0709 12:59:49.392534 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:59:49.407357 (+ 14823us) write_op.cc:270] Start()
0709 12:59:49.407569 (+   212us) write_op.cc:276] Timestamp: P: 1783601989407248 usec, L: 0
0709 12:59:49.407598 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:59:49.476660 (+ 69062us) log.cc:844] Serialized 2835 byte log entry
0709 12:59:49.526468 (+ 49808us) op_driver.cc:464] REPLICATION: finished
0709 12:59:49.530648 (+  4180us) write_op.cc:301] APPLY: starting
0709 12:59:49.530752 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:49.534783 (+  4031us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:49.534884 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:49.538954 (+  4070us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:49.539200 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:59:49.539263 (+    63us) write_op.cc:312] APPLY: finished
0709 12:59:49.539938 (+   675us) log.cc:844] Serialized 73 byte log entry
0709 12:59:49.541004 (+  1066us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.541152 (+   148us) write_op.cc:454] Released schema lock
0709 12:59:49.541221 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:49.575916 (+ 34695us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.575957 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":306313,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":3890,"apply.run_cpu_time_us":9861,"apply.run_wall_time_us":45179,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29302,"num_ops":7,"prepare.queue_time_us":56300,"prepare.run_cpu_time_us":4736,"prepare.run_wall_time_us":93979,"replication_time_us":118659,"thread_start_us":55624,"threads_started":1}]]}
I20260709 12:59:49.671439  1743 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:49.653954  6351 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:49.626103  6641 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.677515  1497 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.679695  1497 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 12, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.681280  1497 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:49.660715  6557 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:49.685000  6641 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.686772  6557 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:49.688743  6715 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.689306  6715 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:49.670053  6322 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:49.670289  6697 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:49.670011  6386 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:49.695148  1497 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.723832  1751 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:49.727344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.724936  1669 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 12:59:49.737360  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 88803.7us
I20260709 12:59:49.738716  1675 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 12:59:49.740337  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:49.744555  1497 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 12, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.691514  6715 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.730270  6723 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.692795  6583 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.709764  6386 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.707082  6322 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.707775  6697 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.770509  1497 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 14, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:59:49.764196  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 126927us
I20260709 12:59:49.755046  6558 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:49.693387  6709 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:49.782382  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.783221  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.775826  1497 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 12, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.784621  6697 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.785228  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 12, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.787671  1497 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.790709  1497 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 14, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.792465  1497 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 8 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.772680  6558 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.798048  6558 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.797402  1497 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 10 to 11, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.777609  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.793231  6322 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.802542  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.803005  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.762940  6723 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.804349  6583 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:49.799378  1497 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 12, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.805691  1669 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:49.813819  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.819149  1594 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:49.820140  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:49.823380  1749 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:49.822613  1497 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 14, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.803610  6745 tablet_replica.cc:333] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 12:59:49.835273  1675 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 12:59:49.843504  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:49.845023  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72335.1us
W20260709 12:59:49.829072  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 84751.3us
I20260709 12:59:49.829408  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.850325  1497 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 10, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.851908  1497 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 14, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.828707  6748 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:49.834714  6583 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:49.876941  6745 raft_consensus.cc:2243] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.859309  6386 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.859613  6697 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:49.881814  6575 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.868618  1497 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 13, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 12:59:49.893028  6751 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:59:49.848266  6557 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:49.860117  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:49.952615  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 92589.9us
I20260709 12:59:49.952913  6557 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.954259  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:49.857673  6750 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:59:49.956316  6750 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:49.956700  6750 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.911587  6697 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:49.957631  6750 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.958336  6697 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.959569  6750 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:49.962167  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:49.962589  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.964682  6701 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:49.915630  6723 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:49.915808  6746 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:49.965191  6701 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:49.965695  6701 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:49.966022  6746 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:49.966487  6746 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.917303  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.967291  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:49.967907  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50698.1us
I20260709 12:59:49.968181  6617 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:49.968916  6617 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:49.969213  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:49.969678  6709 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:49.970206  6709 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:49.924489  6745 raft_consensus.cc:2272] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.971447  6709 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:49.973596  6723 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:49.974447  6745 ts_tablet_manager.cc:1916] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:49.930154  6583 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.935844  6575 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.977748  6723 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.979945  6723 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.939699  1497 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 12, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:49.981113  6617 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:49.984477  6575 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:49.944120  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:49.985450  1675 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:49.966511  6351 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.967379  6746 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:49.923344  6558 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:50.039978  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.041471  1669 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:59:50.049997  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.057505  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:50.061975  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 81112.2us
I20260709 12:59:50.062976  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:50.066098  6723 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.072464  6617 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:50.073160  6557 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.073720  6557 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.074797  6746 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.076189  6557 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:50.087221  1747 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:50.102164  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.123090  1594 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:50.126539  1594 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:50.165004  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:50.165778  1675 raft_consensus.cc:606] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:50.180543  1750 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:59:50.196329  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 141235us
W20260709 12:59:50.200035  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 137118us
I20260709 12:59:50.208474  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.209391  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:50.213994  6748 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:50.231575  6728 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:50.231940  6752 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:50.215804  6641 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:50.241997  6641 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:50.242462  6641 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.215911  6557 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:59:50.250237  6558 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:50.186352  6697 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.254518  6701 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.256472  6322 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:50.257133  6322 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.257661  1749 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:50.259402  6617 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:50.257041  6701 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:50.261060  6748 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:50.261523  6748 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:50.262383  6748 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.264685  6748 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:50.273005  6386 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.273792  6386 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:50.275050  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.254971  6697 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:50.276667  6557 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:50.277362  6557 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:50.279829  6583 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:50.279994  6557 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:50.283811  6583 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.280584  6723 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:50.288563  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76171.1us
I20260709 12:59:50.259444  6322 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:50.304980  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74226.5us
I20260709 12:59:50.303966  6617 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:59:50.305060  6557 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:59:50.318290  6351 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:50.319391  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:50.320382  6351 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:50.322319  6351 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:59:50.317292  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 105099us
I20260709 12:59:50.324055  6386 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:50.324905  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:50.325562  1597 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:50.328792  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:50.330616  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:50.332937  1596 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.345610  1596 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:50.352954  1597 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 12:59:50.357573  1602 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:59:50.383221  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44169.4us
W20260709 12:59:50.382015  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 378648us
W20260709 12:59:50.407588  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69363.9us
I20260709 12:59:50.411835  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:50.425233  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:50.416810  6748 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:59:50.432225  1670 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:50.337478  6641 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.384801  6745 ts_tablet_manager.cc:1929] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:59:50.437961  2310 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:50.421367  6351 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:50.455500  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:50.456363  1676 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:50.456743  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:50.457401  1677 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:50.418707  6557 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:59:50.458032  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:50.461460  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48284.7us
I20260709 12:59:50.461457  5920 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:50.462041  1673 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:50.463614  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:50.431192  6746 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:59:50.469110  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:50.465667  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.472086  1675 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:50.478859  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:50.479581  1749 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:50.465080  6745 log.cc:1199] T 0193c6e20d1c4a33997d268895b8c083 P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/0193c6e20d1c4a33997d268895b8c083
I20260709 12:59:50.459971  6351 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:50.486186  1670 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 12:59:50.511704  5920 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.512389  5920 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.519515  6351 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.521922  5920 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:50.523083  6641 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:50.531348  1670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:50.532229  1670 raft_consensus.cc:606] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:50.532567  1670 raft_consensus.cc:614] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:50.534024  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.534842  1743 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:50.535434  1595 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:50.521973  6351 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:50.536640  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:50.490089  6583 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:50.570282  2313 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Advancing to term 15
I20260709 12:59:50.552781  1599 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:50.582629  1676 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:50.584935  1677 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:50.590581  6752 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:50.594486  2313 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:50.603631  1751 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:50.607721  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:50.608222  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 12:59:50.608695  1677 raft_consensus.cc:606] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:50.609236  1677 raft_consensus.cc:614] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:50.611510  1749 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
W20260709 12:59:50.613382  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 150680us
W20260709 12:59:50.615602  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 203264us
I20260709 12:59:50.619424  1676 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:59:50.612914  6751 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:50.626808  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.628834  1670 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:50.612706  6754 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:50.615060  6715 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:50.637210   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:50.638919  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet 0193c6e20d1c4a33997d268895b8c083 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 12:59:50.641671   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:50.642948  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.646013  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.649441  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.651170  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.653548  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:50.654544  1676 raft_consensus.cc:2368] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14.
I20260709 12:59:50.626324  6752 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:59:50.660184  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:50.661171  1676 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.664731  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:50.672379  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:50.677832  1674 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:50.680411  5920 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.681022  5920 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.683027  5920 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:50.685796  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.687690  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.689821  1751 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:50.693316  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.694612  1751 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:50.700615  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:50.700898  1674 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:50.701814  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.701962  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.702786  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.704264  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.658025  6715 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 12:59:50.710956  6715 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:50.720661  1677 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:50.723815  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:50.724624  1669 raft_consensus.cc:2376] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18. Re-sending same reply.
I20260709 12:59:50.726006  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.744177  1751 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:50.757521  1676 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
W20260709 12:59:50.757648  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 119152us
I20260709 12:59:50.759999  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.770049  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.758621  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.777429  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:50.774958  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.779320  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:50.785254  1594 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:50.781354  1750 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:50.783110  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.784122  1744 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:50.785147  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.798703  1746 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:50.771826  6769 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.797665  6617 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:50.774466  6763 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:50.777951  6583 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:50.811291  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.794673  6575 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:59:50.857447  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46254.5us
I20260709 12:59:50.801808  6386 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:50.869589  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:50.805509  6753 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:50.871974  6575 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:50.870252  6785 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.008s
I20260709 12:59:50.873464  6575 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.848690  6583 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.875622  6583 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:50.875726  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:50.849737  6777 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.842202  6775 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:50.879336  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 126669us
I20260709 12:59:50.847585  6351 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:50.894578  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:50.841683  6641 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:59:50.847316  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:50.879662  6753 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.871995  6322 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:50.815292  6769 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.923041  6775 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.946410  6769 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:50.948364  6781 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:59:50.856478  6763 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.871093  6779 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.933946  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:50.924181  6777 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.919286  6351 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:50.859367  6617 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:50.926501  6322 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:59:50.960449  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 101876us
I20260709 12:59:50.903158  6386 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:50.944243  6778 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:59:50.927224  6753 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:50.976821  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 179091us
I20260709 12:59:50.977923  1595 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:50.980784  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:50.982010  1594 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:50.983032  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:50.986963  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:50.963666  6322 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:50.993474  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:50.958493  6779 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.145882  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:51.175814  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.030880  1669 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [11.5-13.6]
I20260709 12:59:51.038225  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.053094  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.001734  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.206594  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.041119  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.102464  1671 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:59:51.220129  2310 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:51.007467  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 119669us
I20260709 12:59:51.089344  1674 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:51.039072  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.016561  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:51.242779  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 88937.4us
I20260709 12:59:51.260655  1602 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:51.264194  1598 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:51.166708  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.231273  1746 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:51.080084  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:51.029726  6351 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:51.266373  6557 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:51.268312  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.269692  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.270486  1602 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:59:51.270668  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.271003  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.272352  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.165923  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.272496  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.276715  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.278544  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.273703  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.037779  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.176286  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.017138  6763 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.283032  1598 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:51.285933  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.287703  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.215869  6794 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:51.264516  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58004.6us
I20260709 12:59:50.987164  6754 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.302s
I20260709 12:59:51.030995  6617 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.288856  6794 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.289858  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:50.989342  6731 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:51.290762  6731 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:51.291731  6557 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:51.291481  6351 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:51.291217  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.291231  6794 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.293325  6794 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:51.076367  6769 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.294106  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.294509  6769 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.295130  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.295791  1677 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:51.295745  6351 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:51.296020  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.297341  5920 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:51.299074  6617 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:51.300268  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.301205  6351 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:51.293650  1597 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:51.280633  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.295970  6557 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:51.159868  6322 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.303061  6774 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:51.302028  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.306766  6774 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:51.092060  1675 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:59:51.307812  6774 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.193228  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.308429  1601 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:51.309317  6774 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:51.310235  1600 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:51.037048  6777 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:50.988987  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:51.145612  6748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.023s	sys 0.025s
I20260709 12:59:51.164808  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.312738  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.059834  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.302707  6351 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:51.154621  6753 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.316087  6575 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:51.305364  6617 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:59:50.994522  6728 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:51.084712  6386 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.304247  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:51.313426  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48575.8us
W20260709 12:59:51.319119  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54301.5us
I20260709 12:59:51.315817  1598 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:59:51.292284  6779 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.317329  6575 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:51.304157  1752 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:51.305950  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 12:59:51.315879  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 326912us
I20260709 12:59:51.315879  6351 consensus_queue.cc:1243] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:51.332139  6557 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:51.332199  6777 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:51.302378  6794 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:51.333262  6794 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:51.333889  6797 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:51.334239  6794 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.335763  6794 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:51.336427  6777 consensus_queue.cc:1243] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:51.330291  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.331720  1602 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:51.298271  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:51.313274  6748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.030s	sys 0.032s
I20260709 12:59:51.326035  6617 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:51.365296  6617 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:51.366354  6617 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.339946  1601 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:51.320732  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.341686  6698 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:51.342374  6723 raft_consensus.cc:993] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:51.346199  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.356777  1597 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:51.037731  6775 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.318661  6728 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.373204  1672 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:51.140606  6583 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.398721  1600 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:51.399291  1600 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:51.405144  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59045.9us
I20260709 12:59:51.364235  6779 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:51.420030  5920 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.406858  1600 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.420651  5920 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.421420  1600 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:51.383930  6777 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.393025  6617 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:51.390390  6728 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:51.429279  1566 leader_election.cc:400] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14.
I20260709 12:59:51.408324  6723 raft_consensus.cc:1081] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:51.404706  6775 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:51.450114  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.411322  1603 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 8 to 11, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:51.448346  5920 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.454461  5920 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:51.404717  6322 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:51.458514  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52510.5us
I20260709 12:59:51.461375  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:51.474498  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67718.1us
I20260709 12:59:51.475757  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:51.480911  6792 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.481725  6792 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.481632  2315 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 8 to 11, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 12:59:51.483651  6799 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:59:51.483909  6754 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.484364  1671 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:59:51.484500  6754 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.509757  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:51.497766  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.553s (SENT) [suppressed 40 similar messages]
W20260709 12:59:51.514173  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 64206.6us
I20260709 12:59:51.520295  1600 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:59:51.398054  6731 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.452307  6777 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:51.067349  6752 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 8 to 11, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:51.523196  6754 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.546799  6777 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:51.493275  6775 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:51.526343  1600 pending_rounds.cc:85] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 6
I20260709 12:59:51.532905  6774 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:51.534070  6795 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:51.560204  1600 pending_rounds.cc:107] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:59:51.564707  1600 raft_consensus.cc:2889] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.570820  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:51.571949  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:51.572999  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75251.2us
I20260709 12:59:51.574056  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:51.575309  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 112014us
I20260709 12:59:51.499215  6351 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:59:51.581777  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.582682  5920 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.585160  5920 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.582988  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.587209  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.587760  1747 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:51.588299  1743 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 12:59:51.587229  5920 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.591454  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:51.584368  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.593592  1600 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:51.594129  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.595150  1597 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 12:59:51.509938  6641 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:59:51.599099  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:51.600955  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.562165  6774 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:51.609140  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.629832  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.631893  1594 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:51.634045  6820 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:51.634771  6805 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:59:51.636062  6583 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:51.636304  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
W20260709 12:59:51.636656  6815 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:59:51.637073  1600 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:59:51.637496  6806 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:59:51.645308  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.646528  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:51.647670  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.636690  1743 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 8 to 11, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:51.648823  6777 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:51.649463  6777 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:51.650501  6777 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.643311   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:51.653411  6794 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:51.654330  6769 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.548275  6748 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 12:59:51.584255  6763 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:59:51.637537  1600 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:51.509383  6575 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.672026  6820 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:51.674556  1602 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:51.675593  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.677497  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:51.683526  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 161993us
I20260709 12:59:51.704660  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:51.711396  1600 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.712538  1594 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:51.720805  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.724493  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.705036  6761 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:51.683349  6723 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.726608  1751 raft_consensus.cc:1217] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Deduplicated request from leader. Original: 10.4->[11.5-13.6]   Dedup: 13.6->[]
I20260709 12:59:51.730268  1751 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [11.5-13.6]
I20260709 12:59:51.680446  6753 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.733817  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:51.731390  1748 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:59:51.725404  1601 raft_consensus.cc:2376] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12. Re-sending same reply.
I20260709 12:59:51.736093  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.737196  1600 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:51.737998  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:51.740235  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 129039us
W20260709 12:59:51.734683  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 137485us
I20260709 12:59:51.742520  1744 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:51.726699  6794 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:51.750051  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:51.733366  6779 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:51.733599  6820 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.754976  6386 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:51.739055  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:51.868368  6814 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:51.868948  6814 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:51.870055  6821 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:51.872582  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 109875us
I20260709 12:59:51.735797  6723 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:51.880481  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 139158us
W20260709 12:59:51.937500  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64235.1us
W20260709 12:59:51.942194  6778 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260709 12:59:51.976342  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:51.982909  1676 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:51.765753  6351 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.190s
W20260709 12:59:52.078701  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 89785us
I20260709 12:59:52.081301  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:51.937115  6812 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:51.950297  6748 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:51.858456  6617 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 12:59:51.761925  6774 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:51.983062  6715 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:52.138840  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.139968  1603 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:52.147935  6709 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:52.148645  6709 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.150777  6709 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:52.151957  2315 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.004s
I20260709 12:59:52.117966  6748 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:52.172876  6748 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:52.162343  6715 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:52.185071  6728 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.002s
I20260709 12:59:52.185772  6728 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.186966  6715 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.080629  6775 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 12:59:52.216253  6827 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:59:51.882902  6820 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:52.208740  6811 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.519s	user 0.002s	sys 0.000s
W20260709 12:59:52.154330  6779 consensus_queue.cc:1175] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fab19506de7242869c29d70c9fffb739" responder_term: 14 status { last_received { term: 14 index: 7 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [11.5-13.6]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:59:52.261615  6752 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.002s
I20260709 12:59:52.271477  6826 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:52.272336  6826 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:52.274914  6826 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:52.276618  6723 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.280709  6792 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.310932  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:52.311678  1752 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:52.324712  6774 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:52.347187  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.350073  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.350731  6812 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.351809  6812 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.352933  6829 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:52.353600  6829 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:52.354830  6812 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.251434  6820 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.344017  6351 consensus_queue.cc:1243] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 570958eb733a4af7ae16ae020998c8b4 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:59:52.359193  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.355512  6812 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.355938  6829 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:52.389859  6797 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:52.462605  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.468288  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.466221  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.473222  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:52.478472  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:52.479403  6790 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:52.480038  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:52.491926  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.449527  6812 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.505896  6840 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.506610  6840 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.509384  6840 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.511335  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.514979  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.473640  6763 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.477756  6829 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:52.522329  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.005s	sys 0.014s
W20260709 12:59:52.525724  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.005s	sys 0.014s
W20260709 12:59:52.526175  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 785014us
I20260709 12:59:52.528322  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:52.543313  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.512717  6840 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.561183  2315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36896 (request call id 332) took 1070 ms. Trace:
W20260709 12:59:52.519799  6575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.005s	sys 0.014s
W20260709 12:59:52.562497  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.563225  1752 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
W20260709 12:59:52.518934  6731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.013s	sys 0.007s
I20260709 12:59:52.548923  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:52.566047  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:52.561707  2315 rpcz_store.cc:276] 0709 12:59:51.478999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.479154 (+   155us) service_pool.cc:224] Handling call
0709 12:59:51.481244 (+  2090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.481503 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:59:52.152452 (+670949us) log.cc:844] Serialized 14 byte log entry
0709 12:59:52.549119 (+396667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.549173 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:52.549221 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.549307 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.549447 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26982,"raft.queue_time_us":33209,"thread_start_us":368985,"threads_started":1}
I20260709 12:59:52.585884  5920 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:52.586337  5920 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.586848  5920 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:52.550209  6728 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.554100  6697 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:52.568780  6575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.005s	sys 0.014s
I20260709 12:59:52.554426  6820 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.602998  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:52.581650  6775 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.565179  6753 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:59:52.584491  6731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.013s	sys 0.007s
I20260709 12:59:52.616326  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:52.616947  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.585314  6779 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:52.617889  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.622576  1600 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:52.614040  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.625223  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:52.626588  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:52.555258  6763 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.567745  6840 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.564550  6829 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.637458  1670 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:52.651254  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.665237  1601 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:52.668558  6810 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:52.670353  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.651685  6777 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:52.671375  1596 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:52.671783  6557 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:52.651901  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:52.672274  6557 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:52.672593  1750 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:52.673277  6557 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.674698  6557 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.652383  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.653302  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.654281  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:52.678859  1747 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:52.680627  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.649760  6821 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:52.657680  6763 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.659854  5920 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.683722  5920 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.688522  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.660295  6859 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.640079  6779 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.698304  6859 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.699628  1747 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 12:59:52.699110  1750 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:52.700601  6859 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.641638  6826 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:52.654179  6809 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 12:59:52.606663  6322 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:59:52.631291  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.681449  1601 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:52.700223  6779 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.607028  6795 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:52.706066  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:52.708575  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82052.1us
I20260709 12:59:52.618314  6753 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.631052  6820 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.623486  6775 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.642076  6754 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:52.704977  6814 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:52.715692  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 84533.3us
I20260709 12:59:52.717051  1603 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:52.725894  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.745811  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.742827  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.715895  5920 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.751948  5920 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.730705  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.753821  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.775377  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:52.847011  1603 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
W20260709 12:59:52.863966  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 88687.6us
I20260709 12:59:52.864666  5920 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.716547  6809 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:52.868516  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 80058.1us
I20260709 12:59:52.868680  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.870802  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.737707  6840 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.878433  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.879215  1597 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:52.880201  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:52.881546  5920 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:52.882112  5920 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.880776  1597 raft_consensus.cc:2376] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16. Re-sending same reply.
I20260709 12:59:52.871704  1671 raft_consensus.cc:2410] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:59:52.726356  6775 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.717736  6753 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:52.739475  6754 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:52.900776  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.901173  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:52.900825  1676 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:52.901824  1597 raft_consensus.cc:2376] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13. Re-sending same reply.
I20260709 12:59:52.902799  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.890340  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.893657  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.716761  6795 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:52.741406  6814 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:52.774507  6583 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:52.728845  6820 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.740193  6812 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.713511  6863 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:52.911259  1599 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:52.911527  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.913358  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.866146  6847 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:52.775529  6792 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:59:52.900484  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 2530) took 1229 ms (client timeout 1504 ms). Trace:
I20260709 12:59:52.918692  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:52.919075  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.864194  6779 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:52.861227  6641 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 12:59:52.924671  5920 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.925102  6845 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:52.953588  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.925606  6782 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:52.924678  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:52.926898  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.872166  6617 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.938030  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.939272  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:52.947433  6865 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:59:52.944381  1602 rpcz_store.cc:269] 0709 12:59:51.643945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.644993 (+  1048us) service_pool.cc:224] Handling call
0709 12:59:52.873460 (+1228467us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5400038c54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 12:59:52.873575 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65174912}
I20260709 12:59:52.924331  6808 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:59:52.955439  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.930691  6795 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:52.959972  1595 raft_consensus.cc:2376] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16. Re-sending same reply.
I20260709 12:59:52.919425  6775 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:52.967883  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:52.775811  6826 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.161s
I20260709 12:59:52.990265  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.990094  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:52.995342  1672 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:52.999351  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:53.000311  1602 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:53.001170  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.018222  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.019531  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.021982  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.023175  6829 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.023988  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.035586  6754 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.036681  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.958841  6779 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.039062  6779 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.031741  6850 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.039949  6850 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:52.959182  6845 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.042294  6850 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.000770  6775 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.044112  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:52.984143  6617 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.046743  6775 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:53.047770  1597 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:53.049539  6116 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.050275  6116 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.052956  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.054734  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:53.056527  6845 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.047396  6617 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.060006  6116 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:52.966756  6792 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.062134  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2246) took 1987 ms. Trace:
I20260709 12:59:53.062600  1670 rpcz_store.cc:276] 0709 12:59:51.074652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.076559 (+  1907us) service_pool.cc:224] Handling call
0709 12:59:51.076993 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.646674 (+1569681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.061810 (+415136us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400193554. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:53.062038 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3587529600}
I20260709 12:59:52.997854  6789 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:53.080302  6789 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.085048  1599 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:59:53.084903  2310 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:53.020433  1595 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:53.095989  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.098147  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.105805  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:53.071295  6848 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 12:59:53.110806  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.112704  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.117784  1744 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:53.120278  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.121224  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.045477  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.099454  6617 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:53.152192  6697 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.002s
I20260709 12:59:53.151970  6617 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.152801  6697 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.153899  1743 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:53.128202  6789 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.161778  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:53.168599  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.160804  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.144160  1674 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:59:53.188829  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:53.192000  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.197530  1744 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:53.064023  6792 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.163962  6863 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.127574  6557 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.217615  1674 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:53.155428  6617 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.142050  6777 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:53.205879  6831 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:53.151151  6795 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.231868  6831 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:53.233210  6831 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.233546  6795 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:53.239122  1745 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:53.246356  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.247387  1751 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
W20260709 12:59:53.266701  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.226218  6859 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:59:53.278596  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.242354  6753 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.284699  6753 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.288511  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.290117  6789 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.291019  6617 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.291661  6617 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:53.294323  6617 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:53.300154  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:53.301131  1675 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:53.301301  1677 raft_consensus.cc:2368] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14.
I20260709 12:59:53.235800  6777 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.227715  6863 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.306370  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.307003  6863 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.308192  1672 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:53.301617  1675 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:53.230258  6557 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.311514  1675 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.316941  1675 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.317293  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.321556  1594 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 12:59:53.322024  1594 pending_rounds.cc:85] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 12
I20260709 12:59:53.322248  6794 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:53.322690  6794 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:53.323633  6794 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.324416  6557 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:53.324952  6794 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.309013  6777 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:53.326825  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:53.322266  1594 pending_rounds.cc:107] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:59:53.328158  1594 raft_consensus.cc:2889] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:53.329514  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 458) took 1606 ms. Trace:
I20260709 12:59:53.329846  1594 rpcz_store.cc:276] 0709 12:59:51.722646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.722788 (+   142us) service_pool.cc:224] Handling call
0709 12:59:51.723173 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.328600 (+1605427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.329218 (+   618us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400039b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 12:59:53.329415 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3674562944}
I20260709 12:59:53.333606  1675 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:53.340418  6116 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:53.346503  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 12:59:53.357676  6867 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.158s	user 0.000s	sys 0.003s
I20260709 12:59:53.366302  6809 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:53.369974  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.374375  6810 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:53.376556  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.379990  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.380735  1748 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:53.367028  6809 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.381762  6869 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:53.384032  6809 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:53.386686  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.389400  6782 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:53.387883  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.391388  1747 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:53.394681  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:53.398999  6701 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.399856  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.404605  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:53.405555  6845 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:53.406113  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:53.407985  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:53.408833  1677 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:53.375312  6810 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:53.415838  6810 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:53.416738  6810 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:53.417797  6810 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.422135  6782 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:53.426286  6769 raft_consensus.cc:1064] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:59:53.432408  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:53.437404  6872 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.435278  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.442870  6782 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.445269  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.451970  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.454034  6782 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:53.456123  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:53.470726  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 262195us
I20260709 12:59:53.473881  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.485813  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.483491  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:53.502010  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.483491  6782 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.494743  6863 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.506963  6863 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.509542  6863 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:53.495014  6701 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.510627  6782 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:53.511436  6825 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:53.470023  6777 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.512372  6777 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.514555  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:53.482942  6809 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:53.527766  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:53.528786  1600 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:53.514945  6777 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:53.532034  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.517194  6322 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:53.546435  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:53.546778  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 176756us
I20260709 12:59:53.547252  1750 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:53.538969  6769 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.519058  6871 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:53.549081  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.550237  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:53.551790  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:53.561622  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 12:59:53.562456  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.563362  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.565044  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.565246  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.570981  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.572654  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.574129  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.574870  1602 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:53.576715  1745 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:53.586874  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.588912  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:53.590754  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:53.529232  6809 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:53.590380  6871 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:53.600960  6809 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:53.601652  6871 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.576573  6777 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:53.612098  1500 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.620426  1603 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:53.620790  1750 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 12:59:53.621400  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:53.620548  1600 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 12:59:53.579178  6869 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.640558  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 12:59:53.646013  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.646570  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:53.637322  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:53.594444  6814 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:53.594727  6804 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.649257  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:53.654464  6557 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:53.667002  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.673584  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:53.674396  5920 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:53.641676  1600 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:53.674819  5920 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.646066  6831 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:53.595052  6794 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:59:53.632472  6859 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:59:53.671175  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.672216  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:53.638244  6777 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:53.677693  6777 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:53.675333  5920 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:53.682308  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 200) took 5253 ms. Trace:
I20260709 12:59:53.692860  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:53.694993  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:53.700614  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:53.701979  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:53.701561  1500 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:53.708170  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.710219  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.718248  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.722167  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.677047  6831 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:53.680539  6859 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.700316  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:53.748796  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46936.9us
I20260709 12:59:53.666049  6814 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:53.825191  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.696693  6829 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:53.825136  1600 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:53.685389  1497 rpcz_store.cc:276] 0709 12:59:48.429556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.429903 (+   347us) service_pool.cc:224] Handling call
0709 12:59:53.682207 (+5252304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:50.284097 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:50.284760 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:50.284803 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:59:50.284824 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:50.286545 (+  1721us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:50.286616 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:50.286649 (+    33us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:59:50.341371 (+ 54722us) tablet.cc:701] Row locks acquired
0709 12:59:50.341393 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:50.341551 (+   158us) write_op.cc:270] Start()
0709 12:59:50.341678 (+   127us) write_op.cc:276] Timestamp: P: 1783601990341500 usec, L: 0
0709 12:59:50.341702 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:59:50.342691 (+   989us) log.cc:844] Serialized 7187 byte log entry
0709 12:59:50.534179 (+191488us) op_driver.cc:464] REPLICATION: finished
0709 12:59:50.783945 (+249766us) write_op.cc:301] APPLY: starting
0709 12:59:50.787426 (+  3481us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:51.163315 (+375889us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:51.163444 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.083218 (+919774us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.208984 (+125766us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:59:52.231951 (+ 22967us) write_op.cc:312] APPLY: finished
0709 12:59:52.248279 (+ 16328us) log.cc:844] Serialized 164 byte log entry
0709 12:59:52.562831 (+314552us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.589800 (+ 26969us) write_op.cc:454] Released schema lock
0709 12:59:52.602067 (+ 12267us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:52.667079 (+ 65012us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.667124 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"spinlock_wait_cycles":10624,"child_traces":[["op",{"apply.queue_time_us":213387,"apply.run_cpu_time_us":53862,"apply.run_wall_time_us":1853614,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79475,"num_ops":18,"prepare.queue_time_us":200972,"prepare.run_cpu_time_us":6114,"prepare.run_wall_time_us":61692,"replication_time_us":145416,"thread_start_us":498447,"threads_started":3,"wal-append.queue_time_us":410549,"wal-append.run_cpu_time_us":1196,"wal-append.run_wall_time_us":1007053}]]}
I20260709 12:59:53.795200  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet 0193c6e20d1c4a33997d268895b8c083 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:48436
I20260709 12:59:53.796039  6701 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:53.794589  6831 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:53.795018  6859 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:53.902714  5920 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.823714  6753 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:53.927786  5920 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:53.943727  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.906920  6829 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:53.938498  6874 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:59:53.944447  6825 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.669739  6804 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 12:59:53.929585  6753 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:53.964335  6881 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:53.991022  6878 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:59:53.987428  6794 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:53.993279  6885 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:59:54.013114  1500 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 9 to 11, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:54.062170  6897 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:59:54.011754  6887 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 12:59:53.978593  6825 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:54.014333  6889 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
W20260709 12:59:54.117972  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 417700us
I20260709 12:59:54.121301  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.122563  1500 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.131506  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2022) took 1218 ms. Trace:
I20260709 12:59:54.132171  1598 rpcz_store.cc:276] 0709 12:59:52.912778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.064706 (+151928us) service_pool.cc:224] Handling call
0709 12:59:53.086235 (+ 21529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.093240 (+  7005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.093277 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.104485 (+ 11208us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.545767 (+441282us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:53.575988 (+ 30221us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.576226 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.576329 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.131154 (+554825us) raft_consensus.cc:1685] finished
0709 12:59:54.131187 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.131413 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6544,"prepare.queue_time_us":30673,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":7546,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":5419,"spinlock_wait_cycles":16994560,"thread_start_us":381463,"threads_started":1,"wal-append.queue_time_us":548880}
W20260709 12:59:54.138278  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.128940  1500 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.149755  1500 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 11 to 12, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:54.159525  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 370710us
W20260709 12:59:54.169112  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.179141  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.187249  1500 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.191013  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 12:59:54.114698  6891 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:59:54.105119  6890 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:59:54.209097   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:54.174371  6878 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:59:54.234431  6886 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:59:54.235841  6907 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:54.252648  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.253623  5920 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:54.254014  5920 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.254354  5920 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:53.999217  6881 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:54.245151  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.266448  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 12:59:54.257906  6889 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:54.244719  6814 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:54.311218  5920 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.318470  6813 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:54.365116  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.347580  6814 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:54.427879  6814 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.430874  6814 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:54.432238  6904 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 12:59:54.433301  6892 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 12:59:54.434757  6907 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.435669  6907 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.438278  6907 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.384625  6850 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.440202  6850 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:54.385553  6769 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.385793  6925 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:54.386395  6899 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:54.387861  6903 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:59:54.443894  6769 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.366910  6909 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:54.445150  6909 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.447014  6754 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:54.447722  6909 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.388502  6921 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:54.448734  6921 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:54.451288  6921 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.390625  6929 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:54.396168  6900 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:59:54.452128  6929 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:54.454653  6929 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:54.443943  6925 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.455801  6925 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:54.385299  6901 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.458825  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.458765  6901 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.461042  6901 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:54.462642  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.463186  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.463713  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.465713  6925 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:54.468974  6893 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
W20260709 12:59:54.400154  6896 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.421s	user 0.000s	sys 0.004s
W20260709 12:59:54.404350  6898 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:59:54.357649  6795 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:54.485183  6795 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.357028  6804 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.415012  6881 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.416491  6825 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.356120  6829 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.490298  6829 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.424445  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet 0193c6e20d1c4a33997d268895b8c083 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
W20260709 12:59:54.491847  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67427.2us
I20260709 12:59:54.425854  6813 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.496565  6829 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.497159  1675 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:54.497921  6795 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:54.447690  6754 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.498540  1670 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:54.507992  6777 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.830s	user 0.014s	sys 0.000s
I20260709 12:59:54.508527  6777 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:54.509732  1596 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:54.513487  6813 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.513967  6777 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:54.514916  6831 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:59:54.507236  6925 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.515101  6769 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:54.502652  6859 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.000s
I20260709 12:59:54.524659  6829 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.535643  6829 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.538100  6829 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.523583  6753 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.542920  6906 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:54.526398  6859 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.550282  6850 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:54.550549  6859 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.546363  6906 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.517210  6831 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.555063  6906 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:54.558280  6831 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.551748  1595 raft_consensus.cc:2368] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16.
I20260709 12:59:54.566728  6831 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 12:59:54.565686  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 444456us
I20260709 12:59:54.574200  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.567296  6859 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.577773  5920 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.580058  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.582638  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.585826  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.589591  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.569012  6831 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.577764  6859 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.586767  6902 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:54.592602  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:54.586860  6829 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:54.613312  6902 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.656517  6902 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:54.588644  6906 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 12:59:54.645350  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.591385  6901 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:54.593268  6754 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.607822  6794 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:54.652123  6915 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:54.588610  6777 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:54.661859  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 69355.1us
W20260709 12:59:54.671084  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.672081  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.673482  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.674754  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.676251  1673 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:54.681384  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:54.679773  6701 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:54.689453  6701 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:54.689927  6701 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:54.676222  6583 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:59:54.692379  6583 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:54.692723  6583 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:54.693734  6583 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.695102  6583 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:54.695324  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.698529  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.699473  1677 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:54.700523  6859 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:54.702275  6928 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:59:54.702309  1677 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:54.704337  6831 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:54.677016  6915 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.711177  6915 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:54.680678  6921 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:54.725862  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 459471us
I20260709 12:59:54.712008  6930 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:54.699753  6617 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.676084  6863 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:54.716759  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2036) took 1052 ms. Trace:
I20260709 12:59:54.717376  6916 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.722486  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.659600  6906 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.671334  6829 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.729043  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:54.730190  1603 rpcz_store.cc:276] 0709 12:59:53.664871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.790150 (+125279us) service_pool.cc:224] Handling call
0709 12:59:53.790616 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.011808 (+221192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.012058 (+   250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.154868 (+142810us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.346480 (+191612us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:54.353340 (+  6860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.353469 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.716526 (+363057us) raft_consensus.cc:1685] finished
0709 12:59:54.716551 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.716691 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177261,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":6346,"thread_start_us":410705,"threads_started":2,"wal-append.queue_time_us":377287}
I20260709 12:59:54.734638  1678 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:54.730326  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:54.750924  1750 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:54.738245  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:54.690977  6701 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.686480  6826 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:54.753284  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.756332  1750 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:54.756454  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.725203  6901 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:59:54.754679  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:54.760844  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:54.770861  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.754554  6921 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:59:54.806223  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51626.1us
I20260709 12:59:54.817049  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:54.817684  1747 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:54.756276  6769 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:54.819427  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.819965  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:54.820752  1749 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:54.754308  6753 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:54.837229  6753 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:54.811400  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.838109  6753 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:54.831974  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.838814  1745 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:54.815299  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.846246  5920 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:54.847126  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.847530  5920 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:54.847924  5920 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:54.848227  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.849002  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.849558  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.850013  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.850234  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.851025  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.851835  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.850627  1671 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:54.853830  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.854486  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.855703  1602 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:54.849677  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.860808  1596 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:54.863763  1602 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:54.864058  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.867128  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.867502  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.869233  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.869952  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:54.882159  1671 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:54.848773  5920 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:54.873718  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:54.884466  5920 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:54.869240  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:54.885535  1746 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:54.885823  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.870249  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.886091  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.829433  6701 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:54.870868  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:54.888192  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.889806  1600 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:54.890163  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.817374  6617 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:54.844318  6754 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:54.906313  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:54.904488  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.893086  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.893738  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:54.870352  1602 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:54.893949  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.759063  6916 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.916286  6916 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:54.916909  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 80414.7us
I20260709 12:59:54.895257  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:54.895257  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.919185  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.898722  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:54.767635  6826 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.923151  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.903666  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.924450  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.904838  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.925778  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.893922  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:54.926716  1671 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:54.909330  1749 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:54.928130  1744 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:54.913769  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.925462  1670 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:54.869542  6794 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.856985  6930 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:54.929457  1749 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:54.938620  1746 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:54.940672  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.949787  6847 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:54.950325  6847 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:54.950757  6847 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.950839  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.940822  1747 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:54.941942  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:54.942693  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.863306  6782 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:59:54.946081  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:54.947146  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53475.4us
I20260709 12:59:54.954272  1748 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:54.963588  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.957254  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:54.874671  6921 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:54.869241  6777 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:54.874788  6859 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:54.955166  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:54.971145  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.971405  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:54.972195  1600 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 12:59:54.933454  6890 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:54.967520  1746 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:54.977375  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 12:59:54.961098  6922 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 12:59:54.924466  6826 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:54.988750  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:54.954236  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:54.926774  6617 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:54.970693  6910 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:55.005726  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.006371  2316 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:54.888192  6902 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:54.959286  6869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.020s	sys 0.024s
I20260709 12:59:54.999774  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:55.020565  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 111580us
I20260709 12:59:55.025070  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.026065  1669 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:55.028792  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.035637  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.035652  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.036792  6909 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.037395  1749 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:55.038108  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.040985  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.044992  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:54.955096  6794 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.050776  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:54.976022  6859 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:55.051892  6782 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:55.054190  6782 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:55.054668  6782 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:55.055050  6937 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:55.055840  6859 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:54.998699  6808 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:59:54.962164  6930 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:55.059749  6930 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 12:59:55.061049  6938 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 12:59:54.972752  6777 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.055861  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:55.069543  1599 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:55.053572  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.052556  1671 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:54.975730  6921 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 12:59:55.033404  6869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.021s	sys 0.025s
I20260709 12:59:55.072467  6386 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:55.077204  6386 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:55.070500  6909 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:55.078395  6909 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.078783  6909 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:55.052165  6901 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:55.079896  6901 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.037949  6863 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:59:55.080292  6901 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:55.053407  6926 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.084225  6926 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.074188  6859 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:59:55.079711  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.090746  6782 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.086938  6926 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.075610  6617 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:55.093851  6941 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:55.075922  6921 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:55.094376  6913 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.104709  1751 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:55.071189  6831 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:55.096091  6386 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:55.094437  6902 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.103812  6809 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.122551  6795 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:55.124531  6859 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:55.132893  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:55.126101  6831 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:55.125844  6913 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:55.144196  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.131202  6809 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.156479  6386 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.144892  6769 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:55.146059  1600 pending_rounds.cc:85] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 8
I20260709 12:59:55.160596  1600 pending_rounds.cc:107] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:59:55.161016  1600 raft_consensus.cc:2889] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.160643  6831 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.160897  6769 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.161736  6859 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.159485  6386 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.155211  6777 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.131433  6795 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:55.156016  6787 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.146551  6754 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:55.166015  6795 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.166356  6847 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.150583  6731 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:59:55.168588  6794 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.153973  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.170213  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.170727  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.170847  6731 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:55.155509  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:55.156394  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 86948.3us
I20260709 12:59:55.172363  6731 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:55.173328  1715 leader_election.cc:400] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16.
I20260709 12:59:55.173791  1715 leader_election.cc:403] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:59:55.173262  6753 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.176337  6926 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16.
I20260709 12:59:55.176712  6782 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.159787  6809 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.167326  6795 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:55.179790  6701 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.180522  6701 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.167076  6754 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.184684  6701 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.159665  6913 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.186360  6847 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.159529  6869 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:55.187479  6869 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:55.187565  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:55.188516  6869 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.148744  6906 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.189920  6322 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:55.190397  6322 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.190786  6322 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:55.192499  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.164700  6386 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.195173  6794 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:55.195978  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.195894  6794 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:55.195191  6907 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:55.201365  6794 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:55.201632  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.203667  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.204588  1669 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
W20260709 12:59:55.212944  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 162197us
I20260709 12:59:55.237737  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.189926  6869 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:55.240223  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.240727  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.244242  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.244954  1751 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:55.245059  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.214934  6794 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:55.247090  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:55.254083  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.248811  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.250329  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.166061  6787 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.231315  6912 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.251809  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.252050  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.254179  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.258896  1752 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:55.250430  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.261452  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:55.262156  1677 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:55.263917  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.264832  1600 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:55.265461  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.266132  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:55.266211  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.266870  1678 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:55.266958  1600 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:55.268875  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.269119  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.270627  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.271189  1603 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 12:59:55.272364  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.240145  6753 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.274905  1745 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:55.275906  6901 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.284112  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.284327  1678 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 12:59:55.201359  6322 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:55.249637  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.287659  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.300494  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:55.303601  6754 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:55.312599  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.313493  6754 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.314606  6754 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:55.317411  6901 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.272383  6794 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.321173  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.336448  1677 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:55.319696  6871 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:55.341248  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:55.341465  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.345772  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:55.343993  6794 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.344329  1594 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:55.346052  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.286940  6909 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.278638  6912 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:55.319766  6322 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.364025  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:55.357378  6901 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.374105  1678 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:55.375728  6787 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.376232  1673 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:55.345474  6907 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:55.378736  6907 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:55.379305  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.379936  6907 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.381567  6912 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.382130  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:55.378813  6909 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.387290  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.389053  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.390914  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.384045  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.392366  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.393194  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.407678  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.394266  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.404076  1747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 12:59:55.411589  1747 raft_consensus.cc:606] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:55.408748  1675 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 12:59:55.395134  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:55.412708  1671 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:55.395820  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.413894  1672 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:55.396688  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.402770  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.402863  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:55.410359  1752 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:55.415652  1745 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:55.417725  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:55.421833  1597 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:55.422430  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.423060  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:55.424731  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.427076  1748 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:55.427398  6932 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:55.427521  6754 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:55.427947  6932 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:55.427430  6753 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:59:55.404299  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:55.431694  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67740.6us
I20260709 12:59:55.432696  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.438349  1746 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:55.438808  1744 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:55.439721  1671 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:55.439754  1745 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:55.440905  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.441947  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.443454  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 12:59:55.448596  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44368.9us
I20260709 12:59:55.452967  1743 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:59:55.458114  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.473145  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.452905  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.427208  6813 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:55.474831  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.480777  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.486094  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.446439  6901 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:55.450390  6881 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.445705  6909 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.449957  6794 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:55.470077  6930 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.472530  6641 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:55.485208  6754 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.428929  6932 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.509754  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:55.510460  6932 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:55.489976  6925 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.495517  6769 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:55.525342  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:55.526170  1676 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:55.500872  6731 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:55.493844  6795 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:55.538996  6795 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:55.493494  6927 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:59:55.556310  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72807.7us
I20260709 12:59:55.557349  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.504547  6641 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 12:59:55.567234  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.569604  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 12:59:55.580520  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99837.8us
I20260709 12:59:55.583107  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.587054  6809 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:55.587603  6809 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.588042  6809 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:55.588903  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.563825  6901 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:55.550781  6795 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.591706  6777 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.592295  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.593381  6777 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:55.594848  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.596171  6777 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:55.596751  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.579003  6641 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:55.559163  6927 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:55.584287  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.600726  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.590060  6794 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.603886  6948 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:55.603219  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.605906  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:55.609889  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.612811  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.608378  6948 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.619669  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.622004  6916 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:55.623350  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:55.627655  6909 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:55.628259  6927 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.613524  6901 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.602886  6859 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.602389  6826 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:59:55.656504  6826 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:55.656942  6826 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:55.657816  6826 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.659070  6826 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:55.638166  6963 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:55.591064  6831 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:59:55.662385  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:55.663789  1750 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:55.644548  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.646311  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:55.646832  5920 raft_consensus.cc:2764] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:59:55.651342  6863 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:55.638610  6909 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.652179  6777 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:55.639248  6948 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:55.654277  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.686031  1601 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:55.643746  6930 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 12:59:55.654824  1566 leader_election.cc:336] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.663s (SENT)
I20260709 12:59:55.692553  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.655253  6902 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 12:59:55.655366  6701 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:55.675318  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.682610  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:55.679885  6963 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:55.696177  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:55.696813  6902 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:55.698078  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:55.707572  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.707016  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52227us
I20260709 12:59:55.718708  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:55.719435  1601 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:55.685037  6916 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.724103  5920 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.726615  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:55.727322  1597 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:55.692453  6863 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:55.727759  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52535.1us
I20260709 12:59:55.694172  6701 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.722524  6869 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.684757  6909 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:55.728775  6701 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:55.700129  6322 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.699366  6902 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:55.706460  6777 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:55.740738  6777 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:55.742069  6777 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.743515  6777 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:55.705264  6919 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:55.745422  6919 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:55.746681  6919 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.748142  6919 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:55.749754  6948 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.706880  6859 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.761273  1601 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:55.760931  6863 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.699895  6787 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:55.764916  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:55.769155  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.772029  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.766412  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.773869  6116 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:55.778925  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:55.771997  6787 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:55.784034  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:55.785529  6932 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:55.788842  6869 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.789281  6932 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:55.780233  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:55.790302  6932 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.784732  6787 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:55.800565  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.801661  6116 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:55.780522  6809 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.809898  6809 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.781246  6859 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:59:55.810460  1601 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:59:55.787976  6641 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.818063  1750 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:55.788134  6948 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:55.833731  1600 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:59:55.855403  1603 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:55.855701  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:55.858265  1496 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.787825  6927 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:55.860751  1597 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:55.874262  6641 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:55.870857  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:55.886122  6787 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.890081  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:55.903481  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:55.905350  1750 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:55.906023  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:55.907436  1496 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.904273  6948 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:59:56.030104  6948 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:56.030524  6948 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:56.030946  1496 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.028545  6787 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:56.032583  6777 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:56.031461  6948 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:55.936290  6859 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:56.033957  6948 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.034700  6863 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:56.035282  6863 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:56.038477  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 132516us
I20260709 12:59:56.039400  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.041713  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.044759  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d7ba20be4524b828e4259656531c103"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:56.045465  1672 raft_consensus.cc:606] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
W20260709 12:59:56.049265  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 159248us
I20260709 12:59:56.054488  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.063510  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.059265  6859 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:56.071126  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.054890  6777 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:56.059918  6927 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:56.078976  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.061602  6919 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:56.085594  1500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 187) took 11280 ms (client timeout 15000 ms). Trace:
I20260709 12:59:56.063206  6754 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:56.083340  6927 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.099913  6927 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.104393  6863 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:56.077486  6902 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:56.055759  6909 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.083689  6859 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:56.123986  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:56.075439  6963 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:59:56.091641  6831 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:56.075176  6701 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.164485  1594 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:59:56.167402  1751 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:56.086036  1500 rpcz_store.cc:269] 0709 12:59:44.800911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.801572 (+   661us) service_pool.cc:224] Handling call
0709 12:59:56.081052 (+11279480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:54.971934 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:55.057289 (+ 85355us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:55.057336 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:59:55.057358 (+    22us) tablet.cc:662] Decoding operations
0709 12:59:55.058492 (+  1134us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:55.058584 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:55.058611 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:59:55.059432 (+   821us) tablet.cc:701] Row locks acquired
0709 12:59:55.059454 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:55.071358 (+ 11904us) write_op.cc:270] Start()
0709 12:59:55.076755 (+  5397us) write_op.cc:276] Timestamp: P: 1783601995069353 usec, L: 0
0709 12:59:55.076788 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:59:55.077565 (+   777us) log.cc:844] Serialized 3695 byte log entry
0709 12:59:55.551746 (+474181us) op_driver.cc:464] REPLICATION: finished
0709 12:59:55.731904 (+180158us) write_op.cc:301] APPLY: starting
0709 12:59:55.732028 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:55.737067 (+  5039us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:55.737190 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:55.748734 (+ 11544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:55.748978 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:59:55.749021 (+    43us) write_op.cc:312] APPLY: finished
0709 12:59:55.749328 (+   307us) log.cc:844] Serialized 89 byte log entry
0709 12:59:55.751808 (+  2480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:55.751976 (+   168us) write_op.cc:454] Released schema lock
0709 12:59:55.753819 (+  1843us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:55.754296 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:55.754334 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":134446,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":174458,"apply.run_cpu_time_us":12410,"apply.run_wall_time_us":24836,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41801,"num_ops":9,"prepare.queue_time_us":252922,"prepare.run_cpu_time_us":39796,"prepare.run_wall_time_us":310021,"raft.queue_time_us":202933,"raft.run_cpu_time_us":27522,"raft.run_wall_time_us":128564,"replication_time_us":474764,"thread_start_us":460185,"threads_started":4,"wal-append.queue_time_us":213673}]]}
W20260709 12:59:56.165851  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 94814.5us
I20260709 12:59:56.145812  6930 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:59:56.193938  6909 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:56.180567  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:56.202706  1676 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:56.202355  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:56.203452  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 12:59:56.223937  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 136555us
W20260709 12:59:56.232527  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 74134.6us
I20260709 12:59:56.236495  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:56.237419  1670 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:56.238474  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:56.241469  1600 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:56.242559  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.243036  1603 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:59:56.247224  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:56.252065  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:56.254305  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:56.255213  1678 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:56.254487  1597 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:56.251439  6777 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:56.260526  6932 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:56.261044  6932 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:56.262023  6932 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:56.248323  6930 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:59:56.252279  6909 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:56.274221  6701 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:56.275382  1746 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:59:56.275830  1746 pending_rounds.cc:85] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 8
I20260709 12:59:56.276088  1746 pending_rounds.cc:107] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:59:56.276336  1746 raft_consensus.cc:2889] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:56.278342  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.279912  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:56.280973  1751 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:59:56.283257  6932 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:56.288640  6975 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:56.291985  1747 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:56.278859  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:56.299726  1597 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:56.303253  6831 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:56.303833  6831 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:56.304255  6831 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:56.312510  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:56.327111  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:56.345834  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:56.350227  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:56.350670  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:56.353724  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:56.335983  6795 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:56.328763  6787 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:56.358381  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:56.364269  1750 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:56.335913  6975 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:59:56.311049  6731 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:59:56.385633  6731 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:56.385344  6831 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.386044  6731 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:56.392616  6787 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:56.392696  6731 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.393898  6787 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:56.394726  6731 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.397552  6927 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.402758  6831 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:56.404160  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:56.424230  6927 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:56.439320  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:56.444540  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:56.448256  1597 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:56.455561  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:56.457193  1597 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:59:56.460660  1678 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:56.461259  1677 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:59:56.478786  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 146695us
I20260709 12:59:56.496572  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:56.497205  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:56.500613  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:56.501364  1594 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.460074  6948 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:56.504393  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:56.511442  5920 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:56.518673  5920 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:56.465456  6826 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.531257  6963 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:56.531669  6927 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:56.536022  6978 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:56.536717  6978 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:56.531868  6963 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:56.542044  6963 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.542564  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:56.543254  1673 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 12:59:56.545083  6978 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:56.550419  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:56.567946  1603 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 12:59:56.583432  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60238us
I20260709 12:59:56.512213  6976 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.587533  6116 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:56.592162  6116 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:56.598857  1594 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:56.533474  6948 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:56.514063  6975 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:59:56.548695  6826 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.659904  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:56.767534  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 265799us
I20260709 12:59:56.790019  6322 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.663950  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:56.790664  6322 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:56.698122  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 113366us
W20260709 12:59:56.740432  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.697899  1747 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:56.696764  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:56.590355  6927 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 12:59:56.670383  6991 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
W20260709 12:59:56.666000  6964 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.168s	user 0.004s	sys 0.000s
I20260709 12:59:56.811923  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:56.835018  1751 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:59:56.672655  6881 raft_consensus.cc:993] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:56.625233  6116 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:56.818733  6322 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:56.818974  1599 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
W20260709 12:59:56.800716  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 75495.5us
W20260709 12:59:56.674261  6984 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:59:56.599861  6831 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.642225  6787 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.810541  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:56.864892  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54486.6us
I20260709 12:59:56.823835  6987 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:59:56.586738  6641 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.234s
I20260709 12:59:56.877133  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:56.839725  6909 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:56.611667  6976 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:56.825661  6916 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:59:56.870829  6975 raft_consensus.cc:1081] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:56.885025  6933 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:56.934115  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.889504  6994 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:56.870260  6831 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.878079  6787 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.949949  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:56.954787  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.899899  6869 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:59:56.887974  6909 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.868981  6948 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.876408  6927 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:56.936003  6701 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:59:56.993476  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 157314us
I20260709 12:59:56.994387  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:57.003063  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 149381us
I20260709 12:59:56.976761  6933 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:57.018361  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:57.005513  6993 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:57.015503  7003 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:57.029062  6116 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.037043  6933 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:57.044374  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50084.1us
I20260709 12:59:57.023226  7002 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:59:57.026880  7000 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.048002  7009 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.088019  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:57.048174  7003 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:59:57.089821  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 43966.3us
I20260709 12:59:57.051379  6787 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:57.052327  6976 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:57.063086  6975 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:57.096594  7009 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.092043  6831 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.091250  6995 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.068544  6987 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:57.123904  6987 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.126463  6987 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.052922  7000 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.133181  7000 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:57.134449  6975 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.137097  6975 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:57.139227  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.140053  7009 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.143388  6881 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.144178  6881 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:57.145339  7007 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:59:57.146956  6881 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.154699  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.155565  1600 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:57.160156  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:57.161062  1677 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:57.161955  6995 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:57.163233  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.163623  6907 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:57.164052  6907 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:57.165104  6907 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.165159  6988 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:57.166702  6907 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:57.167052  6987 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:57.169477  6987 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:57.170365  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.172500  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:57.168519  1675 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:57.174330  2315 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:59:57.174759  2315 pending_rounds.cc:85] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 10
I20260709 12:59:57.174708  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.175138  2315 pending_rounds.cc:107] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 15.11
I20260709 12:59:57.175427  2315 raft_consensus.cc:2917] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Aborting config change with OpId 15.11: Aborted: Op aborted by new leader
I20260709 12:59:57.175515  1600 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:57.175961  2315 raft_consensus.cc:2889] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:57.173226  2310 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:57.177263  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.178050  1599 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:57.181243  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.182384  6909 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.193789  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.194828  1744 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:57.202021  5920 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:57.210529  6987 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.226730  6987 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:57.212088  7014 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:57.230320  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.198601  6731 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:59:57.208849  6881 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:59:57.238696  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.212925  6996 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:59:57.239723  1747 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 12:59:57.258006  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.262959  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.260195  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.281070  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.283409  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.269083  6948 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:57.270248  6777 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:57.292446  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.294304  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.299413  1673 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 12:59:57.282907  6998 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:57.303596  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.300907  7002 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.306537  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.297024  6777 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:57.308069  6777 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.286275  7012 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:57.305418  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.313076  1672 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:57.288625  6948 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.314024  1675 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:59:57.295883  6933 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:57.317318  1675 pending_rounds.cc:85] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 10
I20260709 12:59:57.317906  1675 pending_rounds.cc:107] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 15.11
I20260709 12:59:57.318362  1675 raft_consensus.cc:2917] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Aborting config change with OpId 15.11: Aborted: Op aborted by new leader
I20260709 12:59:57.318985  1675 raft_consensus.cc:2889] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:57.330364  6322 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.306082  6998 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.312090  6927 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.331287  6322 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.306672  7002 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:57.354753  6909 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.355127  7014 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.319332  6948 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:57.358472  7010 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.307s	user 0.003s	sys 0.000s
W20260709 12:59:57.358914  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.361773  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.319816  6933 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.375342  1715 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 12:59:57.377446  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.312453  7012 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.371201  6998 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:57.397653  6933 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.402680  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:57.405249  6322 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:57.405872  6322 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:59:57.403301  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 201725us
I20260709 12:59:57.398486  7009 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.404125  7012 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.403173  6996 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:57.427088  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.465999  7023 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.466698  7023 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.469035  7023 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.414062  6905 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:59:57.432227  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.440809  7009 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:57.442162  7017 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:59:57.446583  6963 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.394311  6909 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.398090  7014 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.504848  1599 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:57.505394  7014 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.456411  6987 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.506011  7015 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:59:57.506182  6987 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.506847  6909 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.457096  7002 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:57.390587  6927 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.511878  6927 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:57.512729  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.517020  6987 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.517371  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.478932  6777 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.491403  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:57.499863  5920 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:57.488737  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 54314.8us
I20260709 12:59:57.518123  1746 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:57.530167  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.532739  5920 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:57.533346  5920 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 12:59:57.500551  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 85873.1us
I20260709 12:59:57.537889  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.543449  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:57.549028  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.549814  1601 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 12:59:57.544217  1675 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:57.517140  7009 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.554622  1594 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:57.564502  5920 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.567307  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:57.554512  6909 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:57.584785  5920 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:57.587388  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:57.590835  1673 raft_consensus.cc:606] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:57.591302  1673 raft_consensus.cc:614] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:57.555426  6869 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.596868  1594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d7ba20be4524b828e4259656531c103"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:57.597589  1594 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.597982  1594 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:57.610167  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.621737  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.581105  6701 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:57.633221  1599 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:57.635852  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.592926  6909 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:57.688073  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.688987  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:57.583362  6916 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:59:57.635437  6701 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.704049  6948 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.709074  7012 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.620090  7009 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:59:57.716173  7024 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:59:57.728436  6881 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:57.729501  1603 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:59:57.608044  6869 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.706622  6948 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.693042  6909 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:57.733317  6701 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.669940  6992 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:59:57.745931  6826 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:57.738304  7022 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:59:57.711455  7012 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:57.692551  6998 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.693257  6933 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:57.737543  6881 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.757107  6988 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:57.756002  6777 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.769963  6988 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:57.781108  6998 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:57.783051  7027 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
W20260709 12:59:57.783706  7029 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.204s	user 0.001s	sys 0.003s
I20260709 12:59:57.849623  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 100) took 7430 ms. Trace:
W20260709 12:59:57.855983  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 231634us
I20260709 12:59:57.869709  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.873531  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.875800  1750 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:57.850546  1496 rpcz_store.cc:276] 0709 12:59:50.418573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.424661 (+  6088us) service_pool.cc:224] Handling call
0709 12:59:50.724028 (+299367us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 12:59:57.849267 (+7125239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:56.224483 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:56.225133 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:56.225172 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:59:56.225191 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:56.225813 (+   622us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:56.225900 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:56.225931 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:56.226301 (+   370us) tablet.cc:701] Row locks acquired
0709 12:59:56.226320 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:56.226495 (+   175us) write_op.cc:270] Start()
0709 12:59:56.226637 (+   142us) write_op.cc:276] Timestamp: P: 1783601996226433 usec, L: 0
0709 12:59:56.226663 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:59:56.255262 (+ 28599us) log.cc:844] Serialized 1302 byte log entry
0709 12:59:56.312671 (+ 57409us) op_driver.cc:464] REPLICATION: finished
0709 12:59:56.600841 (+288170us) write_op.cc:301] APPLY: starting
0709 12:59:56.608122 (+  7281us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:56.644233 (+ 36111us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:56.644361 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:56.646364 (+  2003us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:56.646594 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:59:56.646653 (+    59us) write_op.cc:312] APPLY: finished
0709 12:59:56.646940 (+   287us) log.cc:844] Serialized 41 byte log entry
0709 12:59:56.795809 (+148869us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:56.812661 (+ 16852us) write_op.cc:454] Released schema lock
0709 12:59:56.823292 (+ 10631us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:56.856012 (+ 32720us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:56.861058 (+  5046us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":120091,"reported_tablets":12,"spinlock_wait_cycles":275327872,"child_traces":[["op",{"apply.queue_time_us":252540,"apply.run_cpu_time_us":7083,"apply.run_wall_time_us":246220,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":183966,"prepare.run_cpu_time_us":3891,"prepare.run_wall_time_us":41259,"replication_time_us":85842,"thread_start_us":269116,"threads_started":2}]]}
I20260709 12:59:57.897794  6869 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:57.897068  6988 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:57.907120  6933 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:57.929678  1746 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:57.918248  6881 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:57.952289  6988 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:57.960274  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 85293.9us
I20260709 12:59:57.961691  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:57.963673  7035 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:57.964710  7035 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:57.980444  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 117239us
I20260709 12:59:57.992133  7002 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.991870  1500 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 8 to 11, term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to <none>, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 12:59:57.993373  7002 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.015743  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:58.023142  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.025626  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.027405  1670 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:58.040146  1743 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:59:58.041445  6777 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.042311  6777 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 12:59:58.044515  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.045578  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:57.984536  7035 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.047434  6987 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.051229  6987 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.053419  1500 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.058099  7023 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.061347  6777 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.058951  7023 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.066315  7023 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.066387  1672 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:58.066992  1599 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.995484  1594 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.082290  6777 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.082742  1597 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:58.083143  6777 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.086076  6777 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.087221  1500 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.089213  6826 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.090174  6826 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.083027  7002 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.095865  6987 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.089632  1500 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 14, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:58.128804  1500 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 14, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.138041  1594 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.140405  6994 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.141264  6994 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.143865  6994 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.131024  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 18, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.123586  1670 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:58.095422  6826 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.145154  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:58.152978  1750 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:58.155997  1599 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:58.163169  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.164587  1672 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 12:59:58.169974  1745 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:58.172294  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:58.173393  1743 raft_consensus.cc:2368] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 12:59:58.174456  6826 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.175361  6826 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.176739  6701 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.178177  1744 raft_consensus.cc:2368] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14.
I20260709 12:59:58.178902  6826 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.182318  6701 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.187505  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.189963  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 12:59:58.190726  2310 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:58.190757  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.190676  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.196023  1599 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:58.196453  1670 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:58.196543  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:58.195950  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:58.197484  1597 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:58.197815  1594 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:58.195600  1676 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:58.195497  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.201776  1596 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:58.206485  2310 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 12:59:58.207233  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 95092us
I20260709 12:59:58.210305  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:58.211151  1745 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:58.211690  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.212002  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.212634  1744 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:58.216928  6987 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:58.218281  6881 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:58.218741  6881 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:58.220041  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.220868  1676 raft_consensus.cc:2368] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 12:59:58.222084  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.218161  6987 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:58.239256  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.239851  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.239135  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.250492  6777 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:59:58.268611  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:58.268573  6963 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.016s
I20260709 12:59:58.270612  6988 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:58.271111  6988 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:58.276868  1597 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:58.278420  1670 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 12:59:58.222078  6881 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.288865  1745 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:58.291165  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.292153  1676 raft_consensus.cc:2368] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 12:59:58.292624  6881 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:58.293246  6988 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.294840  6988 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:58.300388  1566 leader_election.cc:400] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 12:59:58.300877  1566 leader_election.cc:403] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.301776  6948 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 12:59:58.302103  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.303058  6948 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:58.309027  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.309635  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.305312  6948 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.310513  6948 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:58.310527  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.311053  6777 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.311380  1678 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:58.311812  6777 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.312974  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.314420  6777 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.315639  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.308441  1500 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.317691  1500 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 14, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.318717  1676 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:58.318687  7002 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.319517  1500 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:58.320459  7002 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.321455  7033 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.322124  7033 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:58.323153  6909 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.009s
I20260709 12:59:58.323313  7011 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.323737  6909 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.324101  7011 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.325227  7002 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.327484  7002 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.328694  7033 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.329308  7002 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.331020  1678 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:58.332690  7002 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.327533  7011 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.339591  1601 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:58.340821  6909 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.341696  6909 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.355319  1500 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.356926  1671 raft_consensus.cc:2410] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:59:58.357318  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.357470  1500 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:58.358198  1601 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:58.342298  6909 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.362514  6948 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.366266  6933 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.366649  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.367152  6933 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.369792  6933 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.370966  6909 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.372532  6826 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.373282  6826 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.376129  6826 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.383250  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.387650  6948 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.398578  6809 raft_consensus.cc:1064] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 12:59:58.408685  6933 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.409471  6933 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.398380  6881 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.394570  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 12:59:58.416126  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.417342  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.417518  6909 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:58.418112  1748 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:58.418198  6322 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.418515  6909 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 12:59:58.419380  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.419910  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.417236  6933 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.419854  6909 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.420867  1743 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 12:59:58.421741  1745 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:58.420140  1746 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:58.411055  6809 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:58.424034  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.427045  6826 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:58.418905  6322 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.428181  6826 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.431777  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.434609  1597 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:58.435142  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:58.433528  6322 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.448061  1500 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 12:59:58.450531  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.433528  6826 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:58.453464  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 12:59:58.456800  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.428331  6881 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.459277  1500 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 19, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.462225  6881 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.468446  1566 leader_election.cc:400] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 12:59:58.470820  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.477279  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.479050  7002 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:58.480427  7011 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:58.480446  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.489457  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:58.491258  7002 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.494302  6988 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.495111  6988 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.495728  6777 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.496363  6777 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.498387  6777 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.498267  6988 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:58.499682  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.502796  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.508035  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.502193  1566 leader_election.cc:400] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
W20260709 12:59:58.514961  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.516213  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.519584  6988 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:58.520785  6948 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:58.501339  1672 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 12:59:58.530431  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.535293  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:58.540426  1751 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:59:58.544162  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 149776us
I20260709 12:59:58.542686  7011 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:58.562912  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.563925  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.581645  6322 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:58.582324  6322 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:58.587563  6322 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.590832  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.593150  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:58.594517  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.596849  6881 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:58.596851  6988 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:58.604396  6993 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:59:58.615501  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.624491  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.628562  1751 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:58.631095  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:58.632849  6993 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:58.634331  1751 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:58.636310  6881 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:58.640908  6881 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.641315  6881 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:58.651846  7011 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.652733  7011 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.654469  6909 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.655640  7011 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:58.656139  7049 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
I20260709 12:59:58.655226  6909 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:58.635275  6993 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:58.658437  6993 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:58.660375  1641 leader_election.cc:400] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14.
I20260709 12:59:58.661753  6988 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 12:59:58.662489  6988 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.663658  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.664779  6988 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.667474  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.667934  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:58.660787  1641 leader_election.cc:403] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.669318  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.670780  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.666846  6909 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:58.671599  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.675520  6948 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:58.677671  6777 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:58.687791  1751 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:58.674316  7011 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:58.725466  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.702696  6777 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.700839  6948 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.718354  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.701678  6988 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:59:58.711506  7011 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.702409  6881 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.733129  6777 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:58.734740  6948 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:58.755100  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:58.740072  7011 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:58.762285  7033 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:58.782441  7054 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.783138  6881 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:58.784607  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.783612  7054 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.795362  7056 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.791718  6826 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.816174  6826 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:58.788921  7033 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 12:59:58.847333  7053 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:59:58.823455  7054 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:58.859831  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 112862us
I20260709 12:59:58.879101  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.880719  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.881915  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.880142  1744 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:58.838642  7056 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.885171  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:58.864053  7054 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.885200  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:58.887362  1745 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 12:59:58.888886  7033 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.894945  7054 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.897400  7054 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.898195  7054 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.898747  7054 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.929805  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.865010  6777 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.930934  1599 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:58.940024  7065 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:58.940907  7065 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:58.954727  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:58.956050  1601 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 12:59:58.963726  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.971786  7066 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.972960  7066 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.976289  7070 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.977274  7070 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.981300  7056 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.984956  6948 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.989651  7011 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:58.990419  7058 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:58.990926  1597 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:58.991686  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.991993  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.992668  1672 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:58.992748  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.992914  7011 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:58.993049  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.993691  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.994357  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.994940  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.995955  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:58.996654  1674 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:59.001060  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 12:59:59.004788  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 293063us
I20260709 12:59:59.006233  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:58.991087  7058 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.007308  1670 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 4.
I20260709 12:59:59.008816  7058 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.009023  7065 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 12:59:59.011047  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.011427  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.016639  1674 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 12:59:59.019208  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.022056  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.022524  7070 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.025121  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.025950  1677 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:59.026021  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.033340  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.036497  7066 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.037091  7056 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:59.038687  7054 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.039065  6777 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.027259  7058 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:59.055976  7055 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.056769  7055 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:59.058214  6948 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.044569  6988 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14.
I20260709 12:59:59.049983  6881 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:59.060173  7055 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:59.060074  7058 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:59.068022  7058 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:59.069224  7058 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 12:59:59.073551  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 186417us
I20260709 12:59:59.070928  7058 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:59.076510  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.080947  6881 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.081650  6881 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.079263  7054 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:59.049227  1670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:59.083925  6881 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.083284  1670 raft_consensus.cc:606] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.080356  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.085347  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.088006  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.090077  7055 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:59.090914  7055 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.091794  7055 raft_consensus.cc:993] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:59.092320  7055 raft_consensus.cc:1081] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:59.098899  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.101234  7057 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:59.102439  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.102733  7057 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.103386  7057 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:59.103839  7063 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:59.104497  7063 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.104831  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.105691  7056 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:59.106115  7056 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.106513  7056 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.106980  7063 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.101673  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.102051  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.108114  1677 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 12:59:59.108398  1670 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 12:59:59.099040  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.112767  6963 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:59.114178  6987 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:59.114569  6987 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:59.111755  6881 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:59.132294  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.134469  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.135643  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.135419  1747 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 12:59:59.136050  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.137859  1601 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 12:59:59.137897  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.123704  1748 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:59.139351  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.137131  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.140815  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.118795  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.144395  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.146416  1599 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 12:59:59.148948  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.150100  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.150926  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.157823  1669 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.157912  6987 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.160962  6987 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:59.163781  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 66353.4us
I20260709 12:59:59.167613  1670 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 12:59:59.168283  1670 pending_rounds.cc:85] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 4
I20260709 12:59:59.162662  7063 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:59.180469  1599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:59.181344  1599 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.181861  1599 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:59.189574  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.180910  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.194979  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.196575  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.168612  1670 pending_rounds.cc:107] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 12:59:59.199452  1670 raft_consensus.cc:2889] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:59.203426  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.179075  7056 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.209756  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 12:59:59.212224  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45836.1us
I20260709 12:59:59.137168  7057 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.213197  7075 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:59.213449  6948 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:59.214773  7057 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.218091  7056 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.218483  6933 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:59.220489  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.221567  6933 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:59.224128  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:59.224455  7056 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.224978  7056 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.227739  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.235733  7056 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.238404  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.239806  7063 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.238515  6881 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.204455  7054 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:59.241104  7054 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:59.241519  7054 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.240681  1677 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.242110  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 12:59:59.240653  6881 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.243909  1599 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.245095  7057 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:59:59.249913  1673 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:59.254066  1599 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.254833  7074 raft_consensus.cc:2764] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:59:59.256556  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.267921  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.250545  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.280978  6988 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:59.282070  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.283412  7084 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:59.274215  7063 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:59.276232  7075 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:59.293229  7075 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.293913  7075 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:59.297284  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.301352  7054 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.304039  7054 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 12:59:59.314386  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46571.5us
I20260709 12:59:59.320205  7054 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.337349  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 12:59:59.278465  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50832.2us
I20260709 12:59:59.319762  1671 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 12:59:59.348251  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.346969  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.348251  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.351244  1746 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 12:59:59.339118  7066 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:59.355487  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.357926  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.359664  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.360749  1744 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:59:59.357808  7075 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.363945  2309 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.365208  7075 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.366639  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.367389  1599 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.370828  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.371917  1752 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:59.371893  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.372953  1750 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 12:59:59.374966  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.375134  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.375871  1597 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 12:59:59.376278  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.375873  1749 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:59.377987  7075 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.354750  7066 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.378621  7075 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 12:59:59.379438  7066 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.381143  7075 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 12:59:59.383658  1597 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:59.385012  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.387131  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.390133  1744 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.390443  1603 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:59:59.395390  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:59.397927  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.398309  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:59.398671  1601 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 12:59:59.400568  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.404664  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.404932  1749 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 12:59:59.396394  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.409236  1744 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:59.413343  1599 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:59.413846  1603 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:59.413764  1601 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:59.417599  1675 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:59.416662  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.426146  6881 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.432909  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.436457  6881 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.438946  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.439931  1675 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:59.443956  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.445101  6927 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:59.445590  6927 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.445947  6927 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.447311  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.449422  1673 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:59:59.438946  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.451682  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.453843  1673 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 12:59:59.455319  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.455960  1673 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:59:59.456148  1678 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 12:59:59.456261  1673 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:59.465354  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.407793  6826 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:59.457674  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:59.468451  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.470072  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.470785  1675 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:59.472047  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.468683  1673 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.474116  1673 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:59.461954  6976 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:59:59.474606  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 12:59:59.471242  6987 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:59.467991  6826 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:59.479688  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.476406  7074 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:59.492691  1678 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:59.456748  6994 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:59:59.496713  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.494722  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.498154  2309 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.501132  1671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:59.464862  6993 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:59:59.496765  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.505015  1673 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 12:59:59.501885  1671 raft_consensus.cc:606] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.493928  6826 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:59.507174  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 12:59:59.490640  6701 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:59.507874  7056 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:59.502089  6881 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.514905  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.524402  7075 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.525036  7075 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.530702  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.531638  6987 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:59.532110  6987 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.532455  6987 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:59.517412  6701 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:59.531667  1597 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:59.514660  7056 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.541572  1601 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 12:59:59.516548  6963 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:59.540164  7056 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:59.527339  7075 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.553754  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.562126  1601 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.558563  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.560909  7075 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 12:59:59.566211  7075 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.571727  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.572698  1594 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 12:59:59.575731  1596 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.575814  7075 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.578397  1596 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:59.595918  1597 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:59:59.598549  1596 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 12:59:59.581404  6963 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:59.555588  6701 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.610786  1752 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 12:59:59.610651  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.603212  7074 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:59.608039  6963 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:59.614147  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.620586  1595 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.597383  6927 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.626000  7074 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.634007  1597 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:59.660568  6933 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:59:59.670576  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 12:59:59.627135  6963 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.681252  6927 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:59.624361  7066 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.733800  1676 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 12:59:59.735906  1496 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 13 to 16, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 12:59:59.744135  7058 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:59:59.715305  6933 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:59:59.750816  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 12:59:59.754276  6826 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.755578  1743 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.755832  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 12:59:59.756507  1669 raft_consensus.cc:606] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.756880  1669 raft_consensus.cc:614] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:59.757856  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.758414  1669 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.760651  7058 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:59.761143  7058 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:59.762066  7058 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.764021  7055 raft_consensus.cc:993] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:59.764577  7055 raft_consensus.cc:1081] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 12:59:59.764035  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 12:59:59.768842  1752 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:59.772678  1595 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 12:59:59.774410  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.778015  7090 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:59.779908  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.794675  1743 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 12:59:59.691109  6987 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.799731  1670 raft_consensus.cc:2368] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
W20260709 12:59:59.805981  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71801.9us
I20260709 12:59:59.804513  1496 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.810362  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 201) took 3364 ms. Trace:
I20260709 12:59:59.806857  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 12:59:59.812052  1674 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 12:59:59.805297  7058 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.815182  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.798595  7088 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 12:59:59.819439  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52534us
I20260709 12:59:59.830674   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:59.808339  7063 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:59:59.809727  7056 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.842957  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.846907  1601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 12:59:59.810906  1500 rpcz_store.cc:276] 0709 12:59:56.445464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.445600 (+   136us) service_pool.cc:224] Handling call
0709 12:59:59.810249 (+3364649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:58.854127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:58.855100 (+   973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:58.855159 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:59:58.855170 (+    11us) tablet.cc:662] Decoding operations
0709 12:59:58.856624 (+  1454us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:58.856723 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:58.856759 (+    36us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:59:58.858082 (+  1323us) tablet.cc:701] Row locks acquired
0709 12:59:58.858137 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:59:58.858363 (+   226us) write_op.cc:270] Start()
0709 12:59:58.858537 (+   174us) write_op.cc:276] Timestamp: P: 1783601998858287 usec, L: 0
0709 12:59:58.858577 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:59:58.869999 (+ 11422us) log.cc:844] Serialized 5610 byte log entry
0709 12:59:59.260315 (+390316us) op_driver.cc:464] REPLICATION: finished
0709 12:59:59.363599 (+103284us) write_op.cc:301] APPLY: starting
0709 12:59:59.363726 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:59.393053 (+ 29327us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:59.393183 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:59.674929 (+281746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:59.676444 (+  1515us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:59:59.676585 (+   141us) write_op.cc:312] APPLY: finished
0709 12:59:59.677031 (+   446us) log.cc:844] Serialized 129 byte log entry
0709 12:59:59.681146 (+  4115us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.681337 (+   191us) write_op.cc:454] Released schema lock
0709 12:59:59.681413 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:59.746233 (+ 64820us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.746270 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":588,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":99002,"apply.run_cpu_time_us":26100,"apply.run_wall_time_us":352315,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":178150,"prepare.run_cpu_time_us":79233,"prepare.run_wall_time_us":196195,"raft.queue_time_us":199411,"raft.run_cpu_time_us":31724,"raft.run_wall_time_us":85222,"replication_time_us":401518,"thread_start_us":399687,"threads_started":4,"wal-append.queue_time_us":160585}]]}
I20260709 12:59:59.849786   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:59.847631  1601 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.855515  1601 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:59.857174  7066 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 12:59:59.845016  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.823581  6963 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:59.867056  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.842099  6881 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.869556  1672 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:59.866653  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 12:59:59.818967  7084 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:59:59.846241  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 12:59:59.866773  1670 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:59.868278  1595 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.878101  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.845764  1675 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 12:59:59.881003  1673 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:59:59.863092  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53368.6us
I20260709 12:59:59.883369  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.887841  1595 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 12:59:59.884373  6976 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:59:59.888652  7054 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:59:59.896620  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.908838  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 12:59:59.924836  1595 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:59.927901  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44640.8us
I20260709 12:59:59.875314  7096 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:59.935477  1595 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
W20260709 12:59:59.922230  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44232.4us
I20260709 12:59:59.916373  1601 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.939863  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 12:59:59.951676  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.874636  6881 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 12:59:59.903393  6826 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 12:59:59.872308  6963 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 12:59:59.874902  6933 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:59.934254  7089 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:59.938759  7096 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 12:59:59.958837  7090 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:59.974977  7055 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:59.978024  7082 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:59.959491  7098 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:59.974588  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.999208  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 12:59:59.997673  7098 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 12:59:59.996511  7055 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:00.001627  7098 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:00.002351  7055 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:00.005003  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 65225.6us
I20260709 13:00:00.005152  1601 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.008805  6826 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:59.936306  1669 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:00.020205  7058 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:00.020907  7058 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.023217  7058 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.006464  6994 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:00.004196  7082 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:00.010677  7090 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:00.036294  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:00.066947  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 142091us
W20260709 13:00:00.064455  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 132417us
I20260709 13:00:00.069252  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:00.074925  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:00.060424  7056 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.082383  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:00.100762  1743 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:00.082928  7099 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:00:00.108599  7065 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.034184  7096 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.124939  7096 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:00.069412  7088 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:00:00.117493  1743 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 13:00:00.100122  6881 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.076800  7090 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:00.134209  6927 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:00.136157  6976 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:00.136653  6976 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:00.068634  6963 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:00.141373  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72221.7us
W20260709 13:00:00.161245  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 140050us
I20260709 13:00:00.185772  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:00.181730  7102 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.179497  6987 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.192020  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:00.193965  7063 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:00.187605  6993 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:00.148334  6976 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.160905  7054 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:00.202370  1595 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:00.202926  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:00.206419  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:00.228982  1601 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:00.207135  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:00.214923  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:00.229883  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:00.192023  7105 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:00.229918  1751 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:00.199532  1566 leader_election.cc:400] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 13:00:00.236091  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:00.236613  1566 leader_election.cc:403] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:00:00.205101  6994 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:00.225055  7063 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:00.236189  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 126891us
I20260709 13:00:00.224534  6993 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:00.158980  7098 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.250656  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:00.249145  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49841.2us
I20260709 13:00:00.109254  7082 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.261049  7098 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.262456  7063 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.264248  7063 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:00.264279  7106 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:00:00.266920  7069 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:00:00.255208  7103 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:00.255417  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.236784  7054 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:00.282397  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:00.274479  6988 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:00.283209  6988 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:00.283967  7104 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:00.284228  6988 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.285840  6988 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.285419  7098 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:00.276988  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:00.270553  7103 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.271268  7075 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12.
I20260709 13:00:00.226600  7102 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:00.290391  7058 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:00.296322  7103 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.296660  7105 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:00.311232  7075 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:00.312769  7074 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:00.336844  6927 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 8 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:00.339895  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.354439  7075 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:00.355665  7075 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.314894  6993 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.365667  6993 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:00.360733  7074 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:00.381373  7109 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:00.381193  7074 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.382007  7109 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:00.384505  7109 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.386541  7109 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.344094  7054 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:00.397591  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 110349us
I20260709 13:00:00.402581  6976 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:00.362238  7063 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:00.414211  1751 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:00:00.419605  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.422255  1597 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:00.411761  7063 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:00.428356  7113 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.143s	user 0.001s	sys 0.003s
I20260709 13:00:00.430238  7063 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:00.432308  7112 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:00.443248  1747 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:00.456380  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:00.455533  7102 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:00.455777  7082 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:00:00.421118  7105 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:00.460991  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 167372us
I20260709 13:00:00.462881  7084 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:00:00.462757  7119 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:00.484202  7119 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:00.485302  7119 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.491201  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:00.491686  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 218123us
W20260709 13:00:00.502115  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.501874  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 187119us
I20260709 13:00:00.506139  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.512766  7123 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:00.536006  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.540146  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.546078  7102 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:00.588909  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.593230  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.549095  7054 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:00.592988  2310 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 8 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:00.617100  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.597419  7123 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:00.624585  1601 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:00.625241  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.628786  1601 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:00.629670  1599 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 13:00:00.630373  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:00.631040  1595 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:00.637724  1751 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:00.638924  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:00.603036  7102 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:00.663749  1595 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:00.674396  7121 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:00.676890  1599 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:00:00.682328  1601 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:00.641767  7098 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.726397  1595 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:00.728819  7105 raft_consensus.cc:476] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:00.639364  7054 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:00:00.739678  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 122059us
I20260709 13:00:00.673229  7103 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.640843  7119 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:00:00.745769  7103 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.727583  7106 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:00.761246  7056 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:00.761834  7106 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:00.753006  7130 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:00:00.765763  7106 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:00.770853  1751 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:00.775810  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:00.776458  1751 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.782212  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:00.784534  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:00.780393  7075 raft_consensus.cc:2764] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:00:00.788033  1676 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:00.792407  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:00.813243  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.822002  1751 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:00.823736  1595 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:00.824337  1674 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 8 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:00.823948  7098 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:00.894912  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 278936us
I20260709 13:00:00.873286  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:00.895740  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:00.906454  1751 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:00.871475  7090 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.872553  7088 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:00.854175  7105 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:00:00.878194  7137 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:00.878315  6993 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:00.878901  7127 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:00.882881  7096 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:00:00.934576  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:00.911837  7121 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:00.882603  6701 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:00:00.930235  7127 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.901335  6994 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:00:00.942360  7098 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:00.938273  6993 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.945729  7075 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:00.916955  7123 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:00:00.952217  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:00.924077  7137 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.914472  7088 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:00.918357  7090 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:00.962633  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:00.964792  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:00.992621  1752 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:00.992023  1747 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.982903  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 101) took 2765 ms. Trace:
I20260709 13:00:00.890147   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:00.999744  1744 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:00:00.992043  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70017.3us
I20260709 13:00:00.982221  6963 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.994711  1496 rpcz_store.cc:276] 0709 12:59:58.217975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.219679 (+  1704us) service_pool.cc:224] Handling call
0709 13:00:00.982820 (+2763141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:00.135281 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:00.135961 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:00.135998 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:00:00.136017 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:00.136471 (+   454us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:00.136571 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:00.136600 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:00.136946 (+   346us) tablet.cc:701] Row locks acquired
0709 13:00:00.136965 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:00.137132 (+   167us) write_op.cc:270] Start()
0709 13:00:00.137268 (+   136us) write_op.cc:276] Timestamp: P: 1783602000137071 usec, L: 0
0709 13:00:00.137297 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:00.191141 (+ 53844us) log.cc:844] Serialized 978 byte log entry
0709 13:00:00.403623 (+212482us) op_driver.cc:464] REPLICATION: finished
0709 13:00:00.525635 (+122012us) write_op.cc:301] APPLY: starting
0709 13:00:00.531417 (+  5782us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:00.686086 (+154669us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:00.686209 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:00.687948 (+  1739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:00.688168 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:00:00.688240 (+    72us) write_op.cc:312] APPLY: finished
0709 13:00:00.688541 (+   301us) log.cc:844] Serialized 33 byte log entry
0709 13:00:00.688779 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:00.688898 (+   119us) write_op.cc:454] Released schema lock
0709 13:00:00.688953 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:00.689466 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:00.689502 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31408,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":108816,"apply.run_cpu_time_us":7439,"apply.run_wall_time_us":173318,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":274887,"prepare.run_cpu_time_us":3847,"prepare.run_wall_time_us":89085,"replication_time_us":266097,"thread_start_us":262481,"threads_started":2}]]}
I20260709 13:00:00.989087  7121 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:00.991983  7119 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:00.989639  7056 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:01.011096  7089 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:00:01.036908  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74622.2us
I20260709 13:00:01.045944  1715 leader_election.cc:400] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:00:01.046353  1715 leader_election.cc:403] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:00:01.050051  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51986.5us
I20260709 13:00:00.996361  7075 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.062776  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:01.064015  1747 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:01.013873  6963 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.053527  7114 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.053179  6701 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:00:01.031529  7119 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.035722  7056 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.068778  7084 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.048673  7089 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.112561  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:01.108691  1747 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:01.129640  1674 raft_consensus.cc:2368] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 13:00:01.112596  1669 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:01.117065  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.047978  7088 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.075754  6826 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:01.131440  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:01.139690  1598 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:01.141778  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.142433  1670 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:01.148131  1670 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:01.151245  1566 leader_election.cc:400] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 13:00:01.151674  1566 leader_election.cc:403] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:01.127959  7147 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.164453  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:01.173144  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76532.6us
I20260709 13:00:01.175016  7098 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:01.175886  7098 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:01.083962  7114 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.182149  1602 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:01.161072  6993 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:01.196810  1598 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:01.114746  7084 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:01.204844  7153 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:00:01.204982  7145 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:01.180763  7088 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:01.166900  7102 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 13:00:01.210407  7119 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.096776  7121 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.219792  7090 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:01.221414  7056 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.222048  7075 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.172643  7147 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.222961  6963 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.223692  7127 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:01.249786  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:01.243970  7150 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:01.253969  7150 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:01.244874  6881 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.255957  6881 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.259066  6881 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.205003  7089 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:01.221410  7114 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:01.249307  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 214670us
I20260709 13:00:01.243144  7103 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.252750  7147 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.261245  7084 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.198521  7149 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:00:01.256628  7150 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:01.264199  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67217.2us
I20260709 13:00:01.271643  7151 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:01.272009  7103 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.274309  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:01.308339  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.309036  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.312827  1596 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:01.269187  7106 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:01.334580  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.341444  1674 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:01.357110  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.363400  1672 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 13:00:01.378623  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.337319  7150 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:01.383072  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.384584  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.385486  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.335722  7106 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:01.364101  7084 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.394399  7084 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.397128  7084 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.399078  1599 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 14 index: 5. (index mismatch)
I20260709 13:00:01.388571  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.401443  1675 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:01.389719  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.392091  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.375492  6976 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.380484  7082 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:01.357375  7075 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:01.382007  6933 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:01.417860  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.416633  6976 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.401178  7106 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:01.457552  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 65630.1us
I20260709 13:00:01.458808  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.401692  7150 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:01.470604  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.513212  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.522888  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.524334  1599 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:01.536092  6976 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:01.417017  7082 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.545617  7103 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.553910  7150 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.457512  6933 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.576916  6933 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:01.579214  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.580705  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.581609  1599 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:00:01.636703  7161 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.637377  7161 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.649410  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.659212  7106 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.661587  7106 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.654018  7103 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:00:01.664885  1596 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:01.651484  7161 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.667757  7109 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.668396  7109 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.669495  7151 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:01.670616  7109 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.673386  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:01.676098  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 292789us
I20260709 13:00:01.690414  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:01.683728  7161 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:01.698065  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:01.698927  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:01.693451  7161 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.717854  7161 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:01.732406  1596 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:01.699427  7106 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:01.753942  1678 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:01.756558  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.728094  7151 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:01.729599  7103 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:01.772501  1748 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:01.772292  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:01.775810  1672 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:01.777185  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:01.773133  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 78365.4us
I20260709 13:00:01.754758  7106 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.782318  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:01.751062  7147 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:01.795855  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.754866  7152 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:00:01.783058  7106 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:01.774717  7151 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.794670  7114 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:01.781039  7103 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.789255  7102 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:00:01.805200  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.815915  7114 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:01.828246  7114 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:01.840045  7158 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:01.841089  7158 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.845633  7105 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:01.846622  7105 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:01.856050  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.856927  7114 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.869568  7114 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.869776  7106 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:01.870405  7151 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.871838  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.873134  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.873425  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.873871  1749 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:01.876461  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.877123  1752 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:00:01.879321  7103 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:01.882613  7105 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:01.883725  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.885383  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:01.900103  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.901264  1747 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:01.975106  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:01.975927  1747 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:01.899739  7074 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:01.997164  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.001844  1752 raft_consensus.cc:2410] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:02.005563  1743 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:00:02.006013  1743 pending_rounds.cc:85] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 8
I20260709 13:00:02.006232  1743 pending_rounds.cc:107] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:00:02.006462  1743 raft_consensus.cc:2889] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:02.006953  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.917992  7103 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.974498  7152 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.016993  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.017319  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:01.980183  7158 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.018033  1745 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:02.001056  7137 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:02.008661  7074 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.034492  7074 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:02.018203  7103 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.038919  7103 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.045091  7082 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.028236  7106 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.024806  7152 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.052122  7161 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.052747  7152 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.053133  1747 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:02.054137  1744 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:02.024267  7102 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:00:02.057471  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.060564  7180 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:02.071972  7180 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.072603  7180 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.075529  7180 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.076889  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.077822  1746 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:02.080881  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.081966  1678 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:00:02.082129  7105 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:02.082819  7105 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.083282  7105 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:02.094549  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.095223  1595 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:02.095965  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.096784  1672 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:02.097826  1676 raft_consensus.cc:2368] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
I20260709 13:00:02.100137  7161 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.105786  1678 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:02.111303  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.111768  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.112303  1598 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:02.112509  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:02.119689  7114 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:02.121562  7102 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:02.121996  7102 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:02.107185  7105 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.135114  1749 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:02.121332  1602 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 8 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:02.141811  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.142452  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.142620  1677 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:02.140406  7137 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.156136  1595 raft_consensus.cc:2368] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:00:02.123210  7102 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.160997  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:02.161499  7102 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:02.150487  7137 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.166880  7137 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:02.178292  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.179042  1751 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 5. (term mismatch)
I20260709 13:00:02.179574  1751 pending_rounds.cc:85] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 4
I20260709 13:00:02.179994  1751 pending_rounds.cc:107] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.5
I20260709 13:00:02.179633  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.180311  1751 raft_consensus.cc:2889] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:02.181553  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:02.182256  1603 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:02.183511  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.181833  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.180652  1749 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:02.186151  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:02.186548  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.186918  1751 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:02.191066  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.197623  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.198448  1594 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:02.200758  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.201987  1599 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:02.216301  7155 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:02.218341  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.221423  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.225188  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:02.224229  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.222654  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:02.226936  1745 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:02.223798  1751 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 13:00:02.237914  6881 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:02.242558  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.246842  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:02.219849  7186 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:00:02.248554  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.250193  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.251749  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.256814  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.266144  7151 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:02.267133  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.268119  7082 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:02.270159  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:02.235303  7114 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:02.281371  7114 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:02.285457  7082 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:02.286068  7082 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.286370  7084 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.286958  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.287220  7084 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.289000  7180 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:02.289806  7084 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.286438  7082 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:02.288983  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:02.249531  7074 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:02.243592  6881 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:02.297775  7109 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:02.298277  7109 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:02.298427  7074 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:02.298764  7109 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.298883  7074 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:02.252794  7158 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:02.311190  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59026us
I20260709 13:00:02.312597  1715 leader_election.cc:400] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
I20260709 13:00:02.312844  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.312942  1715 leader_election.cc:403] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:02.255815  7103 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:02.319377  7105 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.313745  7148 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:02.320050  7158 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:02.320369  7105 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:02.324462  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:02.325188  1744 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:00:02.325273  7114 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:02.320490  1501 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:02.337416  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:02.321079  7105 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:02.330049  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.323918  7148 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.352782  1603 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 13:00:02.351848  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.322563  7147 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:02.358076  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.327071  7155 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12.
I20260709 13:00:02.359855  1501 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.367630  1744 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:02.354099  7148 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:02.374922  6994 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:00:02.344960  7074 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.385703  7074 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:02.370029  1501 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:02.375504  7102 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:02.375955  7109 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.401599  1501 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.420557  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 13:00:02.424922  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51341.9us
I20260709 13:00:02.427736  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.433265  7103 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:02.433913  7103 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:02.434494  7103 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.442003  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.453852  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.428735  7056 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:02.485348  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.445787  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.506947  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.440797  7158 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:02.472816  6994 raft_consensus.cc:2764] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:00:02.514699  7105 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:02.488288  7191 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:00:02.520291  7075 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:02.524375  7103 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.528828  7103 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.541649  7109 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.562913  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:02.581451  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 135757us
I20260709 13:00:02.582597  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:02.599244  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:02.601358  1671 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:02.603694  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.605399  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.613161  1674 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:02.614883  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.616595  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:02.580965  7056 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:02.584365  7158 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:02.641280  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:02.645293  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:02.648494  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:02.648932  1751 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:02.649511  1748 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:00:02.652977  1596 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:02.654377  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:02.655457  1603 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:00:02.618732  6881 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:02.665468  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:02.617637  7075 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:02.642999  7158 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:02.682835  7193 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:00:02.695881  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:02.693616  7158 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:02.716562  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.718024   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:02.692742  6881 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:02.726626  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:02.728034  1603 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:02.727736  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:02.707677  7084 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:02.745718  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 87707.3us
I20260709 13:00:02.747689  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:02.695916  7199 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:00:02.731221  7109 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:02.708894  7082 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.763417  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:02.773218  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:02.765570  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.764081  7180 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:02.807418  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75187us
I20260709 13:00:02.817061  1677 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:00:02.818825  7137 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:02.819942  7082 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:02.818233  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:02.823673  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58390.6us
W20260709 13:00:02.827746  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.841976  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.766829  7105 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:00:02.821293  7123 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:02.733835  7056 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.753533  7084 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:02.850785  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77664.9us
I20260709 13:00:02.823916  7204 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:02.854748  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:02.743408  7075 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:02.844609  7082 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:02.857651  7204 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:02.984625  7204 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:02.987323  7200 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:00:02.849817  7211 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.002189  7211 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:02.992439  7207 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:00:02.851085  7161 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:03.007362  7158 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.010705  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:02.999208  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:03.013521  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:02.821034  6881 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.017376  7211 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.008261  7161 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.018620  7161 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.856969  7195 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:03.022634  7209 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.178s	user 0.003s	sys 0.000s
I20260709 13:00:03.023798  7105 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.030169  1673 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:03.030441  7105 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:03.031510  7095 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:03.024638  7155 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:03.025884  7201 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:00:03.039510  7056 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:03.040190  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:03.058218  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.024698  7202 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 13:00:03.058118  7056 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:00:03.053977  7151 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:03.071218  7098 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:03.075781  7098 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:03.076102  7155 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:03.112474  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:03.076774  7098 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:03.141276  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 91647.4us
I20260709 13:00:03.107405  7213 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.147308  7103 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:03.152962  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67440.4us
I20260709 13:00:03.184934  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:03.188484  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:03.193655  6881 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:03.195209  7084 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:03.199074  7205 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.416s	user 0.013s	sys 0.000s
I20260709 13:00:03.187428  7215 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.204226  7215 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:03.207365  7158 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.193248  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:03.208235  7204 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.209010  7158 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:03.210846  7204 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:03.154840  7213 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.213939  7213 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.183851  7105 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:03.216307  7148 consensus_meta.cc:287] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.833s	user 0.014s	sys 0.000s
I20260709 13:00:03.216866  7148 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.218155  1746 raft_consensus.cc:2368] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:03.218750  7219 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:03.217950  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:03.222086  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:03.162737  7103 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.224632  7103 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.226109  1675 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
W20260709 13:00:03.228770  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71003.5us
I20260709 13:00:03.232599  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:03.232646  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:03.240200  1715 leader_election.cc:400] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:00:03.226128  6881 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:03.228091  7105 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:03.254401  7074 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:03.255177  7074 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:03.219367  7219 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:03.257536  7074 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:03.258517  7219 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:03.263844  7215 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.265128  7148 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:03.227061  7161 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.270104  7204 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.271261  7204 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.273070  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:03.276225  7098 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:03.276243  7204 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:03.276309  7199 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:00:03.278738  7199 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:03.279137  7199 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:03.280061  7199 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.283169  7199 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:03.284021  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:03.285645  7161 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.292837  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:03.286302  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:03.306370  1595 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 13:00:03.305403  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:03.307211  1603 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:03.314474  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:03.315256  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:03.316542  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:03.317166  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:03.321905  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:03.323050  1750 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:03.322109  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:03.326838  1641 leader_election.cc:400] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:03.327322  1641 leader_election.cc:403] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:03.328090  7082 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:03.329396  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:03.342789  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:03.344100  7111 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:03.349256  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:03.339341  7082 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:03.352240  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:03.356248  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:03.365658  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:03.366645  7082 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:03.367229  7082 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.376524  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:03.382140  1595 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:03.372210  7082 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:03.386461  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:03.387439  1669 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:03.391983  7056 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:03.379570  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:03.397723  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:03.399089  7222 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:03.416554  7199 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.434284  1597 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:03.339257  1603 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:03.438395  1596 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:00:03.435247  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:03.440299  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:03.428155  1496 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 8 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:03.443041  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.444298  7105 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:03.456282  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:03.467857  1750 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:03.448294  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:03.451766  7147 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:03.480489  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:03.483006  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:03.489226  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:03.490851  7213 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:03.485759  6881 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:03.493326  6881 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:03.494513  6881 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.504654  7151 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:03.504395  1496 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 15 to 16, leader changed from <none> to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:03.450906  7199 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.511898  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:03.526350  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:03.530256  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:03.519958  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:03.548216  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:03.484196  7147 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:03.554913  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82542.1us
I20260709 13:00:03.549564  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:03.590047  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:03.591069  1603 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:03.590605  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:03.595583  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46179us
I20260709 13:00:03.545701  7106 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:03.574163  7155 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:03.605739  7155 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:03.606199  7155 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:03.588145  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:03.559763  7147 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:03.573849  7175 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:03.547570  7213 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:00:03.613303  7222 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:03.660660  1603 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:03.671303  7234 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.672197  7234 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.688405  7111 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.689504  7111 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:03.607111  7155 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:03.728899  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 184122us
I20260709 13:00:03.663695  7211 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.738875  1672 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:03.703786  7075 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.722800  7098 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.701319  7222 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:03.649766  7137 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:00:03.743656  7155 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:03.750447  7102 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:03.838135  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 173122us
I20260709 13:00:03.758613  7234 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:03.842362  7229 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:00:03.747304  7211 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.849979  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:03.834998  7240 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.876359  7222 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.878918  7199 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.880604  7111 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.757825  7098 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.881836  7211 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.882841  7098 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:03.869441  7231 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:00:03.849570  7102 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.886052  7102 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.870548  7235 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:03.752372  7075 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:03.886863  7235 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:03.889228  7235 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:03.875294  7240 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.893572  7075 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:03.897454  7242 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.892268  7240 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.906980  7137 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:03.906002  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56205.7us
I20260709 13:00:03.915362  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 102) took 2531 ms. Trace:
I20260709 13:00:03.916126  1496 rpcz_store.cc:276] 0709 13:00:01.384317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.389240 (+  4923us) service_pool.cc:224] Handling call
0709 13:00:03.915241 (+2526001us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:03.725867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:03.875833 (+149966us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:03.875872 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:00:03.875892 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:03.876437 (+   545us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:03.876498 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:03.876533 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:03.876806 (+   273us) tablet.cc:701] Row locks acquired
0709 13:00:03.876824 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:03.876996 (+   172us) write_op.cc:270] Start()
0709 13:00:03.877127 (+   131us) write_op.cc:276] Timestamp: P: 1783602003876939 usec, L: 0
0709 13:00:03.877153 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:00:03.877923 (+   770us) log.cc:844] Serialized 1041 byte log entry
0709 13:00:03.880966 (+  3043us) op_driver.cc:464] REPLICATION: finished
0709 13:00:03.881677 (+   711us) write_op.cc:301] APPLY: starting
0709 13:00:03.881805 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:03.884031 (+  2226us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:03.884233 (+   202us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:03.886403 (+  2170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:03.886706 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:00:03.886786 (+    80us) write_op.cc:312] APPLY: finished
0709 13:00:03.887099 (+   313us) log.cc:844] Serialized 33 byte log entry
0709 13:00:03.888456 (+  1357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.888615 (+   159us) write_op.cc:454] Released schema lock
0709 13:00:03.888689 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:03.889301 (+   612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.889356 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":96883,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":395,"apply.run_cpu_time_us":6517,"apply.run_wall_time_us":7529,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":149642,"prepare.run_cpu_time_us":3853,"prepare.run_wall_time_us":185707,"replication_time_us":3583,"thread_start_us":64517,"threads_started":1}]]}
I20260709 13:00:03.898296  7242 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.960652  7242 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:03.905027  7082 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.963280  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:03.964718  7082 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:03.968393  1673 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:03.971838  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:03.973987  7236 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.234s	user 0.002s	sys 0.002s
I20260709 13:00:03.974489  7147 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.984159  1497 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 9 to 12, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.985755  1497 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:03.988744  7114 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.989670  7114 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:03.993929  7204 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:03.994663  7204 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:03.996104  7204 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:04.012698  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 282478us
I20260709 13:00:03.924724  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 188) took 5031 ms. Trace:
I20260709 13:00:03.931002  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.027704  7239 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.028442  7239 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.028848  1497 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 12 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.030877  7239 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.020129  1501 rpcz_store.cc:276] 0709 12:59:58.893464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.937645 (+ 44181us) service_pool.cc:224] Handling call
0709 12:59:59.192380 (+254735us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 13:00:03.924605 (+4732225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:02.482327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:02.482956 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:02.482997 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:00:02.483017 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:02.517014 (+ 33997us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:02.527225 (+ 10211us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:02.527273 (+    48us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:02.527968 (+   695us) tablet.cc:701] Row locks acquired
0709 13:00:02.527991 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:00:02.528181 (+   190us) write_op.cc:270] Start()
0709 13:00:02.528349 (+   168us) write_op.cc:276] Timestamp: P: 1783602002528121 usec, L: 0
0709 13:00:02.528377 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:00:02.529209 (+   832us) log.cc:844] Serialized 2094 byte log entry
0709 13:00:03.222107 (+692898us) op_driver.cc:464] REPLICATION: finished
0709 13:00:03.364334 (+142227us) write_op.cc:301] APPLY: starting
0709 13:00:03.364432 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:03.383006 (+ 18574us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:03.383111 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:03.397857 (+ 14746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:03.398084 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:00:03.398134 (+    50us) write_op.cc:312] APPLY: finished
0709 13:00:03.398534 (+   400us) log.cc:844] Serialized 57 byte log entry
0709 13:00:03.404136 (+  5602us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.404267 (+   131us) write_op.cc:454] Released schema lock
0709 13:00:03.404317 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:03.405023 (+   706us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.405062 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5160,"reported_tablets":29,"spinlock_wait_cycles":235608320,"child_traces":[["op",{"apply.queue_time_us":141923,"apply.run_cpu_time_us":10146,"apply.run_wall_time_us":40438,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":49220,"prepare.run_cpu_time_us":8821,"prepare.run_wall_time_us":148081,"raft.queue_time_us":129051,"raft.run_cpu_time_us":23772,"raft.run_wall_time_us":215311,"replication_time_us":693527,"spinlock_wait_cycles":20224,"thread_start_us":401108,"threads_started":4,"wal-append.queue_time_us":133999}]]}
I20260709 13:00:04.005115  7204 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:04.023350  7105 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.042505  7105 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.044402  1677 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:00:04.044974  7105 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.040184  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:04.046386  1672 raft_consensus.cc:606] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.047717  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.049155  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.050765  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.053066  1597 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:04.054654  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.056142  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.055191  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.057808  1671 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:00:04.059908  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.039211  7213 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.064491  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:04.066454  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 135549us
I20260709 13:00:04.067400  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:04.064420  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.079726  1676 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:04.079947  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.080955  1670 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:04.055871  7123 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.057085  7082 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.083987  7242 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:04.100009  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.084762  1599 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:04.104790  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.106356  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.107023  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.107519  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.093772  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.085975  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:04.109454  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.108186  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.109066  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.097529  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:04.126756  1594 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:04.127681  1748 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:04.129740  1599 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:04.123208  1601 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:04.108843  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.135326  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.143955  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.144881  1672 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:04.086335  7123 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:04.152773  7123 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:04.086666  7082 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.156199  7082 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.090798  7250 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.159502  7250 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.162084  7250 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:04.086782  7148 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:00:04.163834  7148 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:04.164237  7148 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:04.165159  7148 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.166520  7148 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:04.085986  7110 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:04.170665  1749 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:00:04.084940  7213 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.174638  7213 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.175271  1669 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 13:00:04.124953  7155 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:04.189888  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:04.202800  7246 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:04.202932  7195 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:04.209908  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:04.210069  7246 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.211830  7246 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:04.211899  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.207893  7114 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.216051  7155 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:04.216428  7250 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:04.216951  7250 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.217346  7250 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:04.217346  7155 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.228438  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.230832  7239 raft_consensus.cc:993] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:04.231422  7158 raft_consensus.cc:1081] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:04.233955  7213 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:04.210665  7195 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.246023  7195 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:04.252785  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.256527  1749 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:04.254813  1500 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.261641  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.262068  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.260299  1500 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.266594  1500 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.271328  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:04.273535  1500 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.275206  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 13:00:04.276046  1600 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.276438  1600 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:04.268431  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:04.278931  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:04.270628  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 71300.6us
I20260709 13:00:04.283278  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.284124  1669 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:04.291752  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.256327  7213 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:04.296479  7102 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:04.301402  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 170) took 9386 ms. Trace:
I20260709 13:00:04.302260  1500 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.209054  7147 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.307595  1500 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 15, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.314885  1500 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.303529  1497 rpcz_store.cc:276] 0709 12:59:54.914822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.920111 (+  5289us) service_pool.cc:224] Handling call
0709 13:00:04.301294 (+9381183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:04.149551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:04.150218 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:04.150256 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:00:04.150277 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:04.150868 (+   591us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:04.150927 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:04.150959 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:04.151334 (+   375us) tablet.cc:701] Row locks acquired
0709 13:00:04.151355 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:00:04.151523 (+   168us) write_op.cc:270] Start()
0709 13:00:04.151760 (+   237us) write_op.cc:276] Timestamp: P: 1783602004151464 usec, L: 0
0709 13:00:04.151785 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:04.152556 (+   771us) log.cc:844] Serialized 1317 byte log entry
0709 13:00:04.155436 (+  2880us) op_driver.cc:464] REPLICATION: finished
0709 13:00:04.156545 (+  1109us) write_op.cc:301] APPLY: starting
0709 13:00:04.156644 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:04.158723 (+  2079us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:04.158828 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:04.166314 (+  7486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:04.166508 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:00:04.166558 (+    50us) write_op.cc:312] APPLY: finished
0709 13:00:04.166793 (+   235us) log.cc:844] Serialized 41 byte log entry
0709 13:00:04.167743 (+   950us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:04.167851 (+   108us) write_op.cc:454] Released schema lock
0709 13:00:04.167930 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:04.168356 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:04.168383 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":372,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":833,"apply.run_cpu_time_us":5930,"apply.run_wall_time_us":11773,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":3898,"prepare.run_cpu_time_us":3334,"prepare.run_wall_time_us":5402,"replication_time_us":3518}]]}
I20260709 13:00:04.291833  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.320058  1600 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.329962  1500 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.333827  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.333724  1500 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.277938  7123 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:04.339039  1500 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 16, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.341109  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.340672  1500 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 20 to 21, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.341323  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.342309  1500 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.344291  1500 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.347857  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.341952  1743 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:04.348467  1500 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:04.321376  7239 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:04.353900  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.357872  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:04.359885  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.360608  7252 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:00:04.361359  7249 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:04.363826  7105 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:04.364897  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.371914  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:04.354703  6988 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:04.349689  1600 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.393222  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.411859  1671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:04.411981  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.412755  1671 raft_consensus.cc:606] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.345489  7161 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.415868  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.416652  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:04.326836  7250 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.423038  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.413116  7074 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:04.408617  7147 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:04.355165  7123 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.437240  7123 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.417642  7239 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:04.439930  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.441726  7235 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:04.438299  7240 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:04.446457  7250 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:04.449674  7234 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:04.468757  7074 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:04.469520  7074 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:04.458644  7246 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.475004  7246 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.443310  1675 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:04.477232  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.478763  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.482519  7234 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:04.483176  7234 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.483695  7234 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:04.486980  7240 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:04.487581  7240 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:04.488008  7240 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.502553  1602 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:04.503176  1744 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:04.506642  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:04.456797  7152 raft_consensus.cc:993] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:04.512796  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:04.524600  1669 raft_consensus.cc:606] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.516045  1748 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:04.544442  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:04.546726  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:04.536590  7239 raft_consensus.cc:1081] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:04.554672  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:04.556778  1600 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:04.560566  1669 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:04.561182  7249 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.563216  7249 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.565752  7249 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.546900  7247 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:04.540298  7152 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:04.583987  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:04.584831  1598 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:04.588734  7084 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:04.558604  7223 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:00:04.615181  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 13:00:04.615658  1671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:04.616240  1671 raft_consensus.cc:606] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.616917  1671 raft_consensus.cc:614] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:04.616971  1600 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.617823  1600 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:04.614691  1598 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:04.585268  7240 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.631825  1603 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:04.648826  7240 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.666863  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.679601  1600 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.683295  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.684484  1744 raft_consensus.cc:2368] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 13:00:04.686875  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.687953  1600 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.688323  1748 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:04.689639  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.691795  7095 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:04.693370  7234 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.693897  6994 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:04.695057  1601 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:04.696326  1669 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 13:00:04.705111  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89150.7us
I20260709 13:00:04.706858  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.707176  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:04.697335  7234 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.702343  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:04.712230  1600 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:04.745868  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 43635.1us
I20260709 13:00:04.716615  1748 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:04.727383  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:04.734416  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:04.759797  1674 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:04.760224  1674 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:04.710041  7235 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.739946  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.755909  7195 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:04.777880  7195 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:04.779925  7235 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.782507  7235 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:04.785928  1674 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:04.754469  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 47392.5us
I20260709 13:00:04.757565  7247 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:04.789057  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:04.779040  7195 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.793300  1747 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:04.794131  7247 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:04.794972  7247 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:04.795580  7247 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:04.794664  1750 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:04.797431  7074 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.787288  1674 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:04.804462  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 202) took 1252 ms. Trace:
I20260709 13:00:04.808935  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.809639  1673 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:04.810251  1672 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:00:04.813153  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:04.815330  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:04.817862  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:04.818789  1669 raft_consensus.cc:2368] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 13:00:04.805335  1500 rpcz_store.cc:276] 0709 13:00:03.584940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.585108 (+   168us) service_pool.cc:224] Handling call
0709 13:00:04.799737 (+1214629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:04.372069 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:04.372663 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:04.372696 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:00:04.372712 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:04.374010 (+  1298us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:04.374072 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:04.374098 (+    26us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:00:04.375209 (+  1111us) tablet.cc:701] Row locks acquired
0709 13:00:04.375233 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:00:04.375399 (+   166us) write_op.cc:270] Start()
0709 13:00:04.375518 (+   119us) write_op.cc:276] Timestamp: P: 1783602004375351 usec, L: 0
0709 13:00:04.377396 (+  1878us) op_driver.cc:348] REPLICATION: starting
0709 13:00:04.378130 (+   734us) log.cc:844] Serialized 5586 byte log entry
0709 13:00:04.384584 (+  6454us) op_driver.cc:464] REPLICATION: finished
0709 13:00:04.387248 (+  2664us) write_op.cc:301] APPLY: starting
0709 13:00:04.387344 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:04.465933 (+ 78589us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:04.466044 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:04.652522 (+186478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:04.653058 (+   536us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:00:04.653116 (+    58us) write_op.cc:312] APPLY: finished
0709 13:00:04.653789 (+   673us) log.cc:844] Serialized 129 byte log entry
0709 13:00:04.654023 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:04.654222 (+   199us) write_op.cc:454] Released schema lock
0709 13:00:04.654287 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:04.655692 (+  1405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:04.655726 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":97110,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":2377,"apply.run_cpu_time_us":23985,"apply.run_wall_time_us":268421,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58604,"num_ops":14,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":4598,"prepare.run_wall_time_us":9663,"replication_time_us":6988}]]}
I20260709 13:00:04.846495  1566 leader_election.cc:400] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 13:00:04.846925  1566 leader_election.cc:403] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:00:04.832599  7234 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:04.847867  7223 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:00:04.854282  7249 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 13:00:04.856047  7234 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:04.858486  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:04.861858  7075 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:04.862497  7075 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:04.857297  7234 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.874405  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:04.878073  1751 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:04.871308  7260 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:00:04.887229  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.889559  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:04.900635  1748 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:04.905633  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:04.908327  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:04.876181  7074 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:04.919788  1748 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:04.916968  7147 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.924695  7095 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:04.912655  7155 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:04.923312  7214 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:00:04.863497  7075 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.953975  7175 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:04.958323  7175 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:04.961158  7175 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:04.942621  7147 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:04.967468  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:04.970132  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:04.983958  1599 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:04.983985  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:05.038964  2315 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:00:05.035851  7262 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 13:00:04.983355  1603 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:05.055430  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:05.062440  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:05.063192  1677 raft_consensus.cc:606] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:05.067878  7234 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:05.067250  7247 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.069324  7250 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:05.059211  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:05.070281  6912 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:05.061086  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77175.9us
I20260709 13:00:05.072086  1600 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:05.072503  1566 leader_election.cc:400] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16.
I20260709 13:00:05.073696  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:05.080029  1674 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:05.086623  7235 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:05.100020  7147 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.099789  1602 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:05.101461  2315 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:05.100546  7235 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.070060  7250 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.120431  1749 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:05.109342  7235 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:05.122691  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:05.158521  1750 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:05.160506  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.160986  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:05.148792  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.149556  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:05.161634  1672 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:05.162266  1674 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:05.162825  1674 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:05.164917  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:05.166097  1671 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
W20260709 13:00:05.167564  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 97942.7us
I20260709 13:00:05.095753  6993 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:00:05.185381  1674 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.186568  1674 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:05.114470  7075 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.196807  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:05.205296  7240 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:05.205824  7240 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.206198  7240 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:05.208297  7270 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:00:05.209586  7147 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:05.217232  7250 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:05.201912  7242 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:00:05.226048  1674 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:05.183688  7246 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:05.234246  7246 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:05.235921  7246 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.203660  7247 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.241310  7249 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:05.241788  7249 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:05.242642  7249 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.244146  7249 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:05.250411  7137 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:05.250944  7137 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:05.262249  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 93170.5us
W20260709 13:00:05.279995  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.070s	sys 0.074s
W20260709 13:00:05.280494  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.070s	sys 0.074s
I20260709 13:00:05.286381  7137 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.288168  7137 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:05.294541  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 97821.3us
I20260709 13:00:05.320595  7147 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.321271  7147 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.328706  7147 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.332983  7268 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:05.333612  7268 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:05.334620  7268 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:05.342535  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 159817us
I20260709 13:00:05.349956  7158 raft_consensus.cc:993] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
W20260709 13:00:05.351624  7266 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.316s	user 0.002s	sys 0.004s
I20260709 13:00:05.352089  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:05.352804  1749 raft_consensus.cc:606] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:05.354939   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:05.357954  7158 raft_consensus.cc:1081] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:05.358795  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:05.358225   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:05.359161  7235 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:05.345541  7241 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:05.363631  1750 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:05.359629  7268 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:05.368512  7235 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.385676  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 13:00:05.386499  1600 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:05.386914  1600 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:05.393715  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46513.6us
I20260709 13:00:05.395149  7214 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:05.395354  1500 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.397892  1500 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 13 to 16, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.399647  1500 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.401541  1500 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 16, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:05.404688  1500 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 13 to 14, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.410375  7103 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:05.411610  7238 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:05.412050  7238 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:05.412943  7238 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.348500  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:05.419410  7238 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:05.425071  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:05.431758  7105 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:05.432480  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 84064.6us
I20260709 13:00:05.434333  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:05.435447  7105 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:05.435909  7105 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.436549  7105 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:05.436255  7239 raft_consensus.cc:993] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:05.439055  7239 raft_consensus.cc:1081] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:05.447918  1600 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.474881  1600 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.476701  1598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 13:00:05.478312  1598 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:05.382634  7240 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.479058  1598 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:05.480391  1675 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:05.480970  7240 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.457983  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.489521  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:05.490562  1675 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:05.491516  1674 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:05.491218  1598 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.501390  7105 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.519299  1598 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:05.510027  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 74485.4us
I20260709 13:00:05.525408  7105 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:05.529755  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:05.552130  7240 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:05.553996  7240 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:05.555254  7240 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.564003  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:05.564376  1675 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:05.574353  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:05.593606  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.594380  1675 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:05.598503  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.599498  1677 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:05.599942  1677 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:05.602484  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.602823  1669 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:05.603153  1673 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:05.603631  1673 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:05.605608  1673 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.607010  1673 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:05.601042  1677 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.609159  1677 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:05.610152  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.610765  1669 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:00:05.612757  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:05.613368  1749 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:00:05.614197  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:05.614809  1671 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:05.616377  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:05.616801  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:05.616961  1748 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:05.617345  1743 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:05.618396  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:05.619657  1744 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:05.615847  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:05.620903  1752 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:05.622368  1747 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:05.626772  1750 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:00:05.628690  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.608743  7137 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:00:05.664031  1671 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:05.666774  6994 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:05.669142  7148 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 11 to 13, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:05.679170  2309 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:05.685148  1676 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:05.687356  1675 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:00:05.665266  1752 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:05.639062  1749 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:00:05.693986  1748 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:05.705387  7137 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:05.706792  1673 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:05.708210  7249 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:05.709858  7249 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:05.712347  1669 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:05.704131  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:05.721550  1744 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:05.721050  1677 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:05.721926  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:05.725095  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:05.745529  1743 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:05.749445  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:05.753149  1598 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:05.775367  1496 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 11 to 13, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:05.730005  7246 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:05.797783  7246 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:05.771658  7240 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:05.800381  7240 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:05.801328  7240 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.805349  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75dc4812cc534228899ce2b7b14d2237 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:05.798861  7246 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.745584  7249 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:05.809168  7249 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 23 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:05.810192  7249 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:05.860054  1601 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:05.902959  7074 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:05.907087  7286 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 13:00:05.911732  1674 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:05.909245  1501 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.923501  1501 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.929807  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.936487  1748 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:05.994522  7074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48436 (request call id 74) took 1202 ms. Trace:
I20260709 13:00:05.995709  7074 rpcz_store.cc:276] 0709 13:00:04.792069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.792277 (+   208us) service_pool.cc:224] Handling call
0709 13:00:04.798453 (+  6176us) log.cc:844] Serialized 501 byte log entry
0709 13:00:05.350899 (+552446us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:05.994371 (+643472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149009,"raft.queue_time_us":179840,"raft.run_cpu_time_us":2579,"raft.run_wall_time_us":167536,"spinlock_wait_cycles":12868352,"thread_start_us":132438,"threads_started":1,"wal-append.queue_time_us":154865}
I20260709 13:00:05.998566  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60a0f19eac6047fdb1fd191d07ab7355 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:06.002236  7274 raft_consensus.cc:993] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:06.002924  7274 raft_consensus.cc:1081] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:06.014627  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:06.016918  7234 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:06.018743  7246 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:06.024449  7148 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:06.028293  7246 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:06.028748  2315 raft_consensus.cc:2955] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:06.030797  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:06.032879  7246 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:06.033432  7246 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:06.034497  7246 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.040170  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:06.044207  7234 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:06.045053  7234 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:06.046100  7234 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.053418  7275 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.061189  1598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:00:06.061869  1598 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.062242  1598 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:06.076593  1598 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.079495  1496 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 12 to 13, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:06.080749  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 212372us
I20260709 13:00:06.098816  1598 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:06.109397  1744 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:06.115198  1678 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:06.136974  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:06.137032  1744 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:06.133281  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:06.151080  1748 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:06.151670  1748 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:06.167459  1748 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.165915  7214 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:06.118618  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dc4812cc534228899ce2b7b14d2237 with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:46970
I20260709 13:00:06.190081  1748 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:06.177073  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57698.6us
I20260709 13:00:06.227313  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:06.228066  1674 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:06.251246  1674 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:06.253109  1748 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:06.302815  7252 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:06.303505  7252 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.305804  7252 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:06.306344  7252 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:06.306859  7252 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:06.327273  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:06.328413  1603 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:06.332803  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:06.333738  1749 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:06.344233  7252 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:06.344307  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:06.345249  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:06.346973  7309 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:06.347898  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:06.348475  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:06.269938  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 131383us
I20260709 13:00:06.349956  1641 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:06.353619  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:06.382011  7314 tablet_replica.cc:333] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:00:06.384068  7314 raft_consensus.cc:2243] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:06.348065  7309 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:06.387159  7309 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:06.397168  7252 raft_consensus.cc:2706] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Received pre-election callback for term 17 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:00:06.377876   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:06.376611  7306 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:06.429607  7306 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:06.430250  7306 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:06.431252  7306 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.459937  7314 raft_consensus.cc:2272] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:06.471338  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 117785us
I20260709 13:00:06.502542  1601 raft_consensus.cc:2955] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:06.483228  1497 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.522552  1671 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:06.496235  7314 ts_tablet_manager.cc:1916] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:06.550909  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 17, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:06.603755  1674 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:06.612337  1748 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:06.578981  7309 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.649554  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 171) took 1029 ms. Trace:
I20260709 13:00:06.677126  7274 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.677583  7322 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:06.677796  7274 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.678220  7322 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:06.679752  1677 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:00:06.682325  7234 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:06.660928  1497 rpcz_store.cc:276] 0709 13:00:05.620381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.631611 (+ 11230us) service_pool.cc:224] Handling call
0709 13:00:05.701478 (+ 69867us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b5400002490. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e3690b2 00007f94872e2a89 00007f948727ada6 00007f948724c088 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc
0709 13:00:05.737603 (+ 36125us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 13:00:06.649455 (+911852us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:06.535970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:06.536559 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:06.536624 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:00:06.536637 (+    13us) tablet.cc:662] Decoding operations
0709 13:00:06.537010 (+   373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:06.537071 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:06.537098 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:06.537293 (+   195us) tablet.cc:701] Row locks acquired
0709 13:00:06.537317 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:00:06.537476 (+   159us) write_op.cc:270] Start()
0709 13:00:06.537596 (+   120us) write_op.cc:276] Timestamp: P: 1783602006537427 usec, L: 0
0709 13:00:06.537611 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:00:06.538290 (+   679us) log.cc:844] Serialized 541 byte log entry
0709 13:00:06.541516 (+  3226us) op_driver.cc:464] REPLICATION: finished
0709 13:00:06.541910 (+   394us) write_op.cc:301] APPLY: starting
0709 13:00:06.542005 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:06.543036 (+  1031us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:06.543151 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:06.544045 (+   894us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:06.544230 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:00:06.544285 (+    55us) write_op.cc:312] APPLY: finished
0709 13:00:06.544514 (+   229us) log.cc:844] Serialized 25 byte log entry
0709 13:00:06.544717 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:06.544811 (+    94us) write_op.cc:454] Released schema lock
0709 13:00:06.544858 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:06.578675 (+ 33817us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:06.578724 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":155771,"reported_tablets":33,"spinlock_wait_cycles":174113408,"child_traces":[["op",{"apply.queue_time_us":128,"apply.run_cpu_time_us":3410,"apply.run_wall_time_us":19001,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":1992,"prepare.run_cpu_time_us":2637,"prepare.run_wall_time_us":2638,"replication_time_us":3752}]]}
I20260709 13:00:06.693487  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:06.690191  1501 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 13, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:06.698663  1501 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:06.702718  1677 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:06.686702  7274 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:06.708824  1748 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:06.703130  7158 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:06.715339  1748 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:06.718770  1743 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:06.730777  1743 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:00:06.706315  7240 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:00:06.723208  7158 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.735836  7158 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:06.737797  7309 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:06.760818  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:06.761687  1601 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:06.767565  7306 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:06.768715  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:06.769456  1748 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:06.773243  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:06.774595  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:06.775403  1748 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:06.775513  1677 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:06.772354  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:06.779456  1673 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:06.782135  1599 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:06.778331  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:06.794965  1602 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:06.777246  7311 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.798907  1671 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:06.771162  7240 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:00:06.788858  7155 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:06.809407  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:06.840881  7322 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:06.811069  7311 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.847311  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 13:00:06.849129  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49387.5us
I20260709 13:00:06.851133  7158 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:06.852262  7158 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:06.853565  7314 ts_tablet_manager.cc:1929] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:00:06.854305  7314 log.cc:1199] T 75dc4812cc534228899ce2b7b14d2237 P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/75dc4812cc534228899ce2b7b14d2237
I20260709 13:00:06.857821  7240 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:06.846124  7234 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.811486  7235 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:00:06.835062  7155 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.860920  7155 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:06.858780  7234 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.785077  7315 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:00:06.875072  7152 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:06.875818  7152 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:06.883934  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:06.853332  7158 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.890604  7311 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:06.886994  7235 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:00:06.904440  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:06.905066  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:06.908404  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:06.906946  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:06.864748  7234 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:06.832442  7335 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:00:06.884864  7152 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:06.915166  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:06.917361  1744 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 13:00:06.899899  7155 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:06.924233  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:06.925449  1602 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 13:00:06.933782  7319 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:00:06.936591  7105 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:00:06.993795  1566 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:06.946461  7318 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:00:07.012485  7234 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:07.013126  7158 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:07.061677  7158 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.080339  7155 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:07.082365  7158 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:06.903389  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet 75dc4812cc534228899ce2b7b14d2237 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
W20260709 13:00:07.095386  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 191993us
I20260709 13:00:07.111176  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:07.112071  1602 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:07.117605  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:07.118467  1752 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:07.123392  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:07.124393  7309 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:07.124843  7309 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:07.125263  7309 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.149459  7309 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.159291  7309 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:07.165944  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:07.167050  1602 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:07.169154  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:07.187062  1743 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:07.222364  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:07.233662  7322 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.247996  7322 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.250886  7322 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:07.215350  7152 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.258312  7152 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:07.259972  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:07.259088  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:07.262189  1602 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:07.274113  1743 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:07.276297  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:07.278818  7329 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:07.279460  7329 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:07.280424  7329 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.234287  7294 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:07.310133  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 317722us
W20260709 13:00:07.321302  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 308443us
I20260709 13:00:07.322278  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:07.362088  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:07.364173  7214 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.364714  7214 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.365105  7214 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.334641  7346 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.369262  7346 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.369700  7346 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.377728  7214 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.381115  7214 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:07.387202  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:07.389731  1750 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:07.324589  7294 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:07.412451  1748 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:07.426985  1750 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:07.441076  1673 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:07.401083  7294 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.505236  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:07.621978  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:07.625649  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:07.657301  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 44923.6us
I20260709 13:00:07.580538  7152 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:00:07.669783  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 162223us
W20260709 13:00:07.702337  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45775.8us
I20260709 13:00:07.672202  7347 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:07.684398  7309 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:07.713107  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:07.718014  1601 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:07.711395  7347 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.714450  7309 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:07.755308  1590 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a0f19eac6047fdb1fd191d07ab7355 with delete_type TABLET_DATA_TOMBSTONED (TS 693257b3078444e0bd26d3e82159d452 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51592
I20260709 13:00:07.719729  7335 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:00:07.716035  7346 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.733289  7347 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:07.784291  7356 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:00:07.785089  7352 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:00:07.795660  7346 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:07.780009  7309 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:07.803689  7365 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:00:07.857872  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 123452us
I20260709 13:00:07.901832  7347 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:07.907097  1601 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:07.844308  7152 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:00:07.902387  1497 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 12 to 13, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.912505  1497 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 12 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.913970  7347 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:07.914057  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:07.929169  1602 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.918727  1497 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 12 to 13, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.950263  1497 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:07.962436  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45628.8us
I20260709 13:00:07.962806  1602 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
W20260709 13:00:07.963465  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.961230  1497 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 17, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.976167  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:07.977115  1601 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:07.970572  1497 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 16 to 17, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:07.980733  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.983274  7158 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:07.986694  7309 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:08.007834  1497 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.003751  7294 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:08.041888  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 68613.9us
I20260709 13:00:08.050086  7373 tablet_replica.cc:333] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:00:08.046962  7294 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:08.060910  7214 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:08.043803  7347 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:00:08.071580  1748 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:08.068782  7349 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:08.068782  7214 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.081229  7349 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.082073  7373 raft_consensus.cc:2243] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.095080  7373 raft_consensus.cc:2272] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.095505  7294 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.098847  7373 ts_tablet_manager.cc:1916] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:08.099079  7294 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.100257  7349 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:08.093361  7214 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:08.148723  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 95148us
I20260709 13:00:08.185036  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:08.139683   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.221160  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:08.278228  7239 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:08.279851  7239 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.283661  7239 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:08.285383  1602 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:08.292834  1744 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:08.302956  7239 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:08.303979  7239 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.307024  7239 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:08.336457  7239 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.337409  7239 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.402381  7158 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:08.371191  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:08.404322  7328 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:08.404857  7328 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:08.406432  7328 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.408282  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:08.404516  1743 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:08.411291  7328 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.423089  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:08.408656  7239 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:08.409272  1747 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.433195  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:08.448527  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:08.448352  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:08.441780  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:08.472484  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:08.490096  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:08.492154  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:08.512636  1677 raft_consensus.cc:2410] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:00:08.544588  1674 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:08.531294  1747 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
W20260709 13:00:08.548951  7387 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.113s	user 0.005s	sys 0.000s
I20260709 13:00:08.558099  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:08.567384  7252 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:08.570211  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:08.588196  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:08.588553  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:08.601699  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:08.616295  7158 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:08.639334  7381 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:08.709877  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet 46080b3c17204e34b7cfa66296431876: Illegal state: Replica 1a40ab12c220464db732562e88c32c11 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:08.714661  7373 ts_tablet_manager.cc:1929] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:00:08.720932  7373 log.cc:1199] T 60a0f19eac6047fdb1fd191d07ab7355 P 693257b3078444e0bd26d3e82159d452: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-0-root/wals/60a0f19eac6047fdb1fd191d07ab7355
I20260709 13:00:08.722904  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:08.723778  7373 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51592 (request call id 0) took 1194 ms. Trace:
I20260709 13:00:08.724867  7345 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:08.724347  7373 rpcz_store.cc:276] 0709 13:00:07.551895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.638169 (+ 86274us) service_pool.cc:224] Handling call
0709 13:00:08.021188 (+383019us) ts_tablet_manager.cc:1151] Deleting tablet 60a0f19eac6047fdb1fd191d07ab7355
0709 13:00:08.025551 (+  4363us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:08.539932 (+514381us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:08.714343 (+174411us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:08.723666 (+  9323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":244387,"thread_start_us":158636,"threads_started":1}
I20260709 13:00:08.725891  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:08.726222  7345 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:08.727865  7384 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.732101  7345 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.742133  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:08.743232  7155 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:08.745141  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:08.746112  7155 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:08.779822  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:08.781140  7372 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.811723  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:08.826619  7319 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:08.833822  7319 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:08.835731  7319 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.896265  1501 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 17 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:08.930613  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 72551.5us
I20260709 13:00:08.937280  1485 catalog_manager.cc:5028] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): tablet 60a0f19eac6047fdb1fd191d07ab7355 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 13:00:08.938164  7239 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:08.948340  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 192) took 1512 ms. Trace:
I20260709 13:00:08.938959  7239 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:08.952780  7239 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:08.961093  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:08.961617  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:08.963832  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:08.964571  1747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22373089b38b498393c2161e53b5f016"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:08.965238  7239 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:08.948805  1501 rpcz_store.cc:276] 0709 13:00:07.435946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.436124 (+   178us) service_pool.cc:224] Handling call
0709 13:00:07.905527 (+469403us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 13:00:08.948246 (+1042719us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:08.911807 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:08.912519 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:08.912575 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:00:08.912592 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:08.913023 (+   431us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:08.913094 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:08.913131 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:08.913365 (+   234us) tablet.cc:701] Row locks acquired
0709 13:00:08.913381 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:00:08.913586 (+   205us) write_op.cc:270] Start()
0709 13:00:08.913735 (+   149us) write_op.cc:276] Timestamp: P: 1783602008913517 usec, L: 0
0709 13:00:08.913757 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:08.914652 (+   895us) log.cc:844] Serialized 541 byte log entry
0709 13:00:08.917422 (+  2770us) op_driver.cc:464] REPLICATION: finished
0709 13:00:08.918113 (+   691us) write_op.cc:301] APPLY: starting
0709 13:00:08.918227 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:08.919515 (+  1288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:08.919713 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:08.920733 (+  1020us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:08.920972 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:00:08.921044 (+    72us) write_op.cc:312] APPLY: finished
0709 13:00:08.921346 (+   302us) log.cc:844] Serialized 25 byte log entry
0709 13:00:08.930362 (+  9016us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.935403 (+  5041us) write_op.cc:454] Released schema lock
0709 13:00:08.936406 (+  1003us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:08.942865 (+  6459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.942899 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2389,"reported_tablets":4,"spinlock_wait_cycles":3844992,"child_traces":[["op",{"apply.queue_time_us":366,"apply.run_cpu_time_us":4379,"apply.run_wall_time_us":24687,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":1759,"prepare.run_cpu_time_us":3225,"prepare.run_wall_time_us":5488,"replication_time_us":3467}]]}
I20260709 13:00:08.965595  1747 raft_consensus.cc:606] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:08.966534  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 172) took 1608 ms. Trace:
I20260709 13:00:08.970541  1747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:08.971344  1747 raft_consensus.cc:606] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:08.992489  1748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:08.993366  1748 raft_consensus.cc:606] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:09.001688  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 205) took 1006 ms. Trace:
I20260709 13:00:08.966975  1497 rpcz_store.cc:276] 0709 13:00:07.357978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.358232 (+   254us) service_pool.cc:224] Handling call
0709 13:00:08.966346 (+1608114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:08.261845 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:08.266993 (+  5148us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:08.267301 (+   308us) write_op.cc:435] Acquired schema lock
0709 13:00:08.267341 (+    40us) tablet.cc:662] Decoding operations
0709 13:00:08.271213 (+  3872us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:08.271339 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:08.271368 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:08.272366 (+   998us) tablet.cc:701] Row locks acquired
0709 13:00:08.272426 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:00:08.272726 (+   300us) write_op.cc:270] Start()
0709 13:00:08.272966 (+   240us) write_op.cc:276] Timestamp: P: 1783602008272627 usec, L: 0
0709 13:00:08.273035 (+    69us) op_driver.cc:348] REPLICATION: starting
0709 13:00:08.276643 (+  3608us) log.cc:844] Serialized 2870 byte log entry
0709 13:00:08.468575 (+191932us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b18001f8ac0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:00:08.496747 (+ 28172us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:08.717192 (+220445us) op_driver.cc:464] REPLICATION: finished
0709 13:00:08.815011 (+ 97819us) write_op.cc:301] APPLY: starting
0709 13:00:08.815155 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:08.820994 (+  5839us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:08.821037 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:08.860289 (+ 39252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:08.860844 (+   555us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:00:08.860923 (+    79us) write_op.cc:312] APPLY: finished
0709 13:00:08.861613 (+   690us) log.cc:844] Serialized 73 byte log entry
0709 13:00:08.871252 (+  9639us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.871448 (+   196us) write_op.cc:454] Released schema lock
0709 13:00:08.871566 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:08.883274 (+ 11708us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.883316 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":724,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":95858,"apply.run_cpu_time_us":15002,"apply.run_wall_time_us":68204,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":112403,"prepare.run_cpu_time_us":68029,"prepare.run_wall_time_us":180708,"raft.queue_time_us":106432,"raft.run_cpu_time_us":12100,"raft.run_wall_time_us":122146,"replication_time_us":435807,"spinlock_wait_cycles":10780544,"thread_start_us":224948,"threads_started":4,"wal-append.queue_time_us":110402}]]}
I20260709 13:00:09.002086  1599 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:09.002313  1500 rpcz_store.cc:276] 0709 13:00:07.995486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.995821 (+   335us) service_pool.cc:224] Handling call
0709 13:00:08.987924 (+992103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5674,"reported_tablets":9}
I20260709 13:00:09.021387  1747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:09.022181  1747 raft_consensus.cc:606] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:09.035218  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:09.036309  1749 raft_consensus.cc:606] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:09.055210   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:09.057631  7384 raft_consensus.cc:993] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:09.058248  7384 raft_consensus.cc:1081] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:09.060179   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:09.060459  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46986
I20260709 13:00:09.061352  1678 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.061745  1678 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:09.121488  1747 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:09.125887  1678 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.127872  1675 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:09.140282  1678 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:09.142745  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:09.142464  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:09.143642  1748 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:09.144025  1748 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:09.146534  1748 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.156210  1748 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:09.168260  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 18 to 19, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.171185  7311 raft_consensus.cc:993] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:09.177382  7311 raft_consensus.cc:1081] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:09.178020  1599 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:09.171896  7401 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:09.183051  7240 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:09.186020  1566 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33f3320caa9849f893ce5125d17a0d48. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:09.211746  1501 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 15, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.216972  7311 raft_consensus.cc:993] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:09.224920  7311 raft_consensus.cc:1081] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:09.222911  7345 raft_consensus.cc:993] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:09.226595  7345 raft_consensus.cc:1081] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:00:09.255048  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46986
I20260709 13:00:09.299029  1677 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.299500  1677 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:09.315949  7252 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.316812  7252 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.289443  1599 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:09.320904  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:09.321774  1603 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:09.249434  1748 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:09.323047  1595 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:09.323697  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:09.325961  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:09.327325  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:09.328426  7239 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:09.328734  7349 raft_consensus.cc:993] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:09.329342  7384 raft_consensus.cc:1081] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:09.332211  1677 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:09.337575  1598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:00:09.338151  1601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:00:09.338351  1598 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.338824  1598 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:09.338778  1601 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.344193  1601 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:09.352672  1603 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:00:09.325037  7240 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:09.357863  7252 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:09.359303  7252 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:09.359880  7252 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.360267  7252 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:09.388182  1748 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:09.384151  1601 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.390581  1677 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:09.388480  1598 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.385874  1752 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:09.418205  1601 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:09.421375  7239 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:09.423418  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 96186.5us
I20260709 13:00:09.424156  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22373089b38b498393c2161e53b5f016"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46986
I20260709 13:00:09.425580  1677 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.426182  1677 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.424468  1598 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:09.429328  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:09.430052  1599 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:09.431532  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:09.432536  1749 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:09.432963  1749 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:09.436601  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:09.437461  1747 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:09.437866  1747 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:09.437994  7414 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:09.439334  1747 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:09.442255  1747 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:09.456815  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:09.458611  1748 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:09.459030  1748 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:09.424166  7214 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:09.460265  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:09.461232  2313 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:09.466742  1747 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:09.468122  7239 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:09.490301  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83205.1us
I20260709 13:00:09.495383  1677 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:09.505890  1599 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:09.509773  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:09.513774  1677 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:09.508423  1749 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.525622  1748 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.535964  1748 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:09.540020  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 102684us
I20260709 13:00:09.587139  1599 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:09.577875  1749 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:09.614562  1748 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:09.620764  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:09.621522  1675 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:09.617851  1677 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:09.623970  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:09.624516  1672 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:09.633530  1674 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:00:09.634275  1674 pending_rounds.cc:85] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 8
I20260709 13:00:09.640259  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 11, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:09.644721  7252 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.646416  1678 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:09.634593  1674 pending_rounds.cc:107] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:00:09.650981  1674 raft_consensus.cc:2889] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.662189  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:09.675138  1744 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:09.683295  7252 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:09.684288  1675 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:09.689356  7404 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:09.690054  7404 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:09.700002  1675 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:09.705814  1672 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:09.715281  7214 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:09.716209  7214 consensus_queue.cc:1243] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:09.716728  7214 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:09.717049  7214 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:09.717957  7214 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.719238  7214 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:09.736873  1566 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e85f5002455b4bc4bc385d3b81511511. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:09.691253  7404 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.744468  7420 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:00:09.784112  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 74811.8us
I20260709 13:00:09.765614  7319 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:00:09.811283  1672 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:09.817546  1749 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:09.838671  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:09.840039  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:09.840776  2310 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.846983  7414 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:09.849654  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:09.850754  7411 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:09.851307  7411 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:09.852571  7411 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:09.856345  2310 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:09.859584  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:09.893297  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:09.894501  1749 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:09.895648  1749 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:09.900391  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:09.908107  1744 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:00:09.913102  7412 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.937978  1749 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:09.939862  7417 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:09.941140  7417 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:09.942452  7417 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:09.944802  7424 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:00:09.946628  7423 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:00:09.935284  7412 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:09.958698  7426 ts_tablet_manager.cc:933] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
I20260709 13:00:09.980561  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:09.987656  1749 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.991888  7433 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.011704  2309 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:10.010392  7433 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:10.019266  7426 tablet_copy_client.cc:323] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
W20260709 13:00:10.047636  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.071965  1749 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:10.080763   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:10.083735  7155 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:10.056071  7418 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:10.037987  7412 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:10.090853  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77509.8us
I20260709 13:00:10.090507  1501 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 19, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.099830  7418 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:10.101837  7418 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:10.037631  7433 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:10.098629  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 173587us
I20260709 13:00:10.114885  7434 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:10.126734  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:10.127995  1612 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet 33f3320caa9849f893ce5125d17a0d48 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
I20260709 13:00:10.130446  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:10.144898  1612 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet 33f3320caa9849f893ce5125d17a0d48 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-33f3320caa9849f893ce5125d17a0d48
I20260709 13:00:10.133180  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:10.146337  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:00:10.168556  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:10.171769  7411 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:10.174958  7402 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:10.177598  1612 tablet_copy_source_session.cc:215] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:10.184465  1748 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:10.194346  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:10.195453  1751 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:00:10.184504  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:10.230243  7412 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:10.235364  1752 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:10.225684  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:10.292955  7410 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:10.293808  7410 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.294227  7410 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.341339  1497 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 15, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.360445  7426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f3320caa9849f893ce5125d17a0d48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:10.387964  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 122881us
I20260709 13:00:10.406545  1748 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:00:10.406855  1501 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:10.424186  7451 ts_tablet_manager.cc:933] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
W20260709 13:00:10.430328  7446 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:00:10.476706  7252 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:10.517583  1752 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:00:10.539753  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81033.9us
W20260709 13:00:10.565836  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 154255us
I20260709 13:00:10.554905  7410 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:10.567612  7319 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:10.587117  7410 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:10.599761  1599 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:10.602434  7434 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:00:10.606556  7451 tablet_copy_client.cc:323] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:37007
W20260709 13:00:10.617933  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet fcd92efcb3084fe59e6f16a5467bcd9e: Illegal state: Replica fab19506de7242869c29d70c9fffb739 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:10.643796  1598 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:10.647256  1612 tablet_copy_service.cc:140] P 693257b3078444e0bd26d3e82159d452: Received BeginTabletCopySession request for tablet e85f5002455b4bc4bc385d3b81511511 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:55880)
I20260709 13:00:10.648031  1612 tablet_copy_service.cc:161] P 693257b3078444e0bd26d3e82159d452: Beginning new tablet copy session on tablet e85f5002455b4bc4bc385d3b81511511 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:55880: session id = 570958eb733a4af7ae16ae020998c8b4-e85f5002455b4bc4bc385d3b81511511
I20260709 13:00:10.670660  2309 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:10.682791  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:10.683534  1598 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.696048  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:00:10.698889  7418 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:10.683162  1612 tablet_copy_source_session.cc:215] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:10.704027  7418 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:10.705638  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:10.716990  1678 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:00:10.726166  1672 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:00:10.738178  7417 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:10.725571  7252 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:10.755023  7252 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:10.756158  7252 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:10.758744  2309 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:10.766040  7426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36884 (request call id 315) took 1029 ms. Trace:
I20260709 13:00:10.777143  1748 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:10.780010  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:10.784379  1747 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.776367  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 12 to 13, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.793992  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 8, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.818449  1751 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:10.731607  7411 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:00:10.801923  7433 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:00:10.842072  1747 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
W20260709 13:00:10.841472  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49027.7us
I20260709 13:00:10.845582  7412 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:10.772401  7426 rpcz_store.cc:276] 0709 13:00:09.742855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.743060 (+   205us) service_pool.cc:224] Handling call
0709 13:00:09.968717 (+225657us) ts_tablet_manager.cc:934] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
0709 13:00:10.284337 (+315620us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:10.607398 (+323061us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:10.607578 (+   180us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:10.765059 (+157481us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:10.765467 (+   408us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:10.765882 (+   415us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:10.765956 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":6379,"tablet-copy.queue_time_us":179011,"thread_start_us":133244,"threads_started":2}
I20260709 13:00:10.852281  7412 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:10.853410  7426 tablet_copy_client.cc:806] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:10.854319  7426 tablet_copy_client.cc:670] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:10.802817  7402 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:00:10.912895  7155 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.913576  7155 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:10.947352  7155 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:10.951012  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:10.953197  1674 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
W20260709 13:00:11.044719  7462 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:00:11.086665  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:11.088270  7349 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:11.088856  7349 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.089388  7349 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:11.107694  7404 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:11.110802  7404 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:11.113941  7404 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:11.134627  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83682.2us
I20260709 13:00:11.143689  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:11.150792  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f5002455b4bc4bc385d3b81511511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.169911  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:11.171412  1671 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:11.150514  1670 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:11.263936  7349 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:11.265614  1750 raft_consensus.cc:2368] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:00:11.268630  7349 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:11.282205  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:11.287000  1600 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:11.297039  1501 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 19 to 20, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.316069  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:11.319365  1671 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:11.377720  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:11.391292  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:11.392892  1600 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:00:11.421451   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:11.437523  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:11.441529  7431 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:11.464260  1600 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:11.451815  7431 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:11.467516  1566 leader_election.cc:400] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:00:11.486707  1566 leader_election.cc:403] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:11.496908  7431 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:11.498878  1748 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:11.506219  7417 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:00:11.496151  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:11.525784  7426 tablet_copy_client.cc:538] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:11.585579  7426 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
W20260709 13:00:11.601742  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70725.7us
W20260709 13:00:11.628564  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63016.5us
I20260709 13:00:11.650169  1500 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.620999  7452 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:11.677599  7411 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:11.701846  1501 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.663363  7451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36884 (request call id 316) took 1398 ms. Trace:
I20260709 13:00:11.704929  7451 rpcz_store.cc:276] 0709 13:00:10.264438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.268787 (+  4349us) service_pool.cc:224] Handling call
0709 13:00:10.424701 (+155914us) ts_tablet_manager.cc:934] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007)
0709 13:00:11.139565 (+714864us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:11.418147 (+278582us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:11.418303 (+   156us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:11.662390 (+244087us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:11.662817 (+   427us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:11.663184 (+   367us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:11.663266 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7801,"tablet-copy.queue_time_us":143779,"thread_start_us":226666,"threads_started":2}
I20260709 13:00:11.719487  7451 tablet_copy_client.cc:806] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:11.720239  7451 tablet_copy_client.cc:670] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:11.924744  1673 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:11.951875  2309 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:11.965977  1603 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:11.969241  7411 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:11.975183  7456 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:12.230193  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 201829us
I20260709 13:00:12.252692  7439 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 5 to 11, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:12.361987  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 365318us
W20260709 13:00:12.368844  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 137703us
W20260709 13:00:12.370215  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 136284us
I20260709 13:00:12.453361  1598 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 5 to 11, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:12.463801  7451 tablet_copy_client.cc:538] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:12.586681  1595 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:00:12.603201  1674 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:00:12.655305  7452 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:12.656050  7452 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:12.658648  7452 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:12.668939  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:12.669749  1599 raft_consensus.cc:606] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
W20260709 13:00:12.669586  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 264951us
I20260709 13:00:12.717394  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27da507a1bb04525952847c678820e4e"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:12.718230  1599 raft_consensus.cc:606] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
W20260709 13:00:12.721396  7465 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:12.729169  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:12.670962  7411 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:12.729946  1599 raft_consensus.cc:606] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:12.692102  7456 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:12.789237  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:12.781170  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9a24b102b5d4949a5dd73c9f7d069ad with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:12.793450  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:12.792642  7504 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:12.747967  7411 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:12.836606  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 142230us
I20260709 13:00:12.826810  7451 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:00:12.823284  7439 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:12.764454  7456 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:12.807400  7504 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:12.843992  7503 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:12.872386  7456 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:12.882951  7411 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:12.855435  7439 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:12.867455  7416 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:12.899281  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:12.900138  1599 raft_consensus.cc:606] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:12.869948  7503 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:12.878780  2309 raft_consensus.cc:2955] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 5 to 11, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:12.928444  7504 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:12.930418  7439 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:12.931808  7426 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:12.932997  7426 tablet_bootstrap.cc:492] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:00:12.933933  7426 ts_tablet_manager.cc:1403] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.349s	user 0.055s	sys 0.041s
I20260709 13:00:12.937670  7426 raft_consensus.cc:359] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:12.938773  7426 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:00:12.936444  7503 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:12.935151  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index 5 to 11, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:12.959524  7426 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:12.969434  7426 ts_tablet_manager.cc:1434] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.005s
W20260709 13:00:12.996053  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 100467us
I20260709 13:00:12.998958  7500 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.006898  7500 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.010283  7500 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.015183  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.032706  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:13.045905  1599 raft_consensus.cc:606] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
W20260709 13:00:13.066871  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 202196us
I20260709 13:00:13.072642   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:13.059733  7500 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:13.075716  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 167711us
I20260709 13:00:13.075956   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:13.047207  7419 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:13.077937  7503 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:13.092469  7419 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:13.082324  7505 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:00:13.126494  7505 consensus_queue.cc:1243] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:13.125768  7439 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:13.129817  7411 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:13.129731  7439 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.130461  7411 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.134152  1612 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-33f3320caa9849f893ce5125d17a0d48 received from {username='slave'} at 127.0.0.1:55880
I20260709 13:00:13.134721  7439 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.134778  1612 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-33f3320caa9849f893ce5125d17a0d48 on tablet 33f3320caa9849f893ce5125d17a0d48 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:13.138239  7419 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:13.126645  7500 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:13.158478  7500 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.123993  7503 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.134833  7411 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.140273  1674 raft_consensus.cc:1217] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[17.9-21.11]   Dedup: 17.9->[19.10-21.11]
I20260709 13:00:13.142514  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:13.165462  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.167304  1674 pending_rounds.cc:85] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 9
I20260709 13:00:13.169744  1674 pending_rounds.cc:107] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:00:13.170089  1674 raft_consensus.cc:2889] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:13.171099  7503 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.174927  7500 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.184942  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.191741  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.198907  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:13.198781  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.252144  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.254616  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:13.292363  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51753.2us
I20260709 13:00:13.364727  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:13.367127  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 111920us
I20260709 13:00:13.386070  1715 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:13.394398  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.397014  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.398916  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.401053  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.404875  7511 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:13.408806  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.412375  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.386833  7413 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:13.413359  7413 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.413792  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.431933  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.443648  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.430253  7413 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.457583  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a24b102b5d4949a5dd73c9f7d069ad with delete_type TABLET_DATA_TOMBSTONED (TS fab19506de7242869c29d70c9fffb739 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48436
I20260709 13:00:13.488135  7486 raft_consensus.cc:993] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:13.488925  7486 raft_consensus.cc:1081] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:13.491710  7513 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:13.492455  7513 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:13.498042  7513 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:13.501976  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:13.584991  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 143430us
I20260709 13:00:13.589952  7432 raft_consensus.cc:993] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:13.591775  7527 tablet_replica.cc:333] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:00:13.592979  7486 raft_consensus.cc:993] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:13.593822  7486 raft_consensus.cc:1081] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
W20260709 13:00:13.581665  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 135963us
I20260709 13:00:13.598970  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:13.602555  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 94712.2us
I20260709 13:00:13.614516  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:13.615841  7432 raft_consensus.cc:1081] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
W20260709 13:00:13.648676  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45658.2us
I20260709 13:00:13.691315  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.706275  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.705605  7413 raft_consensus.cc:993] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:13.712050  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.715528  7503 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:13.716034  7413 raft_consensus.cc:1081] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:13.713361  7411 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:13.706316  7507 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:13.729436  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.722846  7527 raft_consensus.cc:2243] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.735383  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.722849  2309 raft_consensus.cc:1217] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:00:13.732990  7507 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:13.758132  7451 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:13.759299  7451 tablet_bootstrap.cc:492] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:00:13.748730  7411 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:13.760180  7451 ts_tablet_manager.cc:1403] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.940s	user 0.054s	sys 0.018s
I20260709 13:00:13.751889  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.768309  7527 raft_consensus.cc:2272] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.783002  7527 ts_tablet_manager.cc:1916] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:13.789690  7451 raft_consensus.cc:359] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:13.791124  7451 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:00:13.809020  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.810693  1672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27da507a1bb04525952847c678820e4e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46996
I20260709 13:00:13.810945  1674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46996
I20260709 13:00:13.811391  1672 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.811640  1674 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.811853  1672 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:13.812068  1674 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:13.813346  1671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46996
I20260709 13:00:13.813959  1671 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.814333  1671 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:13.815642  7530 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:00:13.820309  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.822263  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.823952  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.825450  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:13.839862  7451 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:13.844769  1674 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.836433  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.850119  7503 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:13.859707  7411 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:13.862462  7451 ts_tablet_manager.cc:1434] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:00:13.835106  1672 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.865320  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:13.865742  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:13.866351  1752 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:13.838485  1671 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.866444  1595 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:13.871780  1595 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:13.872928  1595 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.847246  1674 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.873956  1595 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:13.880676  1671 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.898175  1672 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:13.865320  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.899685  7411 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:13.900236  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:13.902094  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63274.1us
I20260709 13:00:13.910521  1752 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:13.912905  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.917197  1595 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:13.918748  7503 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:13.918118  7411 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:13.925318  1612 tablet_copy_service.cc:342] P 693257b3078444e0bd26d3e82159d452: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-e85f5002455b4bc4bc385d3b81511511 received from {username='slave'} at 127.0.0.1:55880
I20260709 13:00:13.925949  1612 tablet_copy_service.cc:434] P 693257b3078444e0bd26d3e82159d452: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-e85f5002455b4bc4bc385d3b81511511 on tablet e85f5002455b4bc4bc385d3b81511511 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:13.943953  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:13.958333  7527 ts_tablet_manager.cc:1929] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:00:13.958879  7432 raft_consensus.cc:993] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: : Instructing follower fab19506de7242869c29d70c9fffb739 to start an election
I20260709 13:00:13.959174  7527 log.cc:1199] T a9a24b102b5d4949a5dd73c9f7d069ad P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/a9a24b102b5d4949a5dd73c9f7d069ad
I20260709 13:00:13.959499  7432 raft_consensus.cc:1081] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Signalling peer fab19506de7242869c29d70c9fffb739 to start an election
I20260709 13:00:13.963201  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet a9a24b102b5d4949a5dd73c9f7d069ad (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
W20260709 13:00:13.965327  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 43954.7us
I20260709 13:00:13.970629  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:13.973289  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:13.973639  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:13.973966  1595 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:13.974309  1752 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:13.974325  1595 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:13.980031  7507 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:13.980638  7507 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:13.980706  1595 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.981771  7507 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:13.981841  1595 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:13.983918  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:13.987368  7402 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:13.989508  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:13.990393  1599 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:13.991140  1599 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:13.994562  1752 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:13.998859  2309 raft_consensus.cc:1217] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:00:13.999514  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:14.002341  1747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:48448
I20260709 13:00:14.002985  1747 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.003351  1747 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:14.003326  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:14.005867  1752 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:13.997042  1599 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.007604  1599 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:14.013257  1670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46996
I20260709 13:00:14.014015  1670 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.014433  1670 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.019037  1671 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:14.021545  1673 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:14.010655  7513 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.047523  1747 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.050064  1747 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:14.054137  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:14.054622  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:14.054934  1594 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:14.055322  1594 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:14.055285  1671 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:14.056332  1594 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.057680  1594 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:14.067905  1595 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:14.070317  1671 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:14.052898  1670 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.071802  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:14.078648  1670 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:14.082352   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:14.085438  1752 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:14.079608  1594 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:14.078903  7523 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:14.099845  7523 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:14.100977  7523 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.115658  1672 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:14.122031  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:14.122933  7500 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:14.123502  7500 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:14.129956  1599 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:14.124482  7500 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.153882  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:14.154588  1752 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.157922  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:14.158623  1599 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:14.158897  1599 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:14.159696  1599 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.172886  1599 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.212666  1752 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:14.227873  1496 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 20 to 21, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.240051  1599 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:14.245004  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:14.252198  7535 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:14.284081  7486 raft_consensus.cc:1064] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:00:14.290202  7486 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:14.310540  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 64045.8us
I20260709 13:00:14.316475  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:14.324013  7425 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:14.324731  7425 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:14.326756  1676 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:14.330636  7500 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:14.331347  7500 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:14.332386  7500 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.335819  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:14.327250  7425 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:14.352509  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:14.314916  7535 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:14.368561  7535 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:14.412583  2309 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:00:14.414826  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62230.4us
I20260709 13:00:14.417980  1744 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:14.433790  1670 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:14.437189  1500 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.439580  1500 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 13 to 14, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.456420  7432 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:14.441818  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:14.458679  7513 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:14.467527  1597 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:14.471119  7539 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:14.464886  1500 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 17 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.473416  7402 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:14.488646  1747 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:14.490955  7539 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:14.505491  7402 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
W20260709 13:00:14.580709  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54620.2us
W20260709 13:00:14.614023  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 99482.5us
W20260709 13:00:14.682428  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69850us
W20260709 13:00:14.810519  7549 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.130s	user 0.002s	sys 0.003s
W20260709 13:00:14.830534  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 174528us
W20260709 13:00:14.939355  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 251074us
W20260709 13:00:14.978209  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 122231us
I20260709 13:00:15.061429  7548 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:15.117283  7502 raft_consensus.cc:1064] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:00:15.118188  1595 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:15.142230  1595 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:15.158998  1599 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:00:15.160099  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.164376  1672 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:15.173831  7502 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:15.186950  1745 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:15.192468  2313 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:15.215812  1597 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:00:15.222503  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45633.6us
I20260709 13:00:15.236778  1752 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:15.243307  1496 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 11 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:15.272514  1669 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:15.370146  1744 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:15.378069   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:15.386724  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 115540us
I20260709 13:00:15.394464  7573 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:15.409744  2309 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:15.410897  7568 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:15.428030  7565 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:15.429770  1500 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 17, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.442615  7568 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:15.460359  7402 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:15.461429  1752 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:15.466776  1745 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:15.516489  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74440.2us
I20260709 13:00:15.527379  7536 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:15.553980  7432 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:15.542907  7539 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:00:15.546494  7569 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:00:15.594873  7582 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 13:00:15.698520  7581 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:00:15.701090  7579 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:00:15.703133  7578 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:00:15.744482  1670 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:15.859499  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 178181us
W20260709 13:00:15.889626  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 134577us
W20260709 13:00:15.952383  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44140.3us
I20260709 13:00:15.972430  7432 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:15.980088  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52811.5us
W20260709 13:00:15.999729  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90553.7us
I20260709 13:00:15.998607  2309 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:16.034624  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:16.038663  1748 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:16.067776  1596 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:16.079928  1600 raft_consensus.cc:606] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:16.081101  7413 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:00:16.100811  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44404.2us
I20260709 13:00:16.126756  2313 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:16.138100  7413 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:00:16.164237  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 122337us
W20260709 13:00:16.246273  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56909.4us
W20260709 13:00:16.388002  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 93436.6us
I20260709 13:00:16.436151  1678 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:16.443287  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:16.444060  1678 raft_consensus.cc:606] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 13:00:16.451400   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:16.453858   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:16.461419  1500 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 9 to 10, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:16.486213  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 109997us
I20260709 13:00:16.520946  1670 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:16.561661  7548 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:16.639525  7502 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:16.664189  2309 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:16.694684  7618 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:00:16.764354  7626 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:00:16.851699  7587 raft_consensus.cc:993] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: : Instructing follower fab19506de7242869c29d70c9fffb739 to start an election
I20260709 13:00:16.852295  7587 raft_consensus.cc:1081] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Signalling peer fab19506de7242869c29d70c9fffb739 to start an election
I20260709 13:00:16.855764  1744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:48454
I20260709 13:00:16.856436  1744 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.856889  1744 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:16.875315  7502 raft_consensus.cc:993] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:16.877384  1672 raft_consensus.cc:2955] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:16.878681  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33f3320caa9849f893ce5125d17a0d48 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:16.884016  7413 raft_consensus.cc:1081] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:16.900065  1670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46996
I20260709 13:00:16.910547  1670 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.911055  1670 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:16.918967  1500 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 12 to 13, VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195) evicted. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:16.911485  1744 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:16.933728  1744 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:16.936805  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:16.941370  1600 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:16.957434  1599 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:16.954265  1670 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:16.961998  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:16.968791  1672 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:16.969381  1672 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:16.977207  1744 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:16.983839  1600 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:16.985285  1672 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:17.001850  1672 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:17.006150  1734 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f3320caa9849f893ce5125d17a0d48 with delete_type TABLET_DATA_TOMBSTONED (TS fab19506de7242869c29d70c9fffb739 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48436
I20260709 13:00:17.016610  7630 tablet_replica.cc:333] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:00:17.017952  7630 raft_consensus.cc:2243] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.018983  7630 raft_consensus.cc:2272] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.026091  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:17.027012  1600 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:17.027371  1600 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:17.028281  1600 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:17.030157  1600 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:17.041716  1670 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:17.043362  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:17.044104  2313 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:17.051076  7630 ts_tablet_manager.cc:1916] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.075174  1600 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
W20260709 13:00:17.090687  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 105867us
I20260709 13:00:17.091738  7413 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:17.093590  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:17.093799  2309 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:17.094444  7439 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:17.096367  7439 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:17.097378  7439 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:17.110440  1672 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:17.114079  2313 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:17.121762  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.139477  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:17.154448  7419 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:17.169101  7419 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:17.170166  7419 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:17.163429  7548 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:00:17.198405  7630 ts_tablet_manager.cc:1929] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:00:17.199009  7630 log.cc:1199] T 33f3320caa9849f893ce5125d17a0d48 P fab19506de7242869c29d70c9fffb739: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-2-root/wals/33f3320caa9849f893ce5125d17a0d48
I20260709 13:00:17.234962  1485 catalog_manager.cc:5028] TS fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): tablet 33f3320caa9849f893ce5125d17a0d48 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 13:00:17.246765  1744 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:17.244503  7413 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:17.310246  1501 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 12, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.356230  2313 raft_consensus.cc:2955] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:17.376152  1501 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index 10 to 11, VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194) evicted. New cstate: current_term: 13 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:17.382278  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e85f5002455b4bc4bc385d3b81511511 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:17.500212   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:19.553095  7641 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:19.554157  7641 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:19.557982  7641 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:19.998878  1642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.017s	sys 0.017s
W20260709 13:00:20.000036  1642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.018s	sys 0.017s
W20260709 13:00:20.093966  1718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.022s	sys 0.007s
W20260709 13:00:20.094385  1717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.007s	sys 0.004s
W20260709 13:00:20.094666  1718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.022s	sys 0.007s
W20260709 13:00:20.094861  1717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.008s	sys 0.004s
I20260709 13:00:20.253999  7644 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.272919  7644 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:20.305213  1715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.001s	sys 0.010s
W20260709 13:00:20.386302  1715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.002s	sys 0.011s
I20260709 13:00:20.390141  7637 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.391752  7637 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.393926  7640 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.400655  7640 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.425225  7639 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.426684  7639 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.434402  7639 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.443101  7644 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.400992  7637 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.454093  7639 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.459235  7640 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.455430  7639 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.465867  7639 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.479413  7646 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.481123  7646 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.484885  7646 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.473112  7639 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.520601  7650 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.521608  7639 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.523186  7650 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.525185  7639 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.526456  7650 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.526676  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 230) took 3162 ms. Trace:
I20260709 13:00:20.527261  7651 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.527956  7646 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.528748  7650 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.531066  7646 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.532279  7637 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.533353  7638 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.536845  7640 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.537195  7638 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.538091  7640 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.538578  7644 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.539708  7649 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.539813  7643 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.541572  7645 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.543061  7644 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.546258  7639 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.546371  7651 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.547089  7645 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.547632  7639 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.549988  7651 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.550760  7639 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.543129  7637 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.550837  7651 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.557571  7645 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.569118  7645 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.568969  7651 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.570317  7645 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.560844  7650 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.541841  7643 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.541986  7649 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.579968  7643 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.529259  1501 rpcz_store.cc:276] 0709 13:00:17.364167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.364453 (+   286us) service_pool.cc:224] Handling call
0709 13:00:20.526368 (+3161915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:17.381141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:17.381716 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:17.381756 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:00:17.381770 (+    14us) tablet.cc:662] Decoding operations
0709 13:00:17.384853 (+  3083us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:17.385257 (+   404us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:17.387979 (+  2722us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:17.406100 (+ 18121us) tablet.cc:701] Row locks acquired
0709 13:00:17.410028 (+  3928us) write_op.cc:260] PREPARE: finished
0709 13:00:17.410205 (+   177us) write_op.cc:270] Start()
0709 13:00:17.410328 (+   123us) write_op.cc:276] Timestamp: P: 1783602017410158 usec, L: 0
0709 13:00:17.410350 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:17.411058 (+   708us) log.cc:844] Serialized 536 byte log entry
0709 13:00:17.413170 (+  2112us) op_driver.cc:464] REPLICATION: finished
0709 13:00:17.413695 (+   525us) write_op.cc:301] APPLY: starting
0709 13:00:17.413792 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:17.414771 (+   979us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:17.414912 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:17.415821 (+   909us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:17.416027 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:00:17.416085 (+    58us) write_op.cc:312] APPLY: finished
0709 13:00:17.416339 (+   254us) log.cc:844] Serialized 25 byte log entry
0709 13:00:17.416556 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:17.416677 (+   121us) write_op.cc:454] Released schema lock
0709 13:00:17.416731 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:17.417128 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:17.417161 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8,"reported_tablets":1,"spinlock_wait_cycles":19840,"child_traces":[["op",{"apply.queue_time_us":290,"apply.run_cpu_time_us":3405,"apply.run_wall_time_us":3405,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":1473,"prepare.run_cpu_time_us":3052,"prepare.run_wall_time_us":30238,"replication_time_us":2678}]]}
I20260709 13:00:20.580971  7638 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.559841  7640 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.571023  7637 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.572417  7651 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.574399  7642 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.567129  7644 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.543197  7647 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.560075  7648 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.551463  7639 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.580348  7649 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.586141  7648 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.586628  7642 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.594240  7646 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.594517  7642 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.587873  7647 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.607018  7639 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.610774  7639 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.605159  7644 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.614003  7647 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.614264  7644 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.604491  7646 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.617225  7646 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.622592  7648 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.625519  7652 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.626590  7652 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.642438  7651 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.643903  7651 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.647967  7643 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.649293  7643 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.660338  7644 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.661372  7644 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.671794  7636 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.672987  7636 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.675741  7648 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.676563  7636 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.677368  7636 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.676893  7648 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.678298  7636 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.680058  7642 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.680841  7642 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.681493  7636 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.683178  7642 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.684324  7670 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.685256  7669 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.685583  7670 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.686908  7642 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.700974  7643 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.664824  7650 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.718113  7662 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.719193  7662 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.722492  7662 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.725445  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2527) took 3282 ms. Trace:
I20260709 13:00:20.726107  1594 rpcz_store.cc:276] 0709 13:00:17.442776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.712750 (+3269974us) service_pool.cc:224] Handling call
0709 13:00:20.724395 (+ 11645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.724782 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.724815 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.724877 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:20.724924 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.725001 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.725146 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.730499  7651 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.694303  7638 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.731925  7657 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.732265  7638 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.732776  7657 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.736023  7659 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.736750  7652 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.737264  7659 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.737890  7642 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.739849  7644 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.740653  7642 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.742408  7639 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.657052  7637 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.731323  7648 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.657415  7647 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.742806  7644 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.735381  7638 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.751363  7665 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.751654  7656 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.751863  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.752326  7665 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.752595  7656 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.755095  7665 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.716492  7643 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.745991  7657 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.761850  7653 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.751448  7639 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.765939  7653 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.755852  7664 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.774446  7639 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.759629  7652 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.775619  7652 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.756029  7637 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.757717  7660 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.778337  7652 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.778450  7660 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.756273  7647 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.763700  7644 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.773998  7664 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.756896  7643 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.778900  7637 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.783619  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.782595  1669 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:20.793814  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:20.783689  7644 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.786387  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.795889  1670 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:20.795053  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.786886  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.797812  1673 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:20.785833  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.798313  7653 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.755496  7656 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.797160  1672 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:20.785629  7664 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.786590  7659 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.783008  7647 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.785903  7643 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.797137  7644 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:20.808434  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.811467  7661 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.812145  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.822184  1674 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:00:20.824038  1672 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:20.825452  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.782142  7660 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.876595   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:20.788628  7670 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.884245  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.884003  1671 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:20.814906  7652 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.764009  7669 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.891208  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.892017  1673 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:20.816980  7664 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.894129  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.899959  1672 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:20.892616  7654 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.900358  7652 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.899987  7656 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.901554  7654 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.901839  7656 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.896876  7663 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.897337  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.887428  7665 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.898274  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.888777  7661 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.884579  7659 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.906517  7663 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.907143  7642 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:20.918707  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.919220  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.918716  7642 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.907997  7636 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.908336  7646 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.908541  7652 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.910496  7656 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.911294  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.914089  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.914804  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.915279  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.915832  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:20.916466  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 133545us
I20260709 13:00:20.891460  7660 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.889101  7670 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.926069  7659 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.926268  7664 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.927151  7669 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:20.927430  7652 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.966553  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.966979  7652 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.969882  7652 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.927229  7672 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.929032  7661 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.908030  7665 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.932145  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.970855  7672 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:20.934459  7666 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.934898  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:20.932802  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.935426  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:20.908061  7648 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:20.938730  7663 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.940189  7642 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.941008  7636 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.944629  7654 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.950520  1670 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:20.960579  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.960768  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.965535  7670 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:20.987048  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:20.995042  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.109800  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.123042  1670 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 13:00:20.995827  1672 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 4.
I20260709 13:00:21.124490  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.132265  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.108752  7665 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.133821  7673 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.111497  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.134255  7656 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.110770  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.129626  1671 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:20.983942  7669 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:20.981271  7652 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.144973  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.101544  7642 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:20.999431  7664 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.995393  7645 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.091638  7661 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.001904  7670 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.005909  7636 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.109681  7672 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:20.995757  7671 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.205596  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.007710  7659 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.187481  1675 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 13:00:21.200879  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.105451  7676 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.103813  7678 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.199882  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:20.992409  7648 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.203773  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.197849  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.211187  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.214908  1747 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:00:20.986295  7660 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.098170  7675 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.224071  7675 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.225015  7677 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.225770  7677 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.226817  7675 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.203096  7663 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.214144  7681 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.227998  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.228102  7663 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.228796  2313 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:21.228240  7681 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.209128  7664 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.992751  7666 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.135280  7673 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.204133  7665 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.246372  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.248545  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.230993  7642 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.251742  7661 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.277479  7642 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.277848  7661 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.252799  7678 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.278643  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.279574  1603 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:21.280085  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.280891  1745 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:21.285014  7665 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.286600  7681 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.287405  1672 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 13:00:21.252842  7664 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.253906  7676 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.293633  7683 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.255843  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.256299  7671 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.303763  7663 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.304306  7671 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.232858  7669 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.263331  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.265328  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.266127  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.266845  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.308128  1599 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:00:21.308245  1749 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 13:00:21.267071  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.215965  7656 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.267859  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.309280  1751 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:21.309533  2313 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 7.
I20260709 13:00:21.310369  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.311096  1674 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:21.311156  7656 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.267915  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.268280  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.290110  7666 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.268944  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.223393  7660 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.288813  7648 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.271136  7673 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.255563  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.314790  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.242137  7652 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.315344  2315 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:21.315490  1670 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:21.227527  7675 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.315871  7678 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.316434  7675 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.298439  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.287523  7665 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.271489  7677 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.313640  7664 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.268800  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.307279  7669 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.321681  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.323808  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.317444  7652 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.328910  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.330262  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.330739  1745 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:00:21.332261  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.332405  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.332868  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.333184  7675 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.335126  7676 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.344669  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.346338  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.348546  1750 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:21.346524  7661 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.352456  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.356716  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.331633  7683 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.359863  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.357276  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.361832  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.362027  7649 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.363679  7649 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.364118  7649 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.367221  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.367736  7669 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.368465  7669 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.369349  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.372143  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.372416  7669 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.373001  7669 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.351998  7675 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.373519  7669 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.373870  7675 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.374050  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.441762  7686 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.467926  1659 tablet_service.cc:1558] Processing DeleteTablet for tablet e85f5002455b4bc4bc385d3b81511511 with delete_type TABLET_DATA_TOMBSTONED (TS 1a40ab12c220464db732562e88c32c11 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46970
I20260709 13:00:21.468430  7669 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.369975  1594 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:00:21.468592  7686 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:21.469374  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3920 after lost signal to thread 434
I20260709 13:00:21.422703  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:21.471083  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6360 after lost signal to thread 1535
I20260709 13:00:21.386857  7642 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.423441  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.418099  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.355240  7661 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.355337  7652 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.409598  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.408064  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.412716  7683 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.416142  7664 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:21.472530  2338 debug-util.cc:398] Leaking SignalData structure 0x7b0800161600 after lost signal to thread 1627
I20260709 13:00:21.471495  7686 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.473682  7642 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:21.490988  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6120 after lost signal to thread 1702
I20260709 13:00:21.493096  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.493953  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
W20260709 13:00:21.494817  2338 debug-util.cc:398] Leaking SignalData structure 0x7b0800365080 after lost signal to thread 1776
I20260709 13:00:21.476908  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.495294  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.496100  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
W20260709 13:00:21.497464  2338 debug-util.cc:398] Leaking SignalData structure 0x7b0800376780 after lost signal to thread 2341
I20260709 13:00:21.483104  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:21.479736  7652 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:21.482861  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 74882.6us
I20260709 13:00:21.501888  7683 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:21.482759  7645 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:21.502410  7683 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.502737  7645 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.503002  7683 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:21.503305  7645 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.484622  7675 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.486342  7687 tablet_replica.cc:333] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:00:21.479276  7661 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.477591  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.489126  7664 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:21.507409  7687 raft_consensus.cc:2243] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.480123  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:21.515378  7653 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:21.479664  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.518929  7687 raft_consensus.cc:2272] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.526290  7664 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.526472  1598 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:21.527926  7642 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.524366  7652 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.532667  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:21.536101  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.539414  1599 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:00:21.543845  7654 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:21.544514  7687 ts_tablet_manager.cc:1916] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:21.549801  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47805.8us
I20260709 13:00:21.563298  7649 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.566648  7649 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.580482  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.501463  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:21.582028  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.583112  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.588773  7642 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:21.588645  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 87255.6us
I20260709 13:00:21.590212  7642 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.590896  7642 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.594913  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.596146  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.596381  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.597308  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.597119  7645 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.598587  7688 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:21.604780  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.606011  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.607095  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.608140  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.603786  7649 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:21.610090  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.610697  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.610893  7649 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.611335  7649 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:21.612372  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.606345  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.616966  1599 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:21.599828  7645 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:21.623080  7645 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:21.623591  7645 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.623965  7645 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:21.632242  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.633284  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.633584  1600 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:21.635192  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.636304  1603 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:21.637537  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.636603  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.638217  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.639325  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.639756  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.640341  1595 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 13:00:21.641597  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45536.4us
I20260709 13:00:21.642239  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.638324  1596 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:21.643734  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.645488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.645802  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.646534  1600 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:21.651278  7689 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:21.651710  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.652155  7689 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.662236  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:21.664593  7688 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:21.665688  7688 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.666245  7688 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:21.666167  7683 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.664616  7689 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:21.663856  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.675834  7678 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:21.644906  7661 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.678594  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.678905  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.696686  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.697772  7690 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:21.698220  7690 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.698588  7690 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:21.699239  7645 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.680779  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.681080  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.681834  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.679265  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.682787  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.685616  7649 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.699867  7661 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.701483  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:21.701670  7691 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:21.708770  7683 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.700281  7642 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.703989  1595 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 13:00:21.706431  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.710918  2312 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:21.707223  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.708317  7649 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.713296  7645 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.708850  7691 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.714604  7691 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:21.679351  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:21.691018  7688 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.721731  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.722916  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.731143  7688 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.724521  7683 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:21.727176  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:21.723932  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 45426.5us
I20260709 13:00:21.732604  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:21.737113  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.738612  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.736157  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.738703  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.742461  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.743011  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.743286  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.743732  2312 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:21.742467  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.736102  7691 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.744756  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.742846  7683 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.749532  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.749843  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.750346  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:21.750938  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.751391  7671 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.751622  1745 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:21.746685  7691 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.752573  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.758605  1603 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:21.757826  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:21.758921  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61350.9us
I20260709 13:00:21.758291  7642 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:21.766652  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.765977  7679 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:21.767931  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.768236  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.767951  7679 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.769061  7679 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:21.769577  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.767977  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.773981  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.774955  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.773370  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.779136  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.779855  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.782078  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:21.785004  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:21.787460  7660 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:21.787930  7653 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.788113  7660 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:21.788445  7653 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.788655  7660 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.788717  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.788990  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.790616  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.783903  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.791994  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.792294  7653 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.798651  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.792666  7691 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:21.802242  7691 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.802978  7691 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:21.803797  7688 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:21.799014  7649 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:21.804283  7688 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.800731  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.801360  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.805742  7688 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:21.804479  7649 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.811071  7649 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.809664  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.813123  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.826229  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:21.828107  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:21.823964  7645 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.833405  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:21.830852  7671 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:21.838092  7671 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.838554  7671 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.839040  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:21.833176  7645 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.840862  7645 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.842912  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.843678  1599 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
I20260709 13:00:21.844934  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:21.846458  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.835706  7692 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:21.849632  7692 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.850200  7692 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.836112  7689 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.879354  7689 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.880244  7689 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.880702  7689 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:21.881089  7689 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.882575  7645 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.885182  7645 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.859005  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:21.896225  7652 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:21.896123  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 111673us
I20260709 13:00:21.896741  7652 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.897193  7652 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.898710  1752 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.899389  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:21.900224  7664 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.900650  7664 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:21.901000  7664 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.904058  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:21.904699  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:21.905759  7675 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:21.906177  7675 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.835421  7687 ts_tablet_manager.cc:1929] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:00:21.906553  7675 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.907076  7687 log.cc:1199] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: Deleting WAL directory at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0/minicluster-data/ts-1-root/wals/e85f5002455b4bc4bc385d3b81511511
I20260709 13:00:21.937716  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:21.855808  7679 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.945824  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:21.943717  7690 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.947651  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:21.969798  1672 raft_consensus.cc:606] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:21.964581  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.965482  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.972432  1674 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:21.966290  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.966403  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.965571  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:21.969105  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 135766us
I20260709 13:00:21.972327  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.973384  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.966432  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.974975  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:21.975764  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:21.978655  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.978662  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:21.982256  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:21.978988  7645 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.985811  7645 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:21.986330  7645 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.987353  7671 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:21.988863  2312 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:21.990485  7671 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.991789  7688 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.983974  7691 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.994707  7688 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.996460  7691 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.997066  7649 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:21.997797  7679 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.001124  7690 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.999850  7652 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.004777  7652 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.010198  7660 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.012146  7653 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.024610  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.026674  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.029290  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.030543  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.031828  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.033264  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.035681  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.056594  7649 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:21.990788  7664 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:22.070772  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 95970.8us
I20260709 13:00:22.073482  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:22.073890  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91797us
I20260709 13:00:22.074774  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.076351  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.076476  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.077497  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.078708  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.078945  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.079525  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.079929  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.080047  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.089052  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.106372  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.092455  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.108021  1669 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:00:22.102722  2313 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:22.089553  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.093286  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.087261  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.086863  7664 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.112529  7664 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:22.112864  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.113710  7652 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:22.113852  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.114111  7652 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.114648  7686 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:22.114997  7686 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.115077  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.004784  7694 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.088016  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.092293  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:22.124325  7669 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:22.125056  7694 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:22.126824  7694 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.128125  7660 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.096453  7692 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.131332  7689 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.133904  7689 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.112902  7664 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.135376  7664 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:22.097502  7645 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.119166  7652 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.115446  7686 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.082413  7675 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.088634  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
W20260709 13:00:22.144613  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56069us
I20260709 13:00:22.145668  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.146713  7649 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:22.104218  7653 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.147258  7649 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:22.147761  7696 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:22.148003  7649 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.148404  7696 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:22.148962  7696 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:22.154719  7675 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.147223  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.156723  7689 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:22.158780  2313 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:22.161293  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.124257  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.163277  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.163653  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.166105  7669 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:22.166240  1485 catalog_manager.cc:5028] TS 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): tablet e85f5002455b4bc4bc385d3b81511511 (table test-workload [id=bfa050fa16ac48e8abe15501c9df0afd]) successfully deleted
I20260709 13:00:22.166648  7669 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.167133  7669 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.167682  7695 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.165530  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.172497  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.176864  7642 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:22.177369  1672 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:22.178614  7676 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:22.179059  7676 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.180105  7676 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.181299  7676 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.183593  1641 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.165808  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:22.184532  1641 raft_consensus.cc:2686] T e85f5002455b4bc4bc385d3b81511511 P 1a40ab12c220464db732562e88c32c11: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:00:22.186199  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.186561  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.133937  7692 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.157196  7689 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:00:22.192318  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83761.3us
I20260709 13:00:22.193053  7695 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:22.190935  7683 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.190223  7675 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.197636  7689 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.217878  1752 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:22.215016  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.219453  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.210812  7695 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.231254  7695 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:22.228765  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.236107  7645 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.240502  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.241178  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.241259  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.246101  7694 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.251044  7649 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.250775  7652 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.253553  7649 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.249606  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.249912  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.264408  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.257995  1748 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:22.253786  7652 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.278196  7696 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.284642  1748 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:22.291802  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.294641  7671 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:22.295320  1751 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:22.295775  7669 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.297808  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.299422  7696 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.299930  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.300311  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.296196  7671 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:22.302956  7671 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:22.303444  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.294739  7686 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:22.306643  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 112601us
I20260709 13:00:22.266417  7694 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:22.336663  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.337822  7693 consensus_queue.cc:1059] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:22.318197  7664 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.345876  7686 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.319577  7653 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:22.323845  7652 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:22.315034  7696 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:00:22.328471  7683 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:00:22.304042  7671 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.313809  7660 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:00:22.315102  7689 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.323387  7701 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:22.378645  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 164930us
I20260709 13:00:22.379446  7660 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:22.375634  7652 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:22.378026  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46971.2us
I20260709 13:00:22.409940  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.418642  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.371986  7679 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.424772  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.356170  7669 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.372066  7649 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:22.376421  7683 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:22.375241  7653 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.374130  7664 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.386106  7671 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.419916  7702 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.385576  7689 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.434742  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.428556  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.429663  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.424252  7698 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.351461  7695 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.401060  7676 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:22.447988  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.448545  7676 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:22.451284  1748 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:22.454192  1748 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:22.384763  7701 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.457320  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.458159  7701 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.458679  2313 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:22.426106  7679 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:22.460229  7679 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.461809  1748 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:22.463001  7669 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:22.420972  7660 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:22.466061  7660 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.467284  1751 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:22.438212  7653 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:22.465277  7669 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.469086  7669 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:22.437192  7683 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.472662  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.472944  7683 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.474450  7683 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.463861  7642 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:22.475935  7676 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.468528  7653 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.477516  1744 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:22.477583  7653 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.478464  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.479112  1743 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.437331  7686 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:22.464995  1748 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:22.480118  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.470122  1751 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:22.483827  7676 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.471079  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.471511  7660 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.484989  2313 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:22.475936  1752 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:22.485383  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.463438  7695 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.492340  7676 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.493283  7652 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.494598  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.497797  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:22.498610  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64067.5us
I20260709 13:00:22.499379  1743 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:22.500013  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:22.500835  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 179774us
I20260709 13:00:22.504081  7696 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.497342  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.505319  7679 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.505963  7676 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.508086  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.514425  7676 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.516463  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.516825  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.518077  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.522154  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.518458  7696 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:22.524791  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.529034  7689 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:22.529697  7689 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.521749  7676 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.530185  7689 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:22.520596  7700 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.522001  7649 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:22.533699  7649 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.534111  7649 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:22.540642  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.541932  7664 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:22.542416  7664 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:22.542798  7664 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:22.544178  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.546504  7686 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:22.548372  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.550961  7700 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:22.551512  7700 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:22.552106  7700 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.559100  1673 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:22.551436  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.564786  7676 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.568116  7669 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.570799  7669 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:22.576884  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52105.5us
I20260709 13:00:22.609953  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.578503  7696 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:22.611780  7696 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.612344  7696 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.616346  7694 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:22.590327  7700 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.620023  7700 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.590596  7689 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.594843  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.626451  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.597282  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.627763  7698 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:22.628578  7698 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:22.629177  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.630304  7700 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.624238  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.631933  7690 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.633008  7700 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:22.633867  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.635776  7690 raft_consensus.cc:2764] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:22.633960  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.636732  1743 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:22.637168  7669 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:22.637163  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.639392  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.640043  7690 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:22.640553  7690 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.641453  7690 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:22.643208  7669 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:22.647303  7664 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.649901  7664 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.653913  7689 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.611771  7649 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.655242  7696 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.656836  7649 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.657055  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.658097  7694 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.658620  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.658823  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.659607  7694 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:22.659993  7694 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.660353  7694 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:22.661063  7669 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:22.663053  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.665177  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:22.668504  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:22.670047  7669 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:22.671820  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:22.673210  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.657569  7696 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.676936  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:22.677186  7694 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.680570  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.682366  1743 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:22.685742  1752 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:22.686004  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.686910  7696 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.688176  7696 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:22.687232  7694 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.690094  7669 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.688913  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.691061  7669 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:22.690140  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.692864  7696 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.694798  7690 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.695408  1599 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:22.695660  1600 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:22.695933  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:22.696874  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.697161  7690 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.697535  1602 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.699509  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:22.738072  1602 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:22.738816  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.740247  7669 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.745827  7690 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.741585  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.747040  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:22.748167  7690 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:22.748430  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.748664  7690 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:22.749145  7690 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.758376  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.758999  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.759303  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.759971  1672 raft_consensus.cc:2410] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:00:22.759886  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.760906  7669 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:22.761106  7675 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:22.762065  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.764180  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.769230  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.773196  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.773483  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:22.774412  1672 raft_consensus.cc:606] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:22.775162  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.776537  7678 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:22.777861  7700 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:22.778258  7700 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.779302  7700 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.780754  7700 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:22.780833  1674 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:22.787881  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.790311  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.779958  7690 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.791971  7675 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.793608  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.794539  7675 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:22.796253  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.797108  7675 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:22.798660  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:22.800179  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.800329  7690 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:22.802299  7675 raft_consensus.cc:2764] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:00:22.803977  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:22.804167  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:22.804951  7675 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.805692  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.806677  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:22.807107  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.807616  7675 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.809862  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.811945  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.813038  2313 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:22.814074  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.814652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.816351  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.818293  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.820771  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.821167  1752 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:22.823342  2311 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:22.820061  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.825464  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.827308  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.828356  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.829757  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.830542  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.833253  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.834146  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.833426  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.833271  1600 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:00:22.836439  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.837554  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.838444  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.832460  2312 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 7.
I20260709 13:00:22.840180  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.842331  1752 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:22.843056  1743 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:22.843863  1594 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:22.844065  1595 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:22.845501  1600 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:22.845819  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.846679  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.850031  1599 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:22.851095  1596 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:22.853202  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.854691  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:22.856405  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.861076  1752 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:22.869892  7678 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:22.870675  7678 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.874809  7678 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:22.883751  7678 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:22.885360  7700 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:22.885850  7700 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.886443  7676 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:22.886816  7700 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.888017  7700 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.889202  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:22.890112  7683 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:22.890697  7683 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.890550  7701 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:22.891907  7683 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.892827  7696 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:22.893244  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.894934  7682 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:22.894205  7642 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:22.888068  7676 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.900522  7676 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.902861  7694 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:22.903075  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.903602  7694 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:22.904266  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:22.904717  7694 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.905681  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:22.905829  7690 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:22.907596  7705 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:22.908552  7649 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.909603  7649 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:22.911347  7689 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:22.911859  7689 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:22.913007  7689 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.901806  7676 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.916533  7676 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.895206  7696 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:22.919806  7696 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:22.921214  7696 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.923615  7696 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.919881  7690 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:22.926213  7690 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.928052  7683 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:22.928610  7683 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.929888  7683 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.931658  7683 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:22.942317  7705 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:22.943766  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52772.1us
I20260709 13:00:22.945550  7689 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.948762  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.948977  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.949736  1599 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:22.952777  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.956595  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:22.958894  7642 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:22.959467  7642 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.959651  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.960664  7642 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.962167  7642 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.962467  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:22.963864  7705 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:22.965770  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.967437  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:22.970338  1751 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:22.971181  7682 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:22.972550  7682 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:22.972929  7682 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:22.975276  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:22.973973  7682 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:22.978506  7682 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.977106  7709 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:22.982858  1751 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:22.997143  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.036763  7706 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:23.049227  7706 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:23.049801  7706 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:23.050997  7706 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.053002  7706 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:23.035805  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57666.5us
I20260709 13:00:23.045498  1743 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:23.048008  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.062999  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.066910  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.073621  7711 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:23.065562  7671 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.078437  7694 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:23.069823  7642 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:23.092500  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:23.107347  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.107718  1674 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:23.110122  7652 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:23.110756  7652 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:23.124907  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56773.9us
I20260709 13:00:23.126230  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.132993  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.081935  7675 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:00:23.138203  7717 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:23.146273  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 70421.1us
I20260709 13:00:23.126971  2311 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:23.089618  7669 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:00:23.155092  7652 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:23.155509  7707 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:23.155845  7671 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:23.156035  7707 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:23.157135  7707 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.160331  7675 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:23.160876  7675 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.162386  7716 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:23.162952  7716 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.164103  7716 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.165732  7716 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:23.170691  7707 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.136605  7694 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:23.170974  7675 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.178411  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.185551  1677 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
W20260709 13:00:23.186810  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 116277us
I20260709 13:00:23.188555  7678 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:23.189832  7717 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.189999  7652 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:23.184554  7664 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:23.190968  7652 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.191928  7682 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:23.189855  7669 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:00:23.185177  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.197038  7698 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:23.198796  7678 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:23.201340  7682 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:23.209168  7682 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.209216  7717 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.210668  7682 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:23.213505  7652 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:23.214294  7652 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:23.215770  7664 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:23.216391  7664 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.217870  7664 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.229226  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.231580  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:23.236316  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 129115us
I20260709 13:00:23.237161  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.238030  1602 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:23.237186  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.241779  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:23.243430  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:23.245965  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:23.247278  7721 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:23.247820  7721 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.248786  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:23.248927  7721 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.250059  7721 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:23.245203  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:23.242611  7720 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.230798  7675 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:23.257762  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.251000  1500 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 12 to 13, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.267834  7669 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:23.268297  7724 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:23.268594  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.269420  7669 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:23.270675  1677 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:23.276298  7716 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:23.276862  7716 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.277186  1751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:23.277863  7716 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.279244  7716 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:23.263741  7664 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:23.263805  7719 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:23.285072  7652 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:23.285669  7652 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.286702  7652 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.288264  7652 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:23.277873  1751 raft_consensus.cc:606] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:23.294734   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:00:23.298471  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52297.6us
I20260709 13:00:23.297369   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:23.303982  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58847.1us
I20260709 13:00:23.305249  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:23.307988  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.309345  7727 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:23.312515  7719 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:23.315950  7722 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:23.316485  7722 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.316435  7721 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:23.302866  1641 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c468e528ecc447f9d2154d473a93b16. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:23.321012  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 64593.6us
I20260709 13:00:23.327484  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.330844  7720 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:00:23.331571  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.333514  7724 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:23.334015  7724 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.335628  7698 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:23.336158  7698 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.337265  7698 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.339056  7698 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:23.338554  7724 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.340960  7724 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:23.343916  7722 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.345721  7722 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:23.352592  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.355615  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.303022  7669 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.357395  7720 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:23.357031  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.359941  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.358156  7669 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.361979  7720 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:23.358909  7719 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.365868  7678 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:23.311244  7727 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:00:23.373744  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.373453  7730 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:23.380708  7719 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:23.381461  7664 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:23.390720  7664 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.391816  7664 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.382113  7730 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.388317  7678 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:23.394372  7730 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.395939  7730 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.378417  1672 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:23.415592  1677 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:23.419890  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54991.5us
W20260709 13:00:23.422406  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 115658us
I20260709 13:00:23.423177  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:23.424782  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.424747  1602 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:23.424157  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:23.428009  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.419196  1751 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:00:23.430485  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.432590  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:23.431696  7719 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.430804  7722 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:23.437516  7706 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:23.430528  7716 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:23.442233  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.443734  7721 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.442976  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:23.447999  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.448290  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.452071  7731 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:23.453190  7725 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.449244  7719 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:23.450098  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:23.452490  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.455353  7731 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.457088  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:23.457530  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.457995  7719 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.459581  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.460553  7731 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:23.464718  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.467286  7731 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:23.470283  1641 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46080b3c17204e34b7cfa66296431876. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.472239  7719 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:23.473480  7725 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:23.473896  7725 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:23.474941  7725 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.476141  7725 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:23.475942  7701 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:23.465061  7722 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.471395  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.476994  7701 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.477752  7719 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:23.477842  7664 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:23.480123  7701 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:23.482079  1599 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:23.482944  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.484170  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:23.484768  1751 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:23.484921  1602 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:23.486690  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:23.486866  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.489419  7682 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:23.489841  7682 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:23.490214  7682 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:23.492473  1751 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:23.493216  1602 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:23.494248  7719 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:23.495736  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.496713  7719 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:23.517102  1751 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:23.519421  7701 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:23.521132  7678 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:23.521610  7678 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:23.522676  7678 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.524250  7678 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:23.546905  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51272.1us
I20260709 13:00:23.496131  7715 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:23.548170  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.548935  7678 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:23.549566  7706 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:23.549664  7678 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.552139  7678 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:23.549590  7719 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:23.556541  7682 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.557112  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:23.557982  7720 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:23.558396  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.559059  7682 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:23.547120  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76868.1us
W20260709 13:00:23.562840  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.562747  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.559298  1751 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:23.565135  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:23.566006  1751 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:23.565747  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.566921  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:23.569597  1672 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.570250  1671 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:23.572623  2311 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:23.567792  1602 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:23.573948  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:23.575673  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.581440  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:23.582346  1594 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:23.583268  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:23.592950  1602 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 12: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:23.596510  1672 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:23.598901  1751 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:23.602926  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:23.606611  1670 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:23.608896  1751 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:23.610224  1752 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:23.613343  1673 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:23.568169  7698 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:23.591866  7682 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:23.592803  7730 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:00:23.633605  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.643167  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.644037  1751 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:23.645951  2312 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:23.646355  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.647059  1752 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:00:23.648176  2313 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:23.651265  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:23.651515  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:23.652179  1672 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:23.655421  1671 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:23.625005  7706 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:23.661031  2311 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:23.628729  7682 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:23.640920  7707 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:00:23.624684  7705 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:00:23.629088  7698 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.651408  7730 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.697827  7682 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:23.683895  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:23.659089  7700 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.681366  7720 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:23.724857  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.699684  7731 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:00:23.715785  7678 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:23.717909  7669 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:23.736122  1751 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:23.661841  7722 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:00:23.700280  7664 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:00:23.736110  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 114679us
I20260709 13:00:23.679772  7706 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:23.734387  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 74939.4us
W20260709 13:00:23.737185  7736 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 13:00:23.737890  7720 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:23.735724  7669 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:23.763593  1595 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:23.731691  7700 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:23.752912  7721 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:00:23.773554  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:23.737932  7678 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:23.794706  7678 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:23.795100  7700 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:23.780414  7701 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:00:23.789031  7719 raft_consensus.cc:993] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: : Instructing follower 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:23.791159  7652 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:23.799835  7652 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.760252  7669 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:23.804544  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55621.5us
I20260709 13:00:23.807338  7716 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:23.807883  7716 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.809170  7716 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:23.810959  7716 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:23.802536  7707 raft_consensus.cc:1081] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Signalling peer 1a40ab12c220464db732562e88c32c11 to start an election
I20260709 13:00:23.812008  7709 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:23.812466  7709 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:23.813745  7709 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:23.814401  7731 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:23.822580  7731 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:23.779090  7715 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index -1 to 13, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:23.823683  7731 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.781939  7720 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.795432  7678 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.815212  7709 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:23.817083  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:23.817951  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.846711  1743 raft_consensus.cc:2393] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 5: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:23.818746  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.818866  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:23.806799  7652 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.802616  7698 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.797443  7706 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:23.826269  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:23.852824  1752 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 24: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:23.778666  7722 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:23.854127  7722 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:23.864984  7722 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:23.866163  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:23.867200  2312 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 13:00:23.775436  7730 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:23.873692  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 99452.4us
I20260709 13:00:23.848235  7678 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:23.861277  7745 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:23.876678  7731 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:23.890710  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.878619  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:23.894297  2311 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 13:00:23.894681  7741 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:00:23.913763  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.918040  7678 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:23.919684  7745 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:23.889820  7740 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:23.936265  7745 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.938982  1677 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.940483  1673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46986
I20260709 13:00:23.947906  1673 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.948333  1673 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:23.951821  7707 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:00:23.960747  7707 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:23.961200  7707 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:23.962126  7707 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.964078  7749 ts_tablet_manager.cc:933] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:23.971534  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.946861  7678 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.987119  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 122739us
I20260709 13:00:23.978229  7707 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:23.997473  1677 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:23.951212  7720 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:23.984135  7678 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.007416  1673 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:23.964541  7709 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:24.031980  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:24.014097  7678 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.039637  1673 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.047415  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:24.049746  2309 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:24.054101  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:24.055145  1594 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:24.059321  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:24.040195  7750 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:24.046267  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:24.077087  1677 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:24.020017  7740 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:24.082847  7682 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.085255  7747 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:24.070166  7750 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:24.095157  7750 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.086429  7700 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:24.099781  7700 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:24.100296  7700 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:24.051332  7652 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:24.094252  1751 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:24.094033  1743 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index -1 to 13, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:24.125964  7722 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.128273  7669 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.131026  7669 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.133255  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:24.134020  1600 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:24.135679  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:24.146482  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:24.147792  1600 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:24.150336  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:24.151510  1672 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:24.154058  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:24.154886  2316 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:24.172186  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:24.261348  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:24.162859  7678 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.282440  7748 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:24.284349  7755 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:00:24.264423  7749 tablet_copy_client.cc:323] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:00:24.124208  7698 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:00:24.471448  7747 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.474493  7742 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:24.471448  7730 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.283082  7726 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:24.174645  1603 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index -1 to 13, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:24.502143  1751 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:24.471227  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:24.510213   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:24.574358  1751 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:24.578656  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 390455us
I20260709 13:00:24.515484  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:00:24.473428  7745 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.497713  7716 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.011s
W20260709 13:00:24.530337  7715 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.009s
I20260709 13:00:24.568341  7721 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:00:24.497069  7683 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.515866  7748 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.575780  1751 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.596553  1751 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:24.617309  7751 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:24.592458  7748 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:24.599526  7701 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:24.529526  7678 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.646620  1751 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:00:24.563009  7750 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.577647  7730 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.573861  7742 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.607738  7676 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:24.620157  7722 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.569047  7747 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.582382  7726 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.592325  7745 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.604552  7683 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.649667  7701 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.705343  1743 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:00:24.713824  1748 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:24.751467  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:24.712827  7773 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.722522  7701 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:24.653414  7751 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.704847  7676 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:24.754067  7768 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.768347  7761 ts_tablet_manager.cc:933] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:24.777535  7700 consensus_meta.cc:287] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.668s	user 0.020s	sys 0.014s
I20260709 13:00:24.767771  7722 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.756623  7664 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:00:24.797932  7768 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.803622  7772 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.804363  7772 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:24.792627  7652 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.007s
I20260709 13:00:24.805733  7768 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.806471  7770 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.806911  7772 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.807086  7770 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.807773  1595 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
W20260709 13:00:24.789296  7707 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.014s
W20260709 13:00:24.792615  7731 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.870s	user 0.016s	sys 0.004s
I20260709 13:00:24.786023  7715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 14) took 1354 ms. Trace:
I20260709 13:00:24.793650  7716 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.756054  7669 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:00:24.799103  7740 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.824476  7740 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.827143  7740 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:24.827782  7716 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.815027  7715 rpcz_store.cc:276] 0709 13:00:23.412641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.412928 (+   287us) service_pool.cc:224] Handling call
0709 13:00:23.440410 (+ 27482us) log.cc:844] Serialized 506 byte log entry
0709 13:00:23.558576 (+118166us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b540035df20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481402dbe 00007f948140d930 00007f948140d8d8 00007f948140d858 00007f948140d813 00007f948140ca9c 00007f94872f8626 00007f94872f2dd8 00007f94814497cb 00007f948144c2c0
0709 13:00:24.767402 (+1208826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21525,"raft.queue_time_us":29405,"raft.run_cpu_time_us":2169,"raft.run_wall_time_us":2171,"spinlock_wait_cycles":22441984,"thread_start_us":20976,"threads_started":1,"wal-append.queue_time_us":103585,"wal-append.run_cpu_time_us":4695,"wal-append.run_wall_time_us":1023418}
I20260709 13:00:24.836532  7716 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.777333  7773 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:24.830276  7765 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:00:24.814670  7780 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:24.838665  7773 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.838572  7780 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.841023  7676 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.841084  7780 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.832369  7770 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.842159  7678 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.831094  7751 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.842913  7683 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.843861  7682 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.848392  7747 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.849848  7706 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.850445  7706 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.852234  7786 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:24.871595  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:24.872020  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:24.873195  1752 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:24.873216  1743 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:24.874953  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:24.885533  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:24.883236  1748 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:00:24.904341  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:24.869216  7698 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.809568  7722 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.809204  7700 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.880520  7747 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.935907  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:24.899453  7716 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:24.901738  7770 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:24.939172  7721 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.939730  7779 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.903865  7715 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:24.911939  7676 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.915565  7780 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.924825  7706 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.967849  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:24.924525  7678 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:24.956509  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:24.923787  7731 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:24.980552  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:24.983137  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:24.983891  1670 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
W20260709 13:00:24.939234  7754 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:00:24.968994  2316 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:24.955080  1744 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:24.944214  7716 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.949916  7770 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.982430  2309 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:24.990998  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:24.933120  7698 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.984148  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:24.995498  1674 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:24.996351  7782 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.996973  7782 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.998342  7785 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:24.998952  7785 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.999748  7683 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.000290  7746 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.001312  7785 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.001140  7746 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.000344  7683 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.005553  7787 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.006754  7683 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.006434  7787 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:24.965839  7779 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.009755  7787 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:25.011443  7776 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:00:24.971844  7652 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.964371  7750 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:24.883769  7786 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.972353  7761 tablet_copy_client.cc:323] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:00:24.982314  7780 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.962296  7721 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.046612  7652 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.048688  7721 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.048942  7701 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.049973  7721 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.969733  7715 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.057397  7780 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:24.995641  7770 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:24.947145  7747 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.973601  7742 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:24.973953  7676 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:24.991238  7678 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.041738  7779 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.058960  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.060277  7730 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.062486  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.064302  7700 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:25.045295  7794 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:00:25.029352  7777 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:00:24.990490  7664 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:24.996004  7731 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:24.993587  7716 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:25.068347  1676 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:25.054207  7786 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.067342  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:25.114411  1671 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
I20260709 13:00:25.115111  2316 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 5.
W20260709 13:00:25.131816  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 64564.1us
W20260709 13:00:25.121353  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 130440us
I20260709 13:00:25.135470  7775 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.136200  7775 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.138437  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:25.138537  7775 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.139127  7786 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.064293  7652 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.141657  7709 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:25.143172  7709 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.143584  7709 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.143760  7747 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.145943  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:25.142616  7746 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.149184  7722 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.149770  7722 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.142278  7786 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.151247  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.157960  1600 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:25.153537  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.156230  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.156787  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 212) took 1897 ms. Trace:
I20260709 13:00:25.013411  7726 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.030812  7698 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.157437  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:25.156980  1595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3123) took 1316 ms (client timeout 1583 ms). Trace:
I20260709 13:00:25.176954  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:25.170688  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.177203  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:25.162926  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.181313  2313 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:25.176460  1496 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 16 to 17, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.196435  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:25.180151  1595 rpcz_store.cc:269] 0709 13:00:23.816629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.816774 (+   145us) service_pool.cc:224] Handling call
0709 13:00:25.133157 (+1316383us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400037d54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:25.133262 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211232512}
I20260709 13:00:25.199186  1596 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:25.181263  2316 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:25.051301  7701 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.066617  7750 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.230903  7750 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.067880  7745 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.197748  1496 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index -1 to 12, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:25.113646  7742 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.205641  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.129889  7715 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.175853  7778 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.175308  7786 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.125062  7730 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.208971  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.233439  7750 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.266000  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.266969  1744 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:25.209894  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.199641  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.210897  7700 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.197235  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:25.205513  7787 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.212445  7792 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.213174  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.199862  7775 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.213304  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.214459  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:25.215957  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:25.216184  7678 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.161254  7722 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.218701  2313 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:25.220310  7731 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.224692  1746 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:25.121539  7801 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.155143  7664 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.066246  7748 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.224042  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.229519  7676 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.280731  7772 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.291899  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.292212  7772 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.293061  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:25.068564  7782 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.258560  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.294560  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.295758  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.235013  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.296919  1595 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:25.296768  1600 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:25.298053  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.298841  1595 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:25.067164  7721 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.257939  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.216817  7709 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.173496  7746 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.120519  7803 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:25.208123  7789 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.162135  7652 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.272130  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.274575  2311 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 13:00:25.247001  7747 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.283201  1749 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:25.284143  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60183.3us
I20260709 13:00:25.285951  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:25.286598  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:25.287168  7799 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:00:25.329618  1596 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:25.289309  7800 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.289878  7788 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:25.290638  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.230104  7698 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.304015  1594 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:25.291397  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.273095  7787 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.310747  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.274951  7700 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.313413  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.278146  7707 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:25.275571  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 78363.1us
I20260709 13:00:25.319172  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.300987  7678 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:25.283746  7775 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.303453  7801 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.325388  7748 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.270615  7730 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.319639  7746 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.264941  7778 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.287818  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:25.329488  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.331039  1744 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.333115  1752 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.416574  1598 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:25.340480  1748 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.159654  1500 rpcz_store.cc:276] 0709 13:00:23.237879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.240602 (+  2723us) service_pool.cc:224] Handling call
0709 13:00:25.134793 (+1894191us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:23.433734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:23.434548 (+   814us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:23.434625 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:00:23.434657 (+    32us) tablet.cc:662] Decoding operations
0709 13:00:23.435240 (+   583us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:23.435392 (+   152us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:23.435444 (+    52us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:23.453293 (+ 17849us) tablet.cc:701] Row locks acquired
0709 13:00:23.453359 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:00:23.453575 (+   216us) write_op.cc:270] Start()
0709 13:00:23.453755 (+   180us) write_op.cc:276] Timestamp: P: 1783602023453501 usec, L: 0
0709 13:00:23.453792 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:00:23.455526 (+  1734us) log.cc:844] Serialized 541 byte log entry
0709 13:00:24.003184 (+547658us) op_driver.cc:464] REPLICATION: finished
0709 13:00:24.284659 (+281475us) write_op.cc:301] APPLY: starting
0709 13:00:24.509991 (+225332us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:24.806650 (+296659us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:24.806806 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:24.827783 (+ 20977us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:24.828156 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:00:24.828212 (+    56us) write_op.cc:312] APPLY: finished
0709 13:00:24.828540 (+   328us) log.cc:844] Serialized 25 byte log entry
0709 13:00:24.828773 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:24.828881 (+   108us) write_op.cc:454] Released schema lock
0709 13:00:24.828949 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:24.829450 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:24.829481 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":445,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":176309,"apply.run_cpu_time_us":19755,"apply.run_wall_time_us":554250,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":137037,"prepare.run_cpu_time_us":44655,"prepare.run_wall_time_us":119761,"raft.queue_time_us":220954,"raft.run_cpu_time_us":47949,"raft.run_wall_time_us":106869,"replication_time_us":549184,"thread_start_us":482520,"threads_started":4,"wal-append.queue_time_us":109812}]]}
I20260709 13:00:25.348531  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.281435  7792 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.346988  1601 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
W20260709 13:00:25.326932  7725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.005s	sys 0.022s
I20260709 13:00:25.382952  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.422897  1749 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:25.386756  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.388212  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.424079  1594 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 8: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:25.340766  7788 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.424531  7788 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:25.337028  7652 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.410662  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.265126  7742 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:25.417326  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 87933.1us
I20260709 13:00:25.384186  7696 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:25.417995  1674 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 13:00:25.391705  7678 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:25.423998  1671 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 13:00:25.341396  7787 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:25.425980  7725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.006s	sys 0.023s
I20260709 13:00:25.419624  7740 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.384588  7770 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.462093  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.341111  7800 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.432973  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:25.341326  7698 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.332175  7789 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.434553  7803 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:25.437237  1750 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.437740  7669 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.439626  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.478780  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:25.440323  7762 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.440832  7804 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.426271  7676 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:25.339689  7747 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.481222  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.428932  7664 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.391028  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.479092  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:25.481997  1748 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:25.482666  1599 raft_consensus.cc:2368] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:00:25.442101  7813 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:25.493461  1600 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:25.452771  7731 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:25.486564  1595 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:00:25.488660  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.473272  7750 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.498333  7678 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:25.499250  7806 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:25.499346  7747 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.485186  7676 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.500725  7814 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:25.503021  7800 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.492082  7804 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.505303  7778 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.505657  1746 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:25.549525  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60971.8us
I20260709 13:00:25.550686  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.473435  7740 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.508206  7745 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:25.506068  7716 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.485769  7786 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:25.444056  7696 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.473157  1687 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 46080b3c17204e34b7cfa66296431876 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:00:25.491736  7669 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.524011  7676 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:25.507525  7730 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.551723  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.505995  7746 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.500748  7721 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.522241  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.572103  1748 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.567770  1751 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.568197  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.577903  1597 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19.
I20260709 13:00:25.578804  2316 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 5.
I20260709 13:00:25.492507  7762 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.556547  7782 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.553719  7745 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.556349  7709 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.508420  7813 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.558701  7748 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:25.512950  7731 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:25.565898  7800 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.567520  7786 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:25.520025  7750 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.580812  7701 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:25.551029  7814 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.585140  7782 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.586825  7746 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:25.591383  7745 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:25.587154  7721 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.580608  1687 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 46080b3c17204e34b7cfa66296431876 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-46080b3c17204e34b7cfa66296431876
I20260709 13:00:25.693137  1674 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.693954  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.694656  1677 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:25.595968  7700 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.624651  7800 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.700044  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.626471  7701 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:25.705785  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.706246  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:25.706715  1594 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:25.653970  7740 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.657274  7696 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.658129  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:00:25.715466  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57448.7us
I20260709 13:00:25.715656  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.663993  7770 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.659924  7792 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.660399  7775 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.661084  1598 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:25.661173  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.727195  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.727684  1599 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:25.684821  7720 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.665220  7772 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.598903  7771 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.668964  7758 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.900s	user 0.003s	sys 0.000s
I20260709 13:00:25.670394  7652 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.672443  7801 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.675486  7786 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.609586  7815 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.600644  7748 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.683979  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.772461  2316 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:25.686622  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.773530  1752 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:25.774731  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.698402  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.727792  7740 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.734974  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.584172  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 3c468e528ecc447f9d2154d473a93b16 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:00:25.640812  7782 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.707072  1674 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.654667  7743 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:25.711279  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.807763  1751 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
W20260709 13:00:25.808101  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 240016us
I20260709 13:00:25.808866  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:25.809556  1751 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:25.699362  7721 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:25.699160  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.713380  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.814421  1748 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:25.713647  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.717170  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.658164  7698 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.720805  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.818241  1595 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:00:25.639268  7746 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.687368  7812 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.663827  7742 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.728730  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.665066  7669 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.728968  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.722481  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.854209  1746 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:25.743757  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.855171  1598 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:25.744688  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.687196  7709 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.699064  7730 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.743824  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.696192  7817 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.754491  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.714164  7701 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:25.766217  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:25.766868  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.770116  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.583451  7803 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.728768  7726 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.745296  7696 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.840247  7746 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:25.745620  7775 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.800928  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.679296  7707 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:00:25.816455  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99360.2us
I20260709 13:00:25.777908  7748 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:25.809371  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:25.836385  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:25.839946  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:25.844637  1594 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:25.845707  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:25.851214  1751 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:25.854038  1599 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:25.863924  2312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 620) took 1955 ms. Trace:
W20260709 13:00:25.819394  7736 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.120s	user 0.000s	sys 0.002s
I20260709 13:00:25.880496  1671 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:25.809965  7743 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.762715  7771 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:25.764602  7720 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:25.700851  1744 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:25.980921  2312 rpcz_store.cc:276] 0709 13:00:23.889033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.889208 (+   175us) service_pool.cc:224] Handling call
0709 13:00:23.900045 (+ 10837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.921109 (+ 21064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.921143 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.921709 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.057407 (+135698us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:24.057451 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.057543 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.668104 (+1610561us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:25.820574 (+152470us) raft_consensus.cc:1685] finished
0709 13:00:25.820609 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.844241 (+ 23632us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1988,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":14350,"spinlock_wait_cycles":38650240,"thread_start_us":135277,"threads_started":1,"wal-append.queue_time_us":764062}
I20260709 13:00:25.880239  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.803355  7740 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.843595  7789 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.852402  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 3c468e528ecc447f9d2154d473a93b16 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-3c468e528ecc447f9d2154d473a93b16
I20260709 13:00:25.836755  7821 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.918460  2309 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:25.878263  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:25.919582  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.936620  1672 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:25.861225  2311 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:25.983095  1595 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:25.864977  7800 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.796800  7815 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.992823  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:25.993455  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:25.998238  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 188927us
I20260709 13:00:25.860422  7822 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:25.859501  7716 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:25.985764  7770 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.865075  7762 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:25.915875  7721 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:25.860510  7820 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:26.001487  1746 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:26.010456  1751 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:26.014781  7771 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:26.014952  7825 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.015435  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:25.986397  7743 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.063010  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.063270  7716 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.918470  7726 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.047145  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.147130  1744 raft_consensus.cc:2368] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10.
I20260709 13:00:25.880278  7709 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.016587  7717 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:25.865185  7812 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.990820  7707 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.006661  7826 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:26.070168  7813 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:25.988713  7775 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:25.887061  7730 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.062858  7698 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:25.939459  7696 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.135812   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.138336  1748 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:26.043645  1641 leader_election.cc:400] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:00:26.187655  1745 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
W20260709 13:00:26.138604  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75710us
I20260709 13:00:26.188027  1641 leader_election.cc:403] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.145117  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.189129  1746 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 20.
W20260709 13:00:26.124833  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 133132us
I20260709 13:00:25.929049  7817 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:26.047602  7774 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:00:26.014822  7720 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:26.171991  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 293757us
I20260709 13:00:26.010190  7821 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.175899  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:26.176627  7823 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:00:26.177803  7709 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.138345  7750 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.212044  7730 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.214548  7821 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:26.215776  7797 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:00:26.215794  1600 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:26.158857  7726 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.216594  7738 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.217268  7738 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.070535  7770 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.186650  7698 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.158036  7771 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:26.219925  7698 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:26.220108  7771 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.220603  7771 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:26.221096  7775 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.221302  7770 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.147992  7814 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:26.204694  1750 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:26.225333  7696 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.233572  1744 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:26.196879  1687 tablet_copy_source_session.cc:215] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:26.235844  7814 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.236589  1749 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:26.236523  7814 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.239045  7814 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.239161  7817 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.241008  7738 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.201455  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.057570  7822 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:26.241811  1746 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:26.169363  7826 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.205560  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:26.206828  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 195809us
I20260709 13:00:26.248327  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:26.249323  7826 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:26.159912  7716 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.197680  7827 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:26.256888  7787 consensus_meta.cc:287] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.003s
I20260709 13:00:26.272029  7827 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.272256  7787 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.272873  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.274832  7827 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:26.274806  7787 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:26.275704  1747 raft_consensus.cc:2368] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6.
W20260709 13:00:26.284194  7834 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:00:26.285693  7748 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.202092  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:26.255295  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49791.1us
I20260709 13:00:26.256198  7750 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:26.256861  7804 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.243275  7822 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.290817  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3145) took 1004 ms. Trace:
I20260709 13:00:26.299602  1674 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 13:00:26.260993  7812 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.267890  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:26.271174  7815 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:26.289651  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99362us
W20260709 13:00:26.245991  7824 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.186s	user 0.000s	sys 0.003s
I20260709 13:00:26.293447  1748 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:26.296329  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.254333  7740 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.155228  7825 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:26.320070  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52355.5us
I20260709 13:00:26.247704  7789 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.323905  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:26.309504  7798 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:26.316211  1602 rpcz_store.cc:276] 0709 13:00:25.286724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.291652 (+  4928us) service_pool.cc:224] Handling call
0709 13:00:26.290564 (+998912us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54001a4354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:26.290741 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292531456}
W20260709 13:00:26.297024  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 95132.8us
I20260709 13:00:26.308532  7722 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:26.338532  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.332758  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:26.333112  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51606 (request call id 2) took 1200 ms. Trace:
I20260709 13:00:26.308943  7750 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:26.314994  7803 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.343887  1603 rpcz_store.cc:276] 0709 13:00:25.121045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.121190 (+   145us) service_pool.cc:224] Handling call
0709 13:00:26.320693 (+1199503us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54001e0fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481493735 00007f9486453d29 00007f947f9d21d4 00007f947f9d2162 00007f947f9d2091 00007f947f9d200c 00007f947f9d12c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:26.320947 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062649728}
I20260709 13:00:26.338711  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.363080  1641 leader_election.cc:400] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19.
I20260709 13:00:26.364153  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3021) took 1064 ms. Trace:
I20260709 13:00:26.365327  7747 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:26.362648  7740 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:26.330452  7792 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:26.373018  1747 rpcz_store.cc:276] 0709 13:00:25.279790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.282853 (+  3063us) service_pool.cc:224] Handling call
0709 13:00:26.334662 (+1051809us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54000fa354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:26.343856 (+  9194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176465792}
I20260709 13:00:26.372874  1641 leader_election.cc:403] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.379063  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.376081  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.294193  7774 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:26.377776  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.380108  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.312875  7771 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.344724  7836 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.340150  7798 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.380123  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.384308  1674 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 18: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:26.385053  2279 leader_election.cc:400] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10.
I20260709 13:00:26.385892  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.392685  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.393638  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.370332  7678 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:26.397116  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.372624  7803 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.370548  7775 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:26.367259  7731 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.372939  7750 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:26.369578  7822 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.405843  7822 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.405836  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:26.406535  7822 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.407464  7775 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.407656  7817 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.402329  7669 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:26.409338  7717 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.418648  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:26.389371  7798 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:26.388983  7815 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:26.388166  7836 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.393481  7804 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:26.383749  7722 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:26.394277  7676 consensus_meta.cc:287] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.807s	user 0.007s	sys 0.008s
I20260709 13:00:26.444628  7722 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.445150  7722 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.444815  7676 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.412827  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.378250  7792 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:26.399641  7829 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:00:26.409910  7788 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.006s
I20260709 13:00:26.416083  7817 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:26.424454  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet 813e209bb7f848ca8067e613c9ef43a1: Illegal state: Replica 693257b3078444e0bd26d3e82159d452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:26.424813  1744 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:00:26.425141  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.425540  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.418823  7669 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.415867  7775 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:26.429881  1688 tablet_copy_source_session.cc:215] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:26.430300  7772 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:26.418427  7821 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:26.431314  7701 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.432516  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.434487  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.434710  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.391793  7774 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.438944  7746 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.446946  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46080b3c17204e34b7cfa66296431876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.399292  7801 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:26.442809  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.414788  7803 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.469803  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.540738  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:26.446017  1676 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:26.469406  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.468441  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:26.460772  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.556501  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.631103  1670 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:26.399937  7840 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.554983  1745 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:26.447752  7731 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.529299  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:26.445677  7745 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.006s
W20260709 13:00:26.449553  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53089us
I20260709 13:00:26.583925  7817 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.447227  7676 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.650842  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.473418  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.501441  7770 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:26.554593  1751 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
W20260709 13:00:26.584862  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 221930us
W20260709 13:00:26.597808  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 73667.4us
I20260709 13:00:26.656168  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:26.527900  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:26.622138  7801 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.502262  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.440124  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.616952  7786 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:00:26.422902  7836 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:26.447670  7782 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
I20260709 13:00:26.622545  1602 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:00:26.478565  7696 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:26.421169  7717 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:26.571718  7842 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 13:00:26.632642  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.631148  2309 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.682056  7819 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.682788  7819 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.649967  1688 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:38702 (request call id 1366) took 1370 ms. Trace:
I20260709 13:00:26.683650  7782 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.683856  1688 rpcz_store.cc:276] 0709 13:00:25.339333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.405256 (+ 65923us) service_pool.cc:224] Handling call
0709 13:00:26.649855 (+1244599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260709 13:00:26.685689  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.686067  7782 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:26.686470  1674 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:26.686825  7696 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:26.688242  7800 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.689011  7800 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.629446  1678 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:26.693670  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:26.500913  7652 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:26.595978  7821 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.694520  1674 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.694751  7821 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:26.691385  7800 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.696388  7800 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.445585  7825 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.576752  7792 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:26.706161  7800 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.707794  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 6 to 7, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.555078  1743 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:26.501307  7838 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:26.721033  7838 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.722090  7803 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.502208  7716 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:26.647912  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 118728us
I20260709 13:00:26.649906  7664 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.724411  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.724756  7664 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.725382  7664 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.725458  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.727120  7716 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:26.726773  7826 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.652376  1675 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:26.451952  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.728842  1501 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.734688  1672 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:26.653095  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.621629  7669 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.501860  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.635994  7748 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.635900  7840 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.662765  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.672834  7746 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.648783  7731 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.673576  7722 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.659979  7740 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.687920  7696 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.529139  7815 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:26.700027  7749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c468e528ecc447f9d2154d473a93b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.440574  7804 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:26.694543  7652 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.701912  7747 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.705579  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 191) took 3075 ms. Trace:
I20260709 13:00:26.451001  7829 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.709574  7800 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.773445  1496 rpcz_store.cc:276] 0709 13:00:23.630631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.648848 (+ 18217us) service_pool.cc:224] Handling call
0709 13:00:26.705484 (+3056636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:25.492192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:25.506399 (+ 14207us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:25.506443 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:00:25.506467 (+    24us) tablet.cc:662] Decoding operations
0709 13:00:25.507052 (+   585us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:25.507152 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:25.507190 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:25.507493 (+   303us) tablet.cc:701] Row locks acquired
0709 13:00:25.507527 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:00:25.532249 (+ 24722us) write_op.cc:270] Start()
0709 13:00:25.554591 (+ 22342us) write_op.cc:276] Timestamp: P: 1783602025532162 usec, L: 0
0709 13:00:25.557129 (+  2538us) op_driver.cc:348] REPLICATION: starting
0709 13:00:25.643049 (+ 85920us) log.cc:844] Serialized 987 byte log entry
0709 13:00:26.206068 (+563019us) op_driver.cc:464] REPLICATION: finished
0709 13:00:26.407296 (+201228us) write_op.cc:301] APPLY: starting
0709 13:00:26.407400 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:26.426498 (+ 19098us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:26.426640 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:26.572267 (+145627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:26.604412 (+ 32145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:00:26.604464 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:26.611691 (+  7227us) log.cc:844] Serialized 33 byte log entry
0709 13:00:26.645631 (+ 33940us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:26.651462 (+  5831us) write_op.cc:454] Released schema lock
0709 13:00:26.653605 (+  2143us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:26.743706 (+ 90101us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:26.754604 (+ 10898us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":300112,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":159635,"apply.run_cpu_time_us":8596,"apply.run_wall_time_us":323465,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":190956,"prepare.run_cpu_time_us":4837,"prepare.run_wall_time_us":211509,"replication_time_us":623807,"thread_start_us":166039,"threads_started":2}]]}
I20260709 13:00:26.708799  2309 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
I20260709 13:00:26.703920  7717 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.783406  7717 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.554812  7772 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:26.786998  7772 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.788050  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:26.788619  7772 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:26.788105  7707 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.001s
I20260709 13:00:26.789527  7707 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.790993  1749 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:26.649405  7745 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.788928  1746 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.793257  7745 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.727849  7813 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:26.794260  7813 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:26.795480  1673 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:00:26.795290  7813 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.748435  7730 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:26.728165  7716 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.799291  7716 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:26.729070  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.450531  7726 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.735697  1747 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:26.716922  1674 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 6.
W20260709 13:00:26.803445  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 74433us
I20260709 13:00:26.804565  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.738154  1501 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 7 to 8, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:26.733770  7736 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:00:26.666011  7801 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:26.637744  7750 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.750051  1748 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
W20260709 13:00:26.752302  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.620679  7788 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:26.756464  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 93765.7us
W20260709 13:00:26.817775  7698 consensus_meta.cc:287] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.006s
W20260709 13:00:26.740876  7743 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 13:00:26.631227  7678 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:26.760411  1670 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:26.724424  7803 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.773934  7829 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:26.709285  1676 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:26.779726  7747 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.785522  7826 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.771390  7804 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:26.805531  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:26.872169  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66713.8us
I20260709 13:00:26.716835  7701 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.742861  7840 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.663355  7770 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.770005  7828 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:26.820766  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 153310us
I20260709 13:00:26.822434  1746 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:00:26.828876  2315 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.809791  7800 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.843111  1677 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:26.811298  7730 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:26.858271  7722 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.864279  7678 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.866930  7819 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.822402  7789 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:00:26.873943  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 2912) took 1029 ms. Trace:
I20260709 13:00:26.884485  1752 raft_consensus.cc:2368] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:26.894025  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:26.891284  7800 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.888458  7828 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.903728  7800 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.904085  7828 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.901459  1673 rpcz_store.cc:276] 0709 13:00:25.844633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.845300 (+   667us) service_pool.cc:224] Handling call
0709 13:00:26.873743 (+1028443us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54001833d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:26.873872 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869182208}
I20260709 13:00:26.907516  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:26.899335  7849 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:00:26.833727  7698 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.910154  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:26.847995  7743 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:26.912041  7750 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.900276  7707 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:26.931355  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:26.914986  7798 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.923789  7782 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:26.894636  7730 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.923182  7748 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:26.888406  7855 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:26.915656  7745 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:26.911470  7701 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:26.941651  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:26.946619  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 2827) took 1196 ms. Trace:
W20260709 13:00:26.943667  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 70366.6us
I20260709 13:00:26.941521  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:26.950736  1752 rpcz_store.cc:276] 0709 13:00:25.750110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.800595 (+ 50485us) service_pool.cc:224] Handling call
0709 13:00:26.946297 (+1145702us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54000d2d54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:26.946523 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147260800}
I20260709 13:00:26.945330  1641 leader_election.cc:400] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6.
I20260709 13:00:26.951771  1641 leader_election.cc:403] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.952111  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:26.951364  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.955633  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.943897  7855 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:26.956498  7855 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:26.958664  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.959790  1675 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.891641  7815 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:26.964906  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.960523  1752 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:26.967136  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.967371  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.968000  1747 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:26.968526  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.943342  7698 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:26.963068  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.963212  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.940119  7730 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:26.986627  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.939903  7789 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:26.969188  1751 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:26.989179  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:26.989879  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.962882  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:26.970495  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.972059  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:26.991726  1600 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.972059  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:26.979066  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.979887  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.993451  1749 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:26.993811  1597 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:26.981877  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:26.995095  2313 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:26.982977  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:26.985818  1743 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:26.993453  1594 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:27.000794  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:26.959967  7826 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 5. Current term is 6.
I20260709 13:00:26.961311  7722 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:27.002924  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:27.008008  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.007383  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.010069  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:27.010375  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:27.014240  2316 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.019120  1671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:27.022863  1671 raft_consensus.cc:606] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:27.023384  1671 raft_consensus.cc:614] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.024725  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:26.947988  7836 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:27.027072  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.030539  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.031270  1747 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:27.013311  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.022819  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:27.035337  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72515.8us
I20260709 13:00:27.035676  1673 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:27.036674  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.038127  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.039004  7745 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.044440  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.045222  1743 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:27.046072  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.046975  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.047606  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.048292  1678 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:27.049220  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.049813  1678 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:27.046619  1743 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.044615  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.051537  1751 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:27.032091  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:26.989204  7789 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.057667  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.057413  7664 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:27.058512  1672 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:00:27.057456  7825 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:27.158771  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.159037  7825 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.159811  7825 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:27.059825  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.158778  7774 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:27.162575  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 102861us
I20260709 13:00:27.162968  7774 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:27.163691  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.163903  7774 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.164682  7774 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:27.061189  7822 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
I20260709 13:00:27.177364  7822 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:27.179800  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.842s (SENT) [suppressed 19 similar messages]
I20260709 13:00:27.004772  7701 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.059150  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:27.182412  2312 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:27.183029  1599 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:27.184296  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.185177  1599 raft_consensus.cc:2368] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:27.165073  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.186906  1752 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:27.012339  7722 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.122121  1669 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:27.124570  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.198845  1671 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:27.018599  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:27.166554  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.018826  7731 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.006465  7740 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.986624  7813 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
W20260709 13:00:27.065568  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.190008  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.202533  1747 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:27.054400  7782 raft_consensus.cc:2764] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:00:27.218943  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53919.1us
I20260709 13:00:27.053807  7762 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:27.235586  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.236567  1595 raft_consensus.cc:2368] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:27.142124  7789 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:27.244065  7726 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.245280  7743 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:27.253726  7771 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:27.262511  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.309084  1748 raft_consensus.cc:2368] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25.
I20260709 13:00:27.264604  1672 raft_consensus.cc:2368] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10.
I20260709 13:00:27.265594  7742 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:27.266667  7731 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:27.316771  7731 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:27.318058  7731 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:27.319793  7742 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:27.306283  7848 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:27.322005  7848 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:27.328495  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.329496  1674 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:00:27.268937  7838 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.226431  7722 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.239368  7740 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.167294  7788 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:27.233544  7736 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:00:27.300261  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 2911) took 1447 ms. Trace:
I20260709 13:00:27.300994  7717 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:27.369416  7717 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:27.228660  7709 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:27.371816  7709 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.372382  7709 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.367357  1677 rpcz_store.cc:276] 0709 13:00:25.810016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.810184 (+   168us) service_pool.cc:224] Handling call
0709 13:00:26.272610 (+462426us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 13:00:27.255991 (+983381us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54003232d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:27.256174 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314234112}
I20260709 13:00:27.188980  7803 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:27.361958  7731 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.236202  2311 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.234599  7812 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:27.315526  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.425329  1671 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:27.453347  7822 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:27.353508  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91974.3us
I20260709 13:00:27.286813  7762 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.459686  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.460716  1672 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:27.311345  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.362532  7740 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:27.401880  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.454851  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.465998  1677 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:27.360842  7771 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:00:27.466038  1674 raft_consensus.cc:2368] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:27.446800  7788 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.456656  7812 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:27.490306  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.352344  1598 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:27.487460  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.499847  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.463481  7762 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:27.432556  7803 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:27.503103  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.464736  7798 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:27.524165  1677 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
W20260709 13:00:27.506242  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.507427  2315 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.614s	user 0.017s	sys 0.010s
I20260709 13:00:27.525321  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.525508  2315 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 13:00:27.510921  2316 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:27.503773  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.526839  1747 raft_consensus.cc:2368] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:27.528216  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:27.519498  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.525146  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:27.529520  2313 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.527824  1748 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:27.532217  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.532917  1597 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.537667  1671 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
W20260709 13:00:27.515573  1600 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.523s	user 0.020s	sys 0.015s
I20260709 13:00:27.538664  1600 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:27.541172  1751 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:27.541481  1599 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:27.543805  1743 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:27.544041  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:27.528017  7775 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.902s	user 0.023s	sys 0.009s
I20260709 13:00:27.566380  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.566979  1598 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:27.562647  2313 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
W20260709 13:00:27.567801  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 387975us
I20260709 13:00:27.571429  2315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36870 (request call id 630) took 1795 ms. Trace:
I20260709 13:00:27.527760  7843 raft_consensus.cc:2764] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:00:27.572782  2315 rpcz_store.cc:276] 0709 13:00:25.765663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.765832 (+   169us) service_pool.cc:224] Handling call
0709 13:00:27.546801 (+1780969us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540053fa54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:27.560570 (+ 13769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052685696}
I20260709 13:00:27.576054  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.493217  7788 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:27.578022  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.537285  7747 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:27.563894  7838 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.656183  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.568933  7813 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.652756  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.668334  1599 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.661773  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.672165  1677 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:27.664045  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.576936  7798 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:27.689354  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.680570  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.681699  7717 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.630219  7836 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.570293  7775 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:27.632473  7771 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.713900  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.731101  1674 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:27.769609  2279 leader_election.cc:400] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10.
I20260709 13:00:27.770218  2279 leader_election.cc:403] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.771140  7837 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 9. Current term is 10.
I20260709 13:00:27.709802  7744 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:00:27.776866  7861 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:00:27.792670  7770 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.794924  7652 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.796540  7848 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.799307  1750 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:27.680197  7838 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:27.688944  7813 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:27.819418  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.815225  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45854.3us
I20260709 13:00:27.701098  7798 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:27.831756  2279 leader_election.cc:400] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:27.837833  2279 leader_election.cc:403] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.839895  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.841009  1743 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:27.832312  1598 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
W20260709 13:00:27.842968  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 271253us
I20260709 13:00:27.688470  7812 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:27.844838  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.848030  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.846271  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.847119  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:27.853015  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:27.853772  1598 raft_consensus.cc:2368] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:27.836222  7744 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:27.774058  7771 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:27.849680  7678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.031s	sys 0.046s
I20260709 13:00:27.873379  1674 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:00:27.840548  7652 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:27.874598  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.875844  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.886202  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.847925  7742 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:27.858510  7664 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:27.865195  7669 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.119s	user 0.025s	sys 0.021s
I20260709 13:00:27.863716  7725 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:27.887995  1674 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:00:27.913225  1677 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:27.918159  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.916685  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.923982  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 2838) took 1499 ms. Trace:
I20260709 13:00:27.932065  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.945338  1744 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:27.933686  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.947780  1744 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:27.934751  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.903487  7822 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:27.935791  1743 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:27.937503  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:27.938182  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.943879  1750 rpcz_store.cc:276] 0709 13:00:26.424180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.425214 (+  1034us) service_pool.cc:224] Handling call
0709 13:00:27.923738 (+1498524us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540022abd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:27.923914 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860957952}
I20260709 13:00:27.932817  1599 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:27.935298  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:27.950045  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:27.951088  1674 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:27.951318  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:27.928839  7786 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.250s	user 0.018s	sys 0.005s
I20260709 13:00:27.956766  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:27.958246  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:27.952426  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 75100.6us
I20260709 13:00:28.038981  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.039793  1674 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:27.910846  7770 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:28.040642  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.031322  7725 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:28.043805  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.051383  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:28.029729  7821 consensus_meta.cc:287] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.265s	user 0.010s	sys 0.015s
I20260709 13:00:28.053519  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.060029  1674 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:27.957306  7822 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:28.042058  1669 consensus_meta.cc:287] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.743s	user 0.037s	sys 0.070s
I20260709 13:00:28.060949  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:28.033061  7761 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 1.110s	user 0.033s	sys 0.020s
I20260709 13:00:27.892122  7652 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.041806  7786 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19.
I20260709 13:00:28.029377  7836 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.074517  1675 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.111s	user 0.011s	sys 0.027s
W20260709 13:00:28.046547  7817 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.388s	user 0.018s	sys 0.028s
I20260709 13:00:28.086921  1675 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:28.069751  1669 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
W20260709 13:00:28.087145  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 230028us
I20260709 13:00:28.088141  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 2817) took 1038 ms. Trace:
I20260709 13:00:28.091428  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:28.046641  7800 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.142s	user 0.026s	sys 0.018s
I20260709 13:00:28.081158  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:27.945149  7669 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:28.118167  1597 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.006s
I20260709 13:00:28.097718  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.102869  7838 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.095233  7837 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.059928  7870 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:28.125701  1674 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:28.105783  7813 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:28.107422  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 2935) took 1166 ms (client timeout 1541 ms). Trace:
I20260709 13:00:28.125123  1594 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:00:28.108306  7798 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.064307  7744 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.110260  7771 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.114769  1673 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:00:28.115669  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:28.065974  7801 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.238s	user 0.026s	sys 0.026s
I20260709 13:00:28.171844  7801 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.174165  7801 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:28.116159  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.097565  7873 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:28.176733  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2805) took 1130 ms. Trace:
I20260709 13:00:28.177392  1673 rpcz_store.cc:276] 0709 13:00:27.046016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.046890 (+   874us) service_pool.cc:224] Handling call
0709 13:00:28.114461 (+1067571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.136129 (+ 21668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.176393 (+ 40264us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002fc450. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.176601 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454070144}
I20260709 13:00:28.119210  1597 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:28.088934  1669 rpcz_store.cc:276] 0709 13:00:27.049573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.198807 (+149234us) service_pool.cc:224] Handling call
0709 13:00:28.088063 (+889256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.051925  7869 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:28.049019  7725 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.120931  1670 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:28.053943  7788 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.130482  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:28.126472  1675 rpcz_store.cc:269] 0709 13:00:26.941244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.941374 (+   130us) service_pool.cc:224] Handling call
0709 13:00:28.107123 (+1165749us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b54002fc454. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.107305 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16101760}
I20260709 13:00:28.133671  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.134608  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.183394  1674 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:00:28.183485  1676 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:28.151503  7803 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:28.128509  7775 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.157050  7874 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:28.164758  7813 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:28.165618  7716 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.366s	user 0.012s	sys 0.007s
I20260709 13:00:28.211879  7716 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.214393  7716 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:28.166419  7722 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.007s
I20260709 13:00:28.215240  7722 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.217535  7722 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.218251  1600 raft_consensus.cc:2368] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:28.220033  1595 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:28.219633  7874 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.221493  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:28.221959  7874 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:28.222218  1595 raft_consensus.cc:2368] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:28.222958  7761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 413) took 4191 ms. Trace:
I20260709 13:00:28.223047  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.223465  7761 rpcz_store.cc:276] 0709 13:00:24.031633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.031896 (+   263us) service_pool.cc:224] Handling call
0709 13:00:24.799726 (+767830us) ts_tablet_manager.cc:934] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 13:00:26.370007 (+1570281us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:26.922627 (+552620us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:26.922805 (+   178us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:28.084708 (+1161903us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:28.208559 (+123851us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:28.222823 (+ 14264us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:28.222874 (+    51us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":61735,"tablet-copy.queue_time_us":660385,"thread_start_us":175684,"threads_started":2}
I20260709 13:00:28.225133  7761 tablet_copy_client.cc:806] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:28.225762  7761 tablet_copy_client.cc:670] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:28.227293  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.227974  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.228543  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.170003  1602 raft_consensus.cc:2368] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:00:28.170384  7838 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:28.230213  7838 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.169299  7669 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.232028  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.232810  7838 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:28.233189  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.234200  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.234262  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.237036  1595 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
I20260709 13:00:28.093814  7817 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:28.206521  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 53080.2us
I20260709 13:00:28.242683  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 2806) took 1196 ms. Trace:
I20260709 13:00:28.243155  1670 rpcz_store.cc:276] 0709 13:00:27.046355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.046664 (+   309us) service_pool.cc:224] Handling call
0709 13:00:28.242510 (+1195846us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540006e854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.242619 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467353984}
W20260709 13:00:28.244678  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3151) took 1289 ms (client timeout 1652 ms). Trace:
W20260709 13:00:28.245308  1602 rpcz_store.cc:269] 0709 13:00:26.955187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.955346 (+   159us) service_pool.cc:224] Handling call
0709 13:00:28.244429 (+1289083us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001b5154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.244612 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790404352}
I20260709 13:00:28.246662  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.207186  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:28.248390  1598 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:00:28.198328  7869 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.253660  7869 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.256001  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.259552  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.260115  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.260711  1673 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:28.065101  7821 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.228613  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:00:28.268373  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.272950  1673 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:28.274142  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.128476  7800 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:28.195371  7792 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.489s	user 0.011s	sys 0.006s
I20260709 13:00:28.277364  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.278973  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:28.280107  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 186861us
I20260709 13:00:28.291237  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:28.294512  1595 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:28.286329  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.287027  2314 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:28.295166  1675 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:00:28.287921  1745 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:28.199941  7828 consensus_meta.cc:287] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.295s	user 0.009s	sys 0.010s
I20260709 13:00:28.292750  1676 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:28.117239  7836 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.303020  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.304207  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.304926  1600 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:28.285045  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.062032  7770 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.309986  1596 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:28.282138  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.312935  1594 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:28.305830  1677 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:28.306701  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:28.290339  7762 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.014s
I20260709 13:00:28.314845  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:28.321431  1743 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:28.309794  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:28.322270  1595 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.319084  1675 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:28.324416  1566 leader_election.cc:400] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:28.324779  1566 leader_election.cc:403] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:28.301199  1598 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:28.312026  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.326709  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.327778  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:28.329138  7865 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:28.329422  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.330377  1673 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:28.329447  7742 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.325802  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.333666  1674 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:28.334250  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.335125  1600 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:28.328526  1598 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:28.160140  7822 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.336853  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:28.137380  7870 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.275749  7813 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.323899  7717 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:28.321200  7788 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:28.345299  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.346101  1600 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:28.329792  7865 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:28.342849  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.338624  1595 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:28.339530  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.349648  1677 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:28.352892  7836 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.354914  1595 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:28.356289  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:28.358796  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.359596  1595 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:00:28.359903  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.298302  7792 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.335397  7821 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.364638  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.361887  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.335772  7876 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:28.331138  7878 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:28.308818  7828 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.367424  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.331768  7762 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.370177  7838 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:28.377393  1672 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:28.368009  7772 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:28.369225  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.381316  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:28.384848  7761 tablet_copy_client.cc:538] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:28.366047  7880 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:28.387948  7880 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:28.388571  7880 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:28.389426  7813 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:28.392287  2311 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.937s	user 0.013s	sys 0.000s
I20260709 13:00:28.393031  2311 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:28.382139  7821 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:28.393821  7821 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.394281  7821 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:28.387720  7846 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:28.372910  7669 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:28.372771  7786 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:28.407290  7848 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:28.408344  1751 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:28.401702  7869 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:28.382723  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:28.401340  1749 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:28.380028  7740 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.011s
I20260709 13:00:28.406319  7652 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:28.406519  7828 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.395205  7722 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:28.367489  7788 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:28.378057  7730 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.367s	user 0.026s	sys 0.018s
I20260709 13:00:28.417025  7722 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:28.423312  7730 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.424098  7722 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:28.424793  7825 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.264s	user 0.072s	sys 0.067s
I20260709 13:00:28.425384  7825 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.408787  7669 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.427904  7669 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:28.427484  7865 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:28.429771  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.430613  1603 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:28.397590  7801 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:28.432571  7792 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.433254  7882 raft_consensus.cc:2764] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:00:28.410184  1641 leader_election.cc:400] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25.
I20260709 13:00:28.408447  7786 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:28.414202  1598 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:00:28.382429  7876 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:28.414630  7869 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.419288  7741 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:28.420447  7762 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:28.445495  7855 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.488s	user 0.029s	sys 0.022s
W20260709 13:00:28.450018  7789 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.118s	user 0.010s	sys 0.014s
W20260709 13:00:28.450997  7731 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.031s	user 0.015s	sys 0.007s
I20260709 13:00:28.437361  7870 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.414744  7871 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.434954  1641 leader_election.cc:403] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:00:28.436386  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:28.433643  7804 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.550s	user 0.024s	sys 0.036s
I20260709 13:00:28.377902  7838 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:28.409078  7772 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:28.491319  7838 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:28.492475  7772 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:28.413720  2311 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 422) took 1403 ms (client timeout 1638 ms). Trace:
W20260709 13:00:28.455888  7709 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.083s	user 0.012s	sys 0.008s
W20260709 13:00:28.495520  2311 rpcz_store.cc:269] 0709 13:00:27.010041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.018258 (+  8217us) service_pool.cc:224] Handling call
0709 13:00:28.409249 (+1390991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.496166  7709 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.497035  7804 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.498625  7709 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.501339  7762 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:28.502027  7762 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:28.451664  7869 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:28.505340  1602 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:28.439383  7829 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.555s	user 0.028s	sys 0.025s
I20260709 13:00:28.420644  7788 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.456797  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 2852) took 1474 ms. Trace:
W20260709 13:00:28.470831  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69093.9us
I20260709 13:00:28.508348  7846 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25.
I20260709 13:00:28.510171  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3152) took 1551 ms. Trace:
I20260709 13:00:28.554339  1603 rpcz_store.cc:276] 0709 13:00:26.958925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.959090 (+   165us) service_pool.cc:224] Handling call
0709 13:00:26.959401 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.431047 (+1471646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.509841 (+ 78794us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000938d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:28.510066 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3382580096}
I20260709 13:00:28.438184  7786 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.512140  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:28.516558  1749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 2851) took 1537 ms (client timeout 1851 ms). Trace:
I20260709 13:00:28.517372  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 2818) took 1295 ms. Trace:
I20260709 13:00:28.517539  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.559187  1677 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:28.523826  7828 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:28.446107  7855 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:28.531736  7726 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:28.417526  7740 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.579952  1602 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:00:28.537156  7722 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.584681  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:28.586380  7775 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:28.560554  7840 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.664s	user 0.023s	sys 0.004s
I20260709 13:00:28.549149  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:28.552950  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:28.590165  1743 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:28.553393  1750 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:28.556047  1641 leader_election.cc:400] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:28.591655  1641 leader_election.cc:403] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:28.545763  1745 rpcz_store.cc:276] 0709 13:00:26.981942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.055861 (+ 73919us) service_pool.cc:224] Handling call
0709 13:00:28.456543 (+1400682us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.456720 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406474624}
I20260709 13:00:28.557897  1672 rpcz_store.cc:276] 0709 13:00:27.222159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.486663 (+264504us) service_pool.cc:224] Handling call
0709 13:00:28.517209 (+1030546us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54001842d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.517314 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024551296}
I20260709 13:00:28.450610  7789 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:28.556614  1749 rpcz_store.cc:269] 0709 13:00:26.979599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.994489 (+ 14890us) service_pool.cc:224] Handling call
0709 13:00:28.516191 (+1521702us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400417b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.516482 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3163474304}
I20260709 13:00:28.544672  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:28.563225  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:28.551597  1599 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:28.565122  1671 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:28.574071  1596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3155) took 1607 ms (client timeout 2037 ms). Trace:
I20260709 13:00:28.504884  7804 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:28.577075  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.596062  2279 leader_election.cc:400] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:28.600981  1601 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:28.594139  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:28.602768  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46883.9us
I20260709 13:00:28.603039  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:28.604048  1675 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:28.503062  7762 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:28.595820  1596 rpcz_store.cc:269] 0709 13:00:26.966987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.967116 (+   129us) service_pool.cc:224] Handling call
0709 13:00:28.573733 (+1606617us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003b3b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:28.573971 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085335424}
I20260709 13:00:28.502478  7821 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.606421  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:28.604645  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.611413  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:28.611032  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:28.612304  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:28.612277  1743 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:28.606980  7812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.014s	sys 0.029s
I20260709 13:00:28.612818  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:28.619967  1678 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:28.579227  7792 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:28.618777  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:28.560063  7829 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.568420  7828 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.504640  7871 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.624668  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:28.608544  7846 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:28.625808  1748 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:28.628413  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:28.582629  7726 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.631039  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:28.624298  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 409) took 4816 ms. Trace:
I20260709 13:00:28.633009  7812 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:28.636487  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:28.640792  7740 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.642247  7722 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.645335  1743 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:28.616407  7701 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:28.648336  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:28.619493  7825 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.650445  1752 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:28.653657  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:28.595001  7840 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:28.659843  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:28.662098  7747 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:28.661994  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:28.629904  7741 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:28.674401  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:28.594269  7876 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.654311  7709 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:28.686213  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:28.687915  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:28.657013  7846 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:28.690153  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:28.690878  1597 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:28.692194  7774 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.527s	user 0.012s	sys 0.011s
I20260709 13:00:28.695263  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:28.658634  7701 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:28.675428  7740 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:28.705536  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:28.692777  7882 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.704517  7652 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:28.711293  7879 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:28.741060  7879 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.741550  7879 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:28.712327  7829 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.707389  7747 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:28.714143  7789 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.714670  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:28.646255  7749 rpcz_store.cc:276] 0709 13:00:23.799958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.800142 (+   184us) service_pool.cc:224] Handling call
0709 13:00:23.970677 (+170535us) ts_tablet_manager.cc:934] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 13:00:24.827301 (+856624us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4c00169280. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f76b13f 00007f947f72f2ab 00007f947f75cf3c 00007f947f75d461 00007f947f75d768 00007f94854e32eb 00007f9486408d3b 00007f9486403008 00007f9486402405
0709 13:00:26.698555 (+1871254us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:28.332998 (+1634443us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:28.343972 (+ 10974us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:28.535031 (+191059us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:28.560625 (+ 25594us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:28.605876 (+ 45251us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:28.616049 (+ 10173us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":118146,"spinlock_wait_cycles":6898560,"tablet-copy.queue_time_us":163132,"thread_start_us":162354,"threads_started":2}
I20260709 13:00:28.705742  7741 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:28.689440  7709 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:28.724171  7855 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.703245  7774 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.725749  7813 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:28.727093  7821 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.690743  7731 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:28.730782  7840 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:28.733628  7828 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:28.690611  7725 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:28.814561  1746 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:28.690088  7825 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:28.734225  7838 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.736646  7786 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.690352  7804 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:00:28.697765  7870 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.668344  7669 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:28.759346  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44723.8us
W20260709 13:00:28.766111  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.707145  7740 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.838376  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:28.759418  7890 log.cc:927] Time spent T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
I20260709 13:00:28.761436  7792 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:28.762190  7652 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.768153  7749 tablet_copy_client.cc:806] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:28.768420  7709 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:28.793906  7741 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:28.898178  7740 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:28.898288  7792 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:28.818857  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 206574us
W20260709 13:00:28.815860  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 199383us
I20260709 13:00:28.849429  7893 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.820019  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 114551us
W20260709 13:00:28.953788  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 115491us
I20260709 13:00:28.799993  7880 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:28.819501  7825 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:29.007393  7726 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.974869  7749 tablet_copy_client.cc:670] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:28.952163  7840 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:29.018371  7786 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.019913  7838 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:28.815519  7701 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.044306  7825 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.048943  7817 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.049044  7741 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.051680  7800 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.053076  1595 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:29.054557  7880 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.059223  7669 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.060602  7730 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.060956  7879 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.062695  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3157) took 2087 ms. Trace:
W20260709 13:00:29.031777  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 72439.5us
I20260709 13:00:29.063163  1601 rpcz_store.cc:276] 0709 13:00:26.974864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.975017 (+   153us) service_pool.cc:224] Handling call
0709 13:00:26.975387 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.603807 (+1628420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.062393 (+458586us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003b4a54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:29.062614 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3737642240}
I20260709 13:00:29.040555  7893 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.045562  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:29.046584  7786 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.119853  7786 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.122366  7786 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:29.039208  7869 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 13:00:29.123974  7869 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.126232  1674 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:29.125900  7792 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.127089  7792 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:29.048100  7774 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:29.068935  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.129186  1675 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 8: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:29.044723  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.044603  7846 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:29.131500  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86060.3us
I20260709 13:00:29.136351  7812 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:29.129817  7726 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.142834  7726 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.145278  7726 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.147421  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.148206  1675 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:29.148416  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 103788us
I20260709 13:00:29.152009  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.154418  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.154757  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.155434  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.155534  1677 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:29.155632  1602 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:29.156286  1600 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.157250  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.157998  1602 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.158775  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.159999  1594 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.159829  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.167507  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.161442  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.168329  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.169070  1594 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.168373  1672 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 6.
I20260709 13:00:29.169536  1596 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:29.127442  7899 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 13:00:29.127413  7869 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.168259  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.181746  1677 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:29.182142  1600 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.034592  7789 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:00:29.180023  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.184233  1669 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:00:29.185428  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.185451  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.186156  1676 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:29.187515  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.187867  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.188261  1673 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:29.188673  1598 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.192430  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:29.195607  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.181941  1675 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:29.177583  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.196656  1600 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:00:29.184898  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 153759us
I20260709 13:00:29.196864  1670 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:29.197917  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.196043  1669 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:29.167409  7840 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:29.174948  7838 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:29.146907  7846 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.215287  1676 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:29.198843  7879 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.202764  7717 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.224819  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.199769  7786 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.242308  1600 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:29.220670  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.218417  7761 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:00:29.248365  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.248998  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.249348  1598 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.259814  7903 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:29.261356  7893 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:29.263010  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.263898  7770 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:29.249377  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.233615  7717 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.270265  1596 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:29.270550  1673 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:29.270329  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.271142  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.271585  1600 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.268678  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.267647  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.271413  7904 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:29.281222  7904 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:29.281628  7904 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:29.282583  7903 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:29.337149  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70303.6us
I20260709 13:00:29.274945  7717 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.338809  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.282763  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.337481  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.341745  1641 leader_election.cc:400] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.283622  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:29.341090  1598 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.341969  1600 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:29.342139  1641 leader_election.cc:403] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.342459  7893 raft_consensus.cc:2764] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:00:29.347142  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:29.348505  1601 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:29.343196  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59697.1us
I20260709 13:00:29.322103  7701 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:29.334486  7871 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:29.360929  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.343762  7892 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:29.352111  7786 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.365875  1641 leader_election.cc:400] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.366426  1641 leader_election.cc:403] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.364024  7770 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.367156  7893 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.368396  1601 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:00:29.375953  1599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2654) took 1470 ms (client timeout 1541 ms). Trace:
W20260709 13:00:29.376509  1599 rpcz_store.cc:269] 0709 13:00:27.905892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.951021 (+ 45129us) service_pool.cc:224] Handling call
0709 13:00:29.375699 (+1424678us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001a4854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:29.375873 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148985600}
I20260709 13:00:29.383477  7812 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:29.362416  7701 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.379355  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:29.387068  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.388698  1641 leader_election.cc:400] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.387761  7789 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:00:29.390739  7701 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:29.391672  7904 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.392547  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:29.393622  7822 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.393947  7904 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.394387  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:29.395805  7848 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:29.396180  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:29.397215  7898 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:00:29.398805  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3178) took 1102 ms. Trace:
I20260709 13:00:29.358848  7740 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.399262  1595 rpcz_store.cc:276] 0709 13:00:28.296854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.373606 (+ 76752us) service_pool.cc:224] Handling call
0709 13:00:28.374448 (+   842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.053558 (+679110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.398514 (+344956us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54004092d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:29.398734 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560046464}
I20260709 13:00:29.402822  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.404073  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:29.376643  7825 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.409294  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2635) took 1541 ms. Trace:
I20260709 13:00:29.409855  1597 rpcz_store.cc:276] 0709 13:00:27.868301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.233979 (+365678us) service_pool.cc:224] Handling call
0709 13:00:29.409073 (+1175094us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400422054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:29.409225 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041084800}
I20260709 13:00:29.411223  1603 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:29.413055  1641 leader_election.cc:400] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:29.413913  1641 leader_election.cc:403] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.415684  7792 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.416430  7749 tablet_copy_client.cc:538] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:29.416535  7701 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:29.417443  7792 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:29.402558  7786 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:29.420060  7786 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:29.417465  7709 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.421105  7786 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.422521  7709 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:29.422780  7740 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:29.406123  7874 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:29.411327  7825 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:29.406108  7904 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:29.418604  7792 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.426164  7904 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:29.427781  7904 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.429250  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2839) took 1300 ms. Trace:
I20260709 13:00:29.429673  1678 rpcz_store.cc:276] 0709 13:00:28.129355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.129736 (+   381us) service_pool.cc:224] Handling call
0709 13:00:28.167066 (+ 37330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.620534 (+453468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.428917 (+808383us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54001d42d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:29.429177 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040991488}
I20260709 13:00:29.445937  1641 leader_election.cc:400] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:00:29.446473  1641 leader_election.cc:403] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.447816  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:29.510890  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.516887  7906 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:00:29.452379  7910 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:00:29.502800  7742 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 13:00:29.559087  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 111331us
I20260709 13:00:29.502213  7717 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:29.563412  1641 consensus_peers.cc:597] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3c15f4148e94b83a318e5a513f2f769. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:29.576952  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:29.577807  1744 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:29.577764  1752 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 13:00:29.579826  1744 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:29.580680  1748 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:29.580806  1602 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:29.579739  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:29.581812  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 124066us
I20260709 13:00:29.582194  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:29.583446  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.584235  1602 raft_consensus.cc:2368] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:29.585857  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:29.587224  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.587327  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:29.588538  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.590058  1603 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.590258  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:29.589862  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.592017  1597 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.562290  7893 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.594020  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.597123  1603 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:00:29.564237  7825 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:29.600625  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:29.605309  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.601137  1602 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:29.606938  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:29.607160  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:29.598109  7893 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:29.608215  7825 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.602597  7801 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:00:29.597966  7874 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:29.670580  1599 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:29.643563  7879 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:29.578310  7707 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:29.673601  2312 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 13:00:29.676955  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.677743  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.679245  7904 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:29.702551  1674 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.702364  7707 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.702615  7904 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.688859  1669 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:29.704111  1674 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:29.607870  7770 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.687319  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.704808  7707 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:29.689680  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.705472  1675 raft_consensus.cc:2368] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:00:29.687805  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.689334  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.694139  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.706444  1750 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:29.706696  1676 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.603415  7701 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:29.707798  7879 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:29.708344  7879 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:29.708314  7701 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.705761  1671 raft_consensus.cc:2410] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:00:29.689009  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.711061  7701 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:29.699982  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.707757  1673 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.711429  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.646943  2311 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.712131  1672 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:29.687762  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.688189  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.701468  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 232) took 5807 ms. Trace:
I20260709 13:00:29.718190  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.719007  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.720984  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.723948  1678 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.723946  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.725441  1670 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.704840  7904 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.724033  7722 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.689380  7825 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:29.726881  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.726931  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.766666  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.727324  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.768110  1749 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:29.727403  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.727921  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.769779  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.770468  1674 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.728590  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.730551  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.771961  1669 raft_consensus.cc:2368] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:00:29.772269  1676 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.731277  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.733546  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.734144  7722 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.734997  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.747861  7707 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.735474  7717 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.735709  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.736424  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.790781  1743 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:29.739152  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 125) took 5566 ms. Trace:
I20260709 13:00:29.739531  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:29.697203  7894 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.649s	user 0.002s	sys 0.009s
I20260709 13:00:29.755342  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.797658  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.798345  1670 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.680508  7893 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.758001  7743 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:29.756709  7874 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:29.734460  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.802248  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.803287  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.804051  1677 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.739948  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.804522  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.717566  1501 rpcz_store.cc:276] 0709 13:00:23.894492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.895317 (+   825us) service_pool.cc:224] Handling call
0709 13:00:29.701344 (+5806027us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:26.979875 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:26.980565 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:26.980613 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:00:26.980634 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:26.981277 (+   643us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:26.981364 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:26.981402 (+    38us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:26.981759 (+   357us) tablet.cc:701] Row locks acquired
0709 13:00:26.981779 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:26.981940 (+   161us) write_op.cc:270] Start()
0709 13:00:26.982072 (+   132us) write_op.cc:276] Timestamp: P: 1783602026981884 usec, L: 0
0709 13:00:26.982097 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:26.982967 (+   870us) log.cc:844] Serialized 1302 byte log entry
0709 13:00:28.058266 (+1075299us) op_driver.cc:464] REPLICATION: finished
0709 13:00:28.602366 (+544100us) write_op.cc:301] APPLY: starting
0709 13:00:28.608771 (+  6405us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:28.734057 (+125286us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:28.734217 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:28.971397 (+237180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:29.021217 (+ 49820us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:00:29.021295 (+    78us) write_op.cc:312] APPLY: finished
0709 13:00:29.021630 (+   335us) log.cc:844] Serialized 41 byte log entry
0709 13:00:29.021923 (+   293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:29.022065 (+   142us) write_op.cc:454] Released schema lock
0709 13:00:29.022128 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:29.022722 (+   594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:29.022763 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16378,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":503928,"apply.run_cpu_time_us":12435,"apply.run_wall_time_us":430317,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":158624,"prepare.run_cpu_time_us":3371,"prepare.run_wall_time_us":10795,"replication_time_us":1048373,"thread_start_us":406415,"threads_started":2,"wal-append.queue_time_us":34356}]]}
I20260709 13:00:29.774077  1675 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:29.774703  1750 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:29.805337  1674 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 7.
I20260709 13:00:29.776304  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:29.784602  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.806344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:29.785171  1678 raft_consensus.cc:2368] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:00:29.784999  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.807626  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.808784  1674 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.808827  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.789726  1748 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.792716  1745 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.757644  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:29.791893  1497 rpcz_store.cc:276] 0709 13:00:24.172934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.528991 (+356057us) service_pool.cc:224] Handling call
0709 13:00:29.738939 (+5209948us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:00:29.810205  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.799721  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.811008  1674 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.811136  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:29.812114  1748 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:29.813339  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:29.814764  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.800196  1641 leader_election.cc:400] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.800092  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.804672  1672 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:29.680470  7840 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:00:29.819918  1752 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.827831  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.830118  1641 leader_election.cc:400] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:29.830528  1641 leader_election.cc:403] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:00:29.828074  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51824.3us
I20260709 13:00:29.709988  7879 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.833837  1749 raft_consensus.cc:2368] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:29.805317  1669 raft_consensus.cc:2376] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16. Re-sending same reply.
I20260709 13:00:29.834002  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:29.834039  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.839861  1747 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:29.815959  1670 raft_consensus.cc:2376] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15. Re-sending same reply.
W20260709 13:00:29.840474  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82911.2us
I20260709 13:00:29.810004  1671 raft_consensus.cc:2376] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15. Re-sending same reply.
I20260709 13:00:29.836230  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.841580  1750 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:29.841846  1752 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:29.836395  1496 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 17 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:29.844604  1752 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:00:29.844547  1496 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.849458  1673 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.852825  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:00:29.853688  1672 raft_consensus.cc:606] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
W20260709 13:00:29.833577  7912 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:00:29.864583  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:29.866197  1747 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:00:29.836719  7770 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.858906  1496 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 18 to 19, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.862726  1676 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:29.882927  1496 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 15, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.885165  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.887981  1745 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:29.881508  7726 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:29.890726  7726 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:29.798802  7707 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.891814  7874 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:29.892061  7726 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.852739  7701 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:29.861838  7801 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:29.861186  7900 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:00:29.852349  7881 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:29.900904  7722 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:29.863268  7875 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:00:29.902357  7875 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:29.902827  7875 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:29.904163  7875 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:29.905831  7875 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.846762  7904 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:00:29.856550  7848 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.908619  7848 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:29.909224  7848 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:29.910754  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.914808  1750 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:00:29.921209  1743 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:29.885506  1496 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.983188  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:29.834597  7846 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:00:29.880034  7879 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:29.987617  1752 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:00:29.846235  7910 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:00:29.989756  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:29.998117  1745 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:29.910400  7770 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.012828  7749 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:00:30.013808  7770 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:29.975322  1496 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 reported cstate change: config changed from index -1 to 13, term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to <none>, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 15 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:30.014478  7770 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.005517  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:30.029232  1745 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:30.015316  1496 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.015012  7770 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.043810  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:30.043094  1496 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 11 to 12, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:30.064018  1496 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:30.067473  1496 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 19 to 21, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 21 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:29.996179  7786 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:30.089751  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.042946  7789 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:30.058382  7881 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:30.057693  7717 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:30.049722  7843 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.136124  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 385973us
I20260709 13:00:30.042326  7893 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:30.134922  7789 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:30.156982  1671 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:30.155278  1676 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:00:30.140643  7717 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:30.187675  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 13:00:30.184279  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 354242us
I20260709 13:00:30.189385  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.194347  1671 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:30.194564  1641 leader_election.cc:400] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:30.194914  1641 leader_election.cc:403] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:30.196264  1671 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:30.142309  7892 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:30.198025  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 365757us
I20260709 13:00:30.201555  1673 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:30.200598  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:30.145618  7877 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.205639  2315 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:30.208823  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:30.116204  7786 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:30.180186  7846 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:30.224831  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:30.226155  1752 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:30.230818  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:30.232239  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:30.232134  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:30.230737  1671 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:30.141636  7881 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.241163  1595 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 23: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:30.245810  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:30.143153  7843 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.214802  7846 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:30.260097  1599 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:30.285485  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.287883  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:30.293498  1595 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:30.266604  7924 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:30.282583  7922 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:00:30.254470  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:30.253211  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.255391  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:30.273622  7786 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:30.277889  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.278612  7900 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:30.212991  7892 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.279608  7717 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.260012  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:30.299777  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:30.336717  2315 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 9.
I20260709 13:00:30.282069  7846 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:30.214000  7877 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:30.358142  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58423.7us
I20260709 13:00:30.303606  7879 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:30.370004  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:30.371192  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 133243us
I20260709 13:00:30.265977  7789 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:30.387926  7789 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:30.375818  7910 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:30.415400  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:30.408595  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:30.409803  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.417834  1597 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:30.373271  7926 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:30.384227  7840 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:30.330508  7924 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.434643  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:30.436033  1750 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:00:30.443859  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:30.439708  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:30.440469  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:30.434410  1752 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:30.448019  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:30.450316  1746 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:30.394030  7846 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:30.453543  1750 pending_rounds.cc:85] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 7
I20260709 13:00:30.438890  1595 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:00:30.475914  1750 pending_rounds.cc:107] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:00:30.476621  1750 raft_consensus.cc:2889] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:30.498193  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.508147   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:30.508834  1597 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:30.510816   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:30.411234  7770 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:30.569279  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.585987  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:30.412443  7910 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:30.602447  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.605069  2315 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:30.586081  7871 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.611181  2310 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:00:30.611579  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.636824  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.422626  7922 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.176s
I20260709 13:00:30.503852  7926 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:30.419268  7900 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.187s
I20260709 13:00:30.517171  7893 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:30.517491  7840 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:30.653462  7871 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:30.685056  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 305703us
I20260709 13:00:30.630125  7869 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:30.669716  7929 log.cc:927] Time spent T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.390s	user 0.000s	sys 0.002s
I20260709 13:00:30.723500  1750 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:00:30.732848  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.666378  7786 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:30.756783  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:30.721891  7881 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:30.739459  7893 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:00:30.740653  7875 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.834s	user 0.015s	sys 0.003s
I20260709 13:00:30.740310  7786 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:30.780018  1566 leader_election.cc:336] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.731s (SENT)
I20260709 13:00:30.766736  7922 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.767117  7903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.027s	sys 0.033s
I20260709 13:00:30.731276  7869 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.826268  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:30.806424  7893 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:30.827335  2309 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
W20260709 13:00:30.818640  7903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.034s	sys 0.035s
I20260709 13:00:30.823848  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:30.837473  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:30.836622  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:30.837970  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.827343  7877 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:30.840404  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.838394  1678 raft_consensus.cc:2376] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15. Re-sending same reply.
I20260709 13:00:30.838194  1672 raft_consensus.cc:2376] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16. Re-sending same reply.
I20260709 13:00:30.843468  7877 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.843884  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:30.844071  7877 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:30.844986  7928 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.447s	user 0.000s	sys 0.002s
I20260709 13:00:30.846361  7877 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:30.847189  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2884) took 1114 ms. Trace:
I20260709 13:00:30.847397  7871 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:30.824859  7892 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:30.847711  1674 rpcz_store.cc:276] 0709 13:00:29.749587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.830844 (+ 81257us) service_pool.cc:224] Handling call
0709 13:00:29.831194 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.846394 (+ 15200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.846436 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.861723 (+ 15287us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.211941 (+350218us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:30.419884 (+207943us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.420211 (+   327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.420318 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.846959 (+426641us) raft_consensus.cc:1685] finished
0709 13:00:30.846982 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.847118 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47275,"prepare.queue_time_us":475595,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":191577,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":56580,"thread_start_us":513527,"threads_started":2,"wal-append.queue_time_us":405989}
I20260709 13:00:30.849313  7801 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:30.849756  7801 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:30.850713  2314 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:30.850620  7801 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:30.853001  7918 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.640s	user 0.002s	sys 0.000s
I20260709 13:00:30.853315  7955 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.842257  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:30.853767  7955 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:30.834414  7935 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.436s	user 0.001s	sys 0.001s
I20260709 13:00:30.830960  7843 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:30.756011  7910 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:30.864868  7801 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:30.866335  7930 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:00:30.867013  7923 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:00:30.867645  7933 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:00:30.868235  7931 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 13:00:30.868784  7927 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:00:30.821126  7840 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:30.822958  7922 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:30.857475  7955 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.876161  7951 ts_tablet_manager.cc:933] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:30.872169  7893 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:30.881916  7910 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:30.889940  7945 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:00:30.881623  7924 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:30.833735  7786 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:30.829061  7926 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:30.902062  7922 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:30.907438  7893 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:30.933100  7953 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:30.958948  7955 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:30.889994  7881 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:30.969653  7951 tablet_copy_client.cc:323] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:00:31.268494  7932 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:31.268996  7955 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.269482  7932 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:31.269898  7917 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.258s	user 0.005s	sys 0.007s
I20260709 13:00:31.270632  7956 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.002904  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.037534  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.148491  1603 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:00:31.229308  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.044185  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.071878  7744 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:31.074873  7789 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.007s
I20260709 13:00:31.010183  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 841) took 1242 ms. Trace:
I20260709 13:00:31.271986  7956 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:31.014564  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1338) took 1099 ms. Trace:
W20260709 13:00:31.020313  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.009012  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 191406us
I20260709 13:00:31.278843  7744 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.015877  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 2887) took 1278 ms. Trace:
I20260709 13:00:31.049996  1670 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:31.068159  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.249936  1752 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:31.009064  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2880) took 1276 ms. Trace:
I20260709 13:00:31.189375  7840 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:31.035650  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:31.291033  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.288126  1752 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:31.062422  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.292403  7925 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:31.266894  7922 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.295287  1752 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.295696  7922 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.295527  7925 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.297077  1752 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.299068  7925 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.299356  7897 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:31.010140  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2881) took 1277 ms. Trace:
I20260709 13:00:31.290834  7840 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:31.018077  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 175769us
W20260709 13:00:31.310946  1566 leader_election.cc:336] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.913s (SENT)
I20260709 13:00:31.311826  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:31.303968  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.186174  7879 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.279244  1602 rpcz_store.cc:276] 0709 13:00:29.767512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.770736 (+  3224us) service_pool.cc:224] Handling call
0709 13:00:29.771094 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.771990 (+   896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.772024 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.772548 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.221606 (+449058us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:30.221692 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.221791 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.009377 (+787586us) raft_consensus.cc:1685] finished
0709 13:00:31.009440 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.009891 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":14801,"thread_start_us":388609,"threads_started":1,"wal-append.queue_time_us":788393}
I20260709 13:00:31.153414  7881 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.266978  7924 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.302755  1677 rpcz_store.cc:276] 0709 13:00:29.732428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.829088 (+ 96660us) service_pool.cc:224] Handling call
0709 13:00:29.829407 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.829782 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.829814 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.844125 (+ 14311us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.348306 (+504181us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:30.708644 (+360338us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.810287 (+101643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.810416 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.009480 (+199064us) raft_consensus.cc:1685] finished
0709 13:00:31.009541 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.009906 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36357,"prepare.queue_time_us":393251,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":102287,"raft.run_cpu_time_us":520,"raft.run_wall_time_us":21072,"spinlock_wait_cycles":7424,"thread_start_us":840683,"threads_started":3,"wal-append.queue_time_us":540883}
W20260709 13:00:31.306325  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.223069  7828 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:31.308169  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet c3c15f4148e94b83a318e5a513f2f769 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:00:31.055403  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:31.279992  1745 rpcz_store.cc:276] 0709 13:00:29.915022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.030234 (+115212us) service_pool.cc:224] Handling call
0709 13:00:30.091489 (+ 61255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.108575 (+ 17086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.108642 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.123805 (+ 15163us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.293899 (+170094us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:30.293965 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.294069 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.013694 (+719625us) raft_consensus.cc:1685] finished
0709 13:00:31.013753 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.014230 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":22272,"thread_start_us":147804,"threads_started":1,"wal-append.queue_time_us":239856}
I20260709 13:00:31.284869  1748 rpcz_store.cc:276] 0709 13:00:29.737645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.834181 (+ 96536us) service_pool.cc:224] Handling call
0709 13:00:29.834555 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.835102 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.835134 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.846780 (+ 11646us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.203271 (+356491us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:30.203334 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.203434 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.014966 (+811532us) raft_consensus.cc:1685] finished
0709 13:00:31.015033 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.015526 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9475,"thread_start_us":310878,"threads_started":1,"wal-append.queue_time_us":515733}
W20260709 13:00:31.316221  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.206748  7848 consensus_meta.cc:287] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 1.225s	user 0.013s	sys 0.006s
I20260709 13:00:31.324219  7848 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.324388  7828 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.329738  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet c3c15f4148e94b83a318e5a513f2f769 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-c3c15f4148e94b83a318e5a513f2f769
I20260709 13:00:31.324990  7789 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:31.337800  7701 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:31.338361  7701 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:31.338016  7924 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.344802  7955 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:31.345783  7955 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.332734  7879 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.350994  7952 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:31.351948  7952 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:31.357698  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46219.8us
W20260709 13:00:31.358265  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.360638  2312 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:31.337280  7840 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.330644  7922 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.334013  7956 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:31.276754  7932 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.354846  7952 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.363828  7926 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.288267  1675 rpcz_store.cc:276] 0709 13:00:29.732193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.827951 (+ 95758us) service_pool.cc:224] Handling call
0709 13:00:29.828327 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.117459 (+289132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.118207 (+   748us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.118845 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.249270 (+130425us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.429096 (+179826us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.429423 (+   327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.429535 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.007886 (+578351us) raft_consensus.cc:1685] finished
0709 13:00:31.007996 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.008631 (+   635us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42538,"prepare.queue_time_us":490495,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":209668,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":51963,"thread_start_us":570572,"threads_started":3,"wal-append.queue_time_us":383962}
I20260709 13:00:31.365684  7789 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.375917  7789 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.378582  7789 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.372504  7701 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:31.373338  7926 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.384364  7701 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:31.369757  7828 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.364180  7925 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.393985  1752 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:31.385123  7922 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.386050  7881 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.394482  1752 pending_rounds.cc:85] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 6
I20260709 13:00:31.403808  1752 pending_rounds.cc:107] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:31.404556  7925 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.464812  7925 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.406213  7932 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:31.466409  7893 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.018s
I20260709 13:00:31.406764  7955 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.396274  7879 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.401762  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.404326  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.469194  1752 raft_consensus.cc:2889] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.468531  7707 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:31.395258  7947 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:00:31.470450  7922 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.492285  7922 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:31.496152  7801 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.618s	user 0.020s	sys 0.004s
I20260709 13:00:31.499872  1688 tablet_copy_source_session.cc:215] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:00:31.502054  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 100222us
I20260709 13:00:31.517274  7950 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.519827  7922 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.520637  7922 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:31.523855  7897 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:31.525792  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 151633us
I20260709 13:00:31.526814  7922 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.528918   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:31.526266  7707 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:31.501981  7744 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.507472  7848 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.508319  7926 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.515677  7924 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:31.538475  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 167340us
I20260709 13:00:31.541391  7722 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:31.541911  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.556406  2312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36870 (request call id 650) took 1398 ms. Trace:
I20260709 13:00:31.580869  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.552515  7717 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.582453  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:31.588547  7744 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:31.559938  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:31.580729  2312 rpcz_store.cc:276] 0709 13:00:30.157845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.158059 (+   214us) service_pool.cc:224] Handling call
0709 13:00:31.556113 (+1398054us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400550fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:31.556292 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644557056}
I20260709 13:00:31.599397  7707 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:31.600061  7707 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:31.566493  7892 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.576772  7968 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.552385  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.601831  7968 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.603003  7926 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:31.561501  7786 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:31.604012  7926 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:31.606251  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54138.1us
I20260709 13:00:31.607570  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.608933  7840 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:31.609530  7969 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:31.612071  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3199) took 1172 ms. Trace:
W20260709 13:00:31.612726  2314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36870 (request call id 651) took 1435 ms (client timeout 1753 ms). Trace:
I20260709 13:00:31.612555  1603 rpcz_store.cc:276] 0709 13:00:30.439580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.441375 (+  1795us) service_pool.cc:224] Handling call
0709 13:00:30.442149 (+   774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.291364 (+849215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.611502 (+320138us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54004092d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:31.611994 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620126976}
W20260709 13:00:31.613294  2314 rpcz_store.cc:269] 0709 13:00:30.177344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.177553 (+   209us) service_pool.cc:224] Handling call
0709 13:00:31.612296 (+1434743us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54006815d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:31.612531 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407162112}
I20260709 13:00:31.615761  2311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 649) took 1462 ms. Trace:
I20260709 13:00:31.616307  2311 rpcz_store.cc:276] 0709 13:00:30.153742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.191063 (+ 37321us) service_pool.cc:224] Handling call
0709 13:00:30.246840 (+ 55777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.332796 (+ 85956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.338289 (+  5493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.347381 (+  9092us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:30.364822 (+ 17441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.615206 (+1250384us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b54004a2c54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:31.615285 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.615519 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107977472}
I20260709 13:00:31.572631  1641 leader_election.cc:400] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:00:31.618923  7910 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:31.619643  7910 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.622018  7910 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:31.623461  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51184.1us
I20260709 13:00:31.600587  7707 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:31.631477  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:31.564500  7869 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.636020  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:31.637742  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:31.640555  7869 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.641719  1674 raft_consensus.cc:2368] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:31.641294  7869 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:31.644035  7869 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.648260  7926 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.652268  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.617175  7968 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:31.661278  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60237.3us
I20260709 13:00:31.664055  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:31.665333  7788 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:31.673442  1641 leader_election.cc:400] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17.
I20260709 13:00:31.673733  1752 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
W20260709 13:00:31.679636  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72271.8us
W20260709 13:00:31.684680  7749 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:00:31.685048  7951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c15f4148e94b83a318e5a513f2f769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:31.686406  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:31.698933  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.701176  2279 leader_election.cc:400] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:31.702267  2279 leader_election.cc:403] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.703263  7968 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:31.709887  7892 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.711897  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.714141  7761 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:31.715526  7788 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:31.719107  7701 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.720988  7761 tablet_bootstrap.cc:492] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:00:31.722440  7761 ts_tablet_manager.cc:1403] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 2.504s	user 0.057s	sys 0.048s
W20260709 13:00:31.723166  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.723199  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.706323  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:31.716584  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 50564.7us
I20260709 13:00:31.726100  7892 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9.
I20260709 13:00:31.727737  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.731321  7968 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:31.732043  7707 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.732148  7968 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.734668  7926 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:31.734849  7968 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.735415  7926 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:31.737429  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.737905  7926 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:31.738835  7701 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:31.740042  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.740695  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.741562  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.742677  7968 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.743702  7968 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:31.746908  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.748515  7968 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.754854  7701 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:31.767400  7843 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:31.768754  7707 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:31.775615  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.775502  1566 leader_election.cc:400] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:00:31.777380  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.776559  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:31.783670  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.786947  7926 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:31.781896  7717 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.788090  7786 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:31.791600  1603 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:00:31.791862  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:31.793347  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.795775  7926 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:31.796653  7926 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.799202  7926 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.800791  2311 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:31.800945  7788 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:31.802371  7968 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:31.803149  7968 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:31.805373  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44628.9us
I20260709 13:00:31.806556  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:31.779247  7701 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:31.771251  7761 raft_consensus.cc:359] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:31.811321  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.834993  7761 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:00:31.813503  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:31.817868  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.822919  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.836444  1750 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:31.835970  7761 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:31.836910  1747 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:31.820426  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.837865  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.837918  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.838120  1744 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:31.808840  7722 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:31.828118  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.839157  7722 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.821237  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.839485  1746 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:31.839344  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.835986  1751 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.844895  7968 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.828800  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.846140  1743 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:31.840504  1603 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:31.834218  1599 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:31.843947  1749 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:31.821281  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:31.838688  1747 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:31.838663  1750 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 12.
W20260709 13:00:31.851686  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.852782  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.856525  1597 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:31.817994  1602 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:31.863198  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.863049  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.864547  1601 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:31.864866  7722 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:31.865475  7707 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:31.871872  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.874404  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:31.875216  2311 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:31.874631  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:31.871490  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.876775  1600 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:31.881765  7761 ts_tablet_manager.cc:1434] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.159s	user 0.013s	sys 0.000s
I20260709 13:00:31.900614  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.901134  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:31.901607  1599 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:31.902117  2311 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:00:31.903488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.904402  1602 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:31.904712  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.903491  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.907102  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:31.909592  7707 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:31.910341  7707 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.912890  7707 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:31.915445  2314 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:31.924131  7701 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.924162  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-46080b3c17204e34b7cfa66296431876 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:00:31.925282  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-46080b3c17204e34b7cfa66296431876 on tablet 46080b3c17204e34b7cfa66296431876 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:31.924819  7701 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.928279  7896 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.929049  7701 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.929049  7896 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:31.932593  7788 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:31.933274  7749 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:31.934460  7896 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.934726  7749 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:31.936134  7749 tablet_bootstrap.cc:492] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
W20260709 13:00:31.936691  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 130334us
I20260709 13:00:31.937245  7749 ts_tablet_manager.cc:1403] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.925s	user 0.064s	sys 0.042s
I20260709 13:00:31.937270  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:31.937769  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 154214us
I20260709 13:00:31.938337  1750 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:00:31.938902  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.940025  7722 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:31.940596  7701 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.943267  7701 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.945920  7701 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.943565  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.947129  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:31.951944  1751 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:31.957305  7722 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.951203  7717 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:31.959213  7786 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:31.957305  7701 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.962328  7717 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.966400  7846 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.968410  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.964599  7910 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:31.963505  7869 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.968948  7717 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:31.972882  7846 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.969636  7786 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.974982  7924 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:31.996201  7904 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.996902  7904 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.997373  7846 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:31.994843  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:31.980786  7932 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:31.977340  7910 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.974413  7701 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:31.985983  7955 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.012498  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:31.982038  7869 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.002156  7922 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.018100  7788 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:32.018515  7722 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:32.018560  7744 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:32.000453  7924 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.011322  7903 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:00:32.028867  7904 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.029074  7897 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:32.030174  7869 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.013103  7932 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.016044  7955 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.034642  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 192) took 2358 ms. Trace:
I20260709 13:00:32.036315  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.033146  7786 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.040117  7897 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:32.043079  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61116.2us
I20260709 13:00:32.025224  7744 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.026867  7922 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.047355  7955 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.048626  7924 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.049758  7932 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.060212  7922 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.062130  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.063777  7924 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:32.055418  7910 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.034492  1497 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:32.036260  1496 rpcz_store.cc:276] 0709 13:00:29.674877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.675177 (+   300us) service_pool.cc:224] Handling call
0709 13:00:32.033269 (+2358092us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:30.743237 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:30.864120 (+120883us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:30.869230 (+  5110us) write_op.cc:435] Acquired schema lock
0709 13:00:30.869260 (+    30us) tablet.cc:662] Decoding operations
0709 13:00:30.870422 (+  1162us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:30.870514 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:30.870542 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:00:30.871391 (+   849us) tablet.cc:701] Row locks acquired
0709 13:00:30.871414 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:00:30.876942 (+  5528us) write_op.cc:270] Start()
0709 13:00:30.881883 (+  4941us) write_op.cc:276] Timestamp: P: 1783602030874570 usec, L: 0
0709 13:00:30.883531 (+  1648us) op_driver.cc:348] REPLICATION: starting
0709 13:00:30.935567 (+ 52036us) log.cc:844] Serialized 4048 byte log entry
0709 13:00:31.369762 (+434195us) op_driver.cc:464] REPLICATION: finished
0709 13:00:31.561954 (+192192us) write_op.cc:301] APPLY: starting
0709 13:00:31.562124 (+   170us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:31.669197 (+107073us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:31.669361 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:31.821235 (+151874us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:31.821782 (+   547us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:00:31.821868 (+    86us) write_op.cc:312] APPLY: finished
0709 13:00:31.824133 (+  2265us) log.cc:844] Serialized 97 byte log entry
0709 13:00:31.861656 (+ 37523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:31.928590 (+ 66934us) write_op.cc:454] Released schema lock
0709 13:00:31.928668 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:31.929362 (+   694us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:31.929399 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":165639,"apply.run_cpu_time_us":22858,"apply.run_wall_time_us":367420,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":420594,"prepare.run_cpu_time_us":13969,"prepare.run_wall_time_us":248215,"raft.queue_time_us":394824,"raft.run_cpu_time_us":24115,"raft.run_wall_time_us":147058,"replication_time_us":485816,"thread_start_us":713986,"threads_started":4,"wal-append.queue_time_us":31246}]]}
I20260709 13:00:32.065963  7922 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:32.052757  7749 raft_consensus.cc:359] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:32.066548  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64931.8us
I20260709 13:00:32.066838  7722 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:32.067183  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.068456  7932 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:32.064476  7701 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.074971  1497 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 13 to 15, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.084831  7968 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:32.085351  7968 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:32.085750  7968 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:32.086532  7951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 430) took 1586 ms. Trace:
I20260709 13:00:32.087015  7951 rpcz_store.cc:276] 0709 13:00:30.500651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.501174 (+   523us) service_pool.cc:224] Handling call
0709 13:00:30.891039 (+389865us) ts_tablet_manager.cc:934] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 13:00:31.678513 (+787474us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:31.827834 (+149321us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:31.828001 (+   167us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:32.085507 (+257506us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:32.085881 (+   374us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:32.086267 (+   386us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:32.086410 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":357,"tablet-copy.queue_time_us":327816,"thread_start_us":296987,"threads_started":2}
I20260709 13:00:32.080331  7749 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:00:32.090193  7722 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.096251  1497 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.092039  7951 tablet_copy_client.cc:806] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:32.099439  7951 tablet_copy_client.cc:670] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:32.100157  7722 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:32.101552  7749 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:32.104383  7744 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:32.104887  7749 ts_tablet_manager.cc:1434] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.167s	user 0.010s	sys 0.002s
I20260709 13:00:32.106985  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.106820  7968 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.107609  1687 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-3c468e528ecc447f9d2154d473a93b16 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:00:32.108273  1687 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-3c468e528ecc447f9d2154d473a93b16 on tablet 3c468e528ecc447f9d2154d473a93b16 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:32.108628  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:32.109701  7968 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.109918  7722 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:32.110023  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.110327  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:32.113816  7968 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:32.116782  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.115058  7788 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:32.125877  7707 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:32.126976  7788 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.125993  7932 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:32.128302  7788 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.124464  7717 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.133090  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:32.124727  7951 tablet_copy_client.cc:538] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:32.141808  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:32.143615  7932 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:32.144125  7932 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.144594  7932 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:32.144662  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:32.151232  7922 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:32.151695  7922 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.152043  7922 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:32.147781  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.154760  7788 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.156462  7717 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.157529  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:32.158197  1745 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.159689  7903 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:32.160184  7903 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.160575  7903 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:32.165081  1566 leader_election.cc:400] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:00:32.165580  1566 leader_election.cc:403] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.168232  1745 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:00:32.171895  7968 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:00:32.172117  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:32.175614  7701 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:32.176090  7701 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.176468  7701 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:32.176568  7932 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.179034  7932 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.185561  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.186614  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:32.198194  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.187798  7788 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:32.188338  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:32.188786  7983 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:32.230633  7717 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:32.190164  7903 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.192087  7985 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:32.231940  7985 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.232955  7903 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.232811  7897 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:32.233071  7985 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.234611  7897 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:32.231329  7717 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:32.237742  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:32.238634  7897 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.238173  7717 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.239094  7897 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:32.239578  7897 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.242807  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:32.194343  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.199045  7932 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:32.200438  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.186982  7951 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:00:32.248500  7932 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.249043  7932 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:32.190963  7701 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.226723  7968 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:32.231201  7910 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:32.193861  7922 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.247653  7983 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:32.248036  7722 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:32.247830  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47480.4us
W20260709 13:00:32.247830  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53574.8us
I20260709 13:00:32.251853  7955 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:32.395879  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.397068  7968 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.398459  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.326104  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:00:32.374989  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.397650  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.252969  7910 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:32.408282  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 156937us
I20260709 13:00:32.416685  7985 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:32.394781  7903 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.420903  7985 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.421152  7903 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.422129  7985 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.404085  7717 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.395371  7983 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:32.411248  7788 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:32.427632  7788 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.428768  7788 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.428802  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.433423  7707 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:32.433764  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.434041  7707 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.435006  7956 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:32.435606  7956 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.435288  7707 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.411131  7924 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:32.408005  7910 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:32.445596  7924 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:32.445686  7982 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:32.446604  7701 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.446962  7924 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.449903  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.450845  7983 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:32.436076  7903 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.450922  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.450788  1598 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:32.451890  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.400363  7955 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:32.451963  1599 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:32.462980  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.465938  1600 raft_consensus.cc:2410] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:00:32.469401  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.472105  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.472256  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.473259  1597 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 25.
I20260709 13:00:32.475950  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.476279  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.476372  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.477730  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.470187  1602 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:32.484513  1601 raft_consensus.cc:2410] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:00:32.485836  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49774.6us
I20260709 13:00:32.426117  1501 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 14, leader changed from <none> to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.465546  7955 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.498502  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.499693  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.500816  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.502487  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.502591  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.480050  7722 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:32.504869  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.507284  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.507735  1751 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
W20260709 13:00:32.508512  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 110116us
I20260709 13:00:32.496869  1501 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 21 to 22, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.509624  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.485633  7968 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:32.513170  1597 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:32.517309  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.519976  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.521708  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.511310  1501 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.512852  1599 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:32.524379  1501 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.466997  7717 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.538774  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.529824  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:32.544035  1501 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.539772  1601 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:32.545915  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.543280  1602 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:32.467399  7956 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.516162  7903 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.549590  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.553198  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.564033  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.568783  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.569928  1747 raft_consensus.cc:2410] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:00:32.532280  7989 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:32.572484  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:32.544698  7744 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.605744  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:32.609184  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91999.8us
I20260709 13:00:32.527146  7932 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.614725  1751 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:32.621609  7744 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.624320  7744 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.629930  7998 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:32.635783  7922 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.572338  7903 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.642740  7903 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.571933  7701 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:32.604669  7989 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:32.606096  7924 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.533011  7722 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:32.701732  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81727.5us
I20260709 13:00:32.703251  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.713274  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 13:00:32.716225  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 208529us
I20260709 13:00:32.672503  7897 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.725751  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.713297  7786 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:32.738085  7995 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:00:32.739379  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:32.740684  7707 raft_consensus.cc:2764] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:32.741510  7707 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:32.743171  7982 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:32.744451  7982 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:32.744971  7982 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.746217  7982 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.687892  7924 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.749185  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.749292  7707 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:32.749686  7924 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.750495  7707 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:32.750823  7982 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:32.751003  7707 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:32.750422  7989 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.753008  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.752851  7707 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.754230  7707 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:32.757222  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 231552us
I20260709 13:00:32.761646  7991 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:32.766955  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:32.763248  7991 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:32.726900  7701 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.733376  7903 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:32.796852  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67745.6us
I20260709 13:00:32.733768  7922 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:32.737084  7786 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.802994  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.806706  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.808065  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.812878  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:32.813650  1600 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:32.814388  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 47552.4us
I20260709 13:00:32.815894  1751 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:00:32.798686  7903 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:32.805353  7786 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:32.801981  7922 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:32.810758  7924 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:32.827210  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:32.798411  7701 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.830423  7924 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.832293  7924 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:32.833498  7701 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.833580  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:32.834362  7701 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:32.825366  7903 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:32.837598  7897 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:32.815977  7968 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.834436  1596 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:32.841120  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 88182.2us
I20260709 13:00:32.857120  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:32.826074  7922 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:32.840982  7701 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:32.842319  7892 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:32.865851  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 57882.1us
I20260709 13:00:32.869875  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:32.858799  7932 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.868072  7910 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.864449  7701 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:32.883388  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:32.884194  1594 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:32.884531  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:32.886168  1600 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:32.892732  8015 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:32.893392  8015 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.893774  8015 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:32.896090  7990 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:32.898106  7996 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
I20260709 13:00:32.867862  7892 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:32.878012  8013 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:00:32.899919  1751 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:32.860363  7983 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.903017  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:32.911983  8003 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:00:32.906219  7892 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:32.922732  1748 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:32.905272  7989 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:32.901301  8005 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:32.927898  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.933923  1743 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:32.935864  8014 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:00:32.943229  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.946794  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.924584  7989 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.964242  1752 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:32.966209  7910 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:32.972759  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:32.973183  7922 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:32.971238  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:32.975896  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.944649  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:32.978303  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:32.978389  7922 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.987110  1670 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:32.987466  1673 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:32.987938  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:32.989202  1674 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:32.990751  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:32.992669  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:32.993628  1671 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:32.996310  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:32.997064  1672 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:32.997371  7983 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:33.000034  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:32.999858  7903 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.001427  7717 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:33.001964  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.002508  7903 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:32.963660  7989 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:33.001470  7955 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:32.963228  7701 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.014153  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.018690  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.018903  7786 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:33.019626  1745 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
W20260709 13:00:33.025094  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.031618  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:33.034598  1596 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:33.039919  1671 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:33.044123  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:33.045591  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.044366  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:33.049424  1671 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:00:33.047299  7786 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.057248  1671 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:33.058353  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.059729  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.072897  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.077356  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:33.057192  7701 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.089349  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:33.100051  7955 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:33.108971  7924 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:33.112744  7924 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.144037  8004 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:33.113386  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:33.146950  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.118467  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.120081  8015 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.122522  7968 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:33.150928  7968 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.062213  8007 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:33.155153  7892 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:33.124809   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:33.157600  1497 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.169616  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 213) took 1301 ms. Trace:
I20260709 13:00:33.174371  8006 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:33.175125  8006 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.177558  8006 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:33.180270  7892 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.171653  1501 rpcz_store.cc:276] 0709 13:00:31.864181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.864527 (+   346us) service_pool.cc:224] Handling call
0709 13:00:33.165492 (+1300965us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:32.621518 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:32.622128 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:32.622173 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:00:32.622188 (+    15us) tablet.cc:662] Decoding operations
0709 13:00:32.623130 (+   942us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:32.623194 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:32.623224 (+    30us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:32.623897 (+   673us) tablet.cc:701] Row locks acquired
0709 13:00:32.623919 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:00:32.624092 (+   173us) write_op.cc:270] Start()
0709 13:00:32.624214 (+   122us) write_op.cc:276] Timestamp: P: 1783602032624038 usec, L: 0
0709 13:00:32.624232 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:00:32.624984 (+   752us) log.cc:844] Serialized 2918 byte log entry
0709 13:00:32.627880 (+  2896us) op_driver.cc:464] REPLICATION: finished
0709 13:00:32.628489 (+   609us) write_op.cc:301] APPLY: starting
0709 13:00:32.628594 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:32.746151 (+117557us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:32.746260 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:33.001749 (+255489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:33.002014 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:00:33.002063 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:33.002372 (+   309us) log.cc:844] Serialized 73 byte log entry
0709 13:00:33.002594 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:33.002746 (+   152us) write_op.cc:454] Released schema lock
0709 13:00:33.002800 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:33.003276 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:33.003306 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23801,"reported_tablets":16,"spinlock_wait_cycles":250624,"child_traces":[["op",{"apply.queue_time_us":304,"apply.run_cpu_time_us":15843,"apply.run_wall_time_us":374723,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29302,"num_ops":7,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":3803,"prepare.run_wall_time_us":5534,"replication_time_us":3456}]]}
W20260709 13:00:33.187481  1715 connection.cc:256] RPC call timeout handler was delayed by -1.2483467030000384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260709 13:00:33.187873  7956 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:00:33.188088  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0710467030000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 13:00:33.188480  7956 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.189471  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:33.190883  7956 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:33.155937  8007 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:33.209642  8007 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:33.211165  7788 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:33.211885  7788 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:33.212990  7788 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:33.217993  7989 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:33.233945  8015 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.250434  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:33.258836  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 374284us
I20260709 13:00:33.276919  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.277828  1600 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:00:33.278326  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.278878  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.279101  1594 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:00:33.279466  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.277856  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.278883  1597 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:00:33.283723  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.269407  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:33.289431  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.290203  1602 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:33.300673  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:33.301699  1675 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:33.296396  7924 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:33.305343  7924 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.305775  7924 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:33.306007  7983 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:33.306743  7983 consensus_queue.cc:1243] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:33.310189  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.305004  7990 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:33.311657  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.313755  1749 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:33.312361  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.314465  1596 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:33.318500  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.320130  1597 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:33.320595  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.321985  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.323487  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.321264  1671 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:33.324508  1673 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:33.330082  1672 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:33.322677  1677 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:33.287488  7968 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:33.312300  7983 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:33.332863  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.337389  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.337886  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:33.338181  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.338939  1747 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:33.340476  1748 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:33.341711  1675 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:33.342121  1601 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:33.345762  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.346969  1601 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:33.337726  8006 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:00:33.351468  1602 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:33.357612  1597 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:33.361861  1596 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:33.363786  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.312841  7985 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:00:33.364338  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:33.336782  7983 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:33.369261  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.376405  1677 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:33.374259  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:33.376951  7788 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:33.385218  7982 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:00:33.387478  7788 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.388000  7788 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:33.367398  7989 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:33.380213  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:33.391987  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.384636  7983 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.392966  1745 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:33.393462  7983 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:33.376063  7999 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:00:33.363063  8006 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:33.395823  8006 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.396216  8006 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:33.401348  8005 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:33.402551  8005 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:33.402961  8005 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:33.380570  8034 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:33.405525  7968 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:33.380394  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.407720  1602 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:33.391993  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.380034  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.408998  1601 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:33.385030  1748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:33.385459  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:33.414959  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.416342  8028 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.416378  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.419149  1748 raft_consensus.cc:606] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:33.428175  8028 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.440228  1749 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:33.428468  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.451930  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:33.452008  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.459793  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.460567  1743 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:33.425760  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46391.5us
I20260709 13:00:33.448508  1746 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:33.473304  1749 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:33.479485  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.481410  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:33.484275  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.484956  1751 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.485927  7788 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:33.486755  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 117551us
I20260709 13:00:33.488508  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.489358  1748 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.489943  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:33.484136  7982 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:33.490697  7982 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:33.491106  7982 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.491812  7968 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:33.492237  7968 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:33.492611  7968 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.448639  2311 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.488420  8007 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:33.508929  8005 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.510779  8005 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:33.505067  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:33.519490  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.499305  7924 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.521390  8028 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.521788  7924 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.522467  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.524222  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.524618  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:33.528378  1743 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:33.527709  1496 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.529174  1751 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:00:33.530807  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.530440  1496 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 12 to 14, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.532181  1496 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 15, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.533883  1496 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 15 to 17, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.535760  1496 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 23 to 25, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 25 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.543160  1748 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:33.544661  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:33.553936  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:33.555271  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:33.569401  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:33.571380  1751 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:00:33.565955  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:33.577589  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.578958  1677 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:33.579768  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:33.583515  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:33.584519  1671 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:00:33.566855  7956 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:33.586444  7956 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:33.587044  7956 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:33.593070  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 88079.6us
I20260709 13:00:33.540412  7896 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:33.545853  8028 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.592522  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.495426  8006 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.600320  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 13:00:33.612600  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72001.3us
I20260709 13:00:33.578436  7932 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.525454  8007 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:00:33.623117  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:33.641331  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:33.593052  7990 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:33.647315  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.650861  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.651597  1752 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:33.582234  7982 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.649005  7896 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:33.673368  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.619678  8028 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.674980  1673 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:33.683750  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.658190  8000 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:33.652377  7932 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.722467  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:33.666910  7999 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:00:33.730726  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.657879  7990 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:33.734992  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:33.736996  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 96606.9us
I20260709 13:00:33.741426  1671 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:00:33.554210  7991 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.194s
I20260709 13:00:33.756800  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.757814  1673 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:33.763681  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:33.767036  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.723965  2311 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:33.768364  1671 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:33.736413  7788 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:33.672148  8011 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.196s
I20260709 13:00:33.786458  1671 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
W20260709 13:00:33.762881  8037 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
W20260709 13:00:33.788159  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.806629  1671 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:33.768306  7722 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:33.811686  7932 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:33.812798  1672 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:00:33.812824  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 77862.3us
I20260709 13:00:33.780027  7989 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:33.814816  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:33.745011  8049 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:00:33.828157  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:33.829159  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.824460  8043 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:00:33.826772  8046 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:33.829227  7982 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:33.845297  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.853086  8054 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:33.853407  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.855649  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:33.827021  8006 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:33.853737  8054 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:33.863845  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:33.866895  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 225654us
I20260709 13:00:33.908335  1678 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:33.934659  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:33.862247  7722 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:33.858669  7989 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:33.983000  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:33.992722  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.992601  7951 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:00:34.003098  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:33.985666  8028 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:34.018435  8053 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:00:33.999073  7896 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:33.998338  8051 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:33.950464  7892 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:00:34.024588  8051 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:34.028288  8052 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:00:34.029525  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:34.031147  1678 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
W20260709 13:00:34.047091  8057 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:34.047312  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:34.048873  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:34.049297  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:34.049600  1678 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.053462  7951 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:00:34.054661  7951 tablet_bootstrap.cc:492] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:00:34.054963  1674 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:34.031203  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.032845  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.056344  1674 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:34.057266  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.077841  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.069831  1677 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:34.071346  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.063383  1675 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:34.081679  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.059725  7896 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:34.094208  7896 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:34.055516  7951 ts_tablet_manager.cc:1403] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.869s	user 0.056s	sys 0.037s
I20260709 13:00:34.097950  1675 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:34.099321  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.059791  8028 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:34.110141  1677 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:00:34.056668  7990 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.055939  8051 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.091812  7924 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:34.096231  8015 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:34.122865  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51765us
I20260709 13:00:34.124440  1673 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:34.112287  8005 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.009s
I20260709 13:00:34.149402  1670 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:34.149552  7951 raft_consensus.cc:359] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 15 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.114581  8028 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:34.163837  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 335720us
I20260709 13:00:34.129769  7924 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.132664  8015 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.172617  1600 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:34.173620  8006 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.174785  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.175932  1603 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:00:34.176321  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.177564  7985 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:00:34.178588  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.178792  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.179270  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.206079  1602 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:34.180080  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.207396  1597 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:34.181030  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.181922  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:34.188755  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:34.163780  7968 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.003s
I20260709 13:00:34.161839  8028 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.216130  1595 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:34.216728  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.097429  8054 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.218969  1594 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:34.216920  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:34.224217  1596 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:00:34.184522  7924 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.249179  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:34.192060  8015 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:34.190107  8007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.017s
I20260709 13:00:34.201820  7997 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.251261  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.259835  1597 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:00:34.263525  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 164890us
I20260709 13:00:34.264168  1601 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:34.264882  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.266857  1671 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.267064  1594 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:34.202744  7985 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.167502  8064 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:00:34.271582  2312 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:34.278699  1596 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:34.280946  1601 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:34.266758  7997 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:34.260593  8007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.008s	sys 0.017s
I20260709 13:00:34.283895  1599 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:00:34.287067  1595 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:34.254773  8048 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:34.204908  8006 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.216204  8050 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:00:34.298357  1597 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:00:34.236151  7968 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:34.300201  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 117251us
I20260709 13:00:34.308866  1677 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.235882  8005 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:00:34.311936  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47201.1us
I20260709 13:00:34.315857  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.300765  1597 pending_rounds.cc:85] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 13:00:34.317438  1597 pending_rounds.cc:107] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:00:34.290376  7932 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:34.317806  1597 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.323026  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:34.324759  1598 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.327728  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:34.327849  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.328568  1599 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.329856  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.330075  1603 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:34.332446  1595 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:34.333446  1596 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:34.312690  7951 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:00:34.339138  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:34.345013  1601 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:34.340725  1752 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:34.341995  1751 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:34.360240  1678 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:34.362253  8005 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:34.362833  8005 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.364557  1749 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:34.317760  8048 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:34.370270  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.373818  2311 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Advancing to term 16
I20260709 13:00:34.376974  8075 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:34.377795  8082 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:34.378113  8005 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.378713  8082 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:34.379084  8082 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.379432  8082 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:34.380259  7956 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.792s	user 0.016s	sys 0.000s
I20260709 13:00:34.380733  7956 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.383332  1746 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:34.371407  8007 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:34.379457  8005 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.384209  8047 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:34.384846  8047 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.387115  8047 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:34.388003  8054 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:34.389794  1598 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:34.392493  1599 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:34.384099  8007 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.395368  8007 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.401047  7951 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:34.404100  7932 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.404706  7932 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:34.406076  8006 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:34.420261  7997 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.423188  7985 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:34.425096  8011 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:34.425760  8011 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.428061  8045 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:34.428754  8045 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.430090  8045 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:34.404716  8076 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.433334  8076 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:34.432435  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 57822.1us
I20260709 13:00:34.439420  8050 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:34.440384  8050 consensus_queue.cc:1243] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 570958eb733a4af7ae16ae020998c8b4 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:00:34.441169  8077 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:34.441380  8050 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:34.441893  8050 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.443526  8021 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:34.444070  8021 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:34.445236  8021 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.446883  8021 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.376576  8059 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:00:34.426048  8072 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:00:34.377839  8075 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.449297  8075 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.451503  8048 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.454339  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.458788  7788 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:34.442905  8050 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:34.463582  8050 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.462322  7951 ts_tablet_manager.cc:1434] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.366s	user 0.011s	sys 0.003s
W20260709 13:00:34.468065  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.471262  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-c3c15f4148e94b83a318e5a513f2f769 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:00:34.471916  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-c3c15f4148e94b83a318e5a513f2f769 on tablet c3c15f4148e94b83a318e5a513f2f769 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:34.476528  8076 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.476900  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:34.478503  7956 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:34.480643  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:34.478219  8047 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:00:34.485607  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.486805  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.508028  1676 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:34.493049  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:34.539062  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.491272  8080 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:00:34.547585  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.478228  8075 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.549873  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:46300
I20260709 13:00:34.550338  8081 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.550917  7968 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.499331  7985 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:34.512372  8074 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.496289  8011 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:34.553545  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60614.7us
I20260709 13:00:34.544178  7788 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.513005  8070 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.494233  7982 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:00:34.544499  7707 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:34.568480  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:34.567046  8079 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.144s	user 0.000s	sys 0.003s
I20260709 13:00:34.535634  8082 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.511806  8007 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.569016  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:34.589715  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.588263  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 258449us
I20260709 13:00:34.595237  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.580922  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.584833  8068 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:34.582885  7968 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:00:34.600597  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.602344  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.605712  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.606444  1678 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:34.602654  7990 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:34.614971  8083 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:34.609469  8076 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:34.616039  8076 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.616441  8076 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.621204  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:34.625803  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.564473  8081 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:34.631325  8011 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.578830  8070 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.637358  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.638401  1670 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:34.637686  8070 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.579866  7788 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:34.571671  8074 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.657104  8082 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.647359  7990 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:00:34.663076  7932 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.608045  8075 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:34.687088  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.690014  1743 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
W20260709 13:00:34.693809  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.695708  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 127338us
I20260709 13:00:34.611966  8007 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.670008  8028 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.699959  8007 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.700069  8028 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.702255  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.703253  1670 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:34.704051  8045 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.705771  1745 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:00:34.706197  1745 pending_rounds.cc:85] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 9
I20260709 13:00:34.706451  1745 pending_rounds.cc:107] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:00:34.706719  1745 raft_consensus.cc:2889] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.689532  8075 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:34.707862  7982 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.708509  7982 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.709134  7788 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:34.710784  8082 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:34.710906  7982 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:34.711458  8082 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:34.711652  7707 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.712291  7707 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.712551  8082 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.714634  7707 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:34.714550  7924 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.718390  7932 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.719008  8081 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.719138  1601 raft_consensus.cc:606] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:34.719692  1601 raft_consensus.cc:614] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:34.721217  8015 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.721846  1671 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:34.723875  1669 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:34.725728  2311 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:00:34.728385  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.729552  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.731997  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:34.732306  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:34.711239  8074 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.737653  1673 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:34.707966  8075 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.738358  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:34.739177  8005 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:34.733688  8015 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.768093  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:34.736183  8004 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:34.786449  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.786365  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:34.767750  8047 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:34.790144  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 190723us
I20260709 13:00:34.790302  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:34.795393  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:34.780965  7982 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:34.782209  8004 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.796301  8050 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:34.796147  8048 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:34.802918  8054 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:00:34.805910  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 170943us
I20260709 13:00:34.781510  7707 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:00:34.831292  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:34.833195  8047 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:34.833012  8064 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:34.834491  8047 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:34.834968  8047 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.840587  7924 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.848105  8050 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:34.850142  8007 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:00:34.850744  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.850696  8007 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:34.816947  8004 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.860116  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:34.860306  8070 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:34.816370  8059 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:00:34.883396  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 59508.6us
I20260709 13:00:34.860663  2312 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.885699  1672 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:34.886528  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:34.860450  8007 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:34.877254  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.800122  7997 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:00:34.878329  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.817793  8051 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.883886  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:34.910807  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.908470  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.872380  8086 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:34.918865  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:34.921283  1674 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:00:34.880012  8070 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:34.925236  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:34.925879  1673 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 25. Current term is 26. Ops: []
W20260709 13:00:34.930972  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75243.8us
I20260709 13:00:34.930374  8062 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:34.941629  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:34.935868  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:34.883634  8091 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:00:34.908044  8074 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:34.935693  8007 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.935192  8083 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:34.930127  8086 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:34.953341  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:34.960058  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:34.956542  8087 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:34.963893  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:34.956252  7991 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.956538  8062 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:34.975834  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:34.932096  8047 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.960388  8101 raft_consensus.cc:2764] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:00:34.958324  8076 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:34.991796  7788 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:00:34.976392  7924 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:34.979198  8087 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.994956  7788 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:34.979146  7991 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.998485  1669 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:34.983449  7932 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:34.981207  8028 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:34.962818  8048 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:00:35.004390  7788 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.000603  8076 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:34.974613  8011 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:00:35.017557  8090 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:00:35.013818  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 129539us
I20260709 13:00:34.978713  8060 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:00:35.022351  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:35.028618  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.036998  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.004946  8087 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:35.046979  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.047458  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.032262  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.048441  1601 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:35.049067  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.049660  1594 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:35.007359  7924 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.052167  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.053287  1748 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:35.042136  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:34.995174  8064 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:00:35.054486  1602 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:00:35.034878  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.516s (SENT) [suppressed 35 similar messages]
I20260709 13:00:35.045979  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.010299  8028 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.063058  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.064136  1598 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:00:35.043174  8089 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 13:00:35.023293  8074 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 13:00:35.039849  8099 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:00:34.978842  8070 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:35.100395  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.104084  1751 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:35.011039  7991 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.064025  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.041860  8076 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:35.096863  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.053625  8068 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:35.069904  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.068696  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.125437  1601 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:35.067951  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.067422  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.126202  1600 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:35.126302  1597 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:00:35.064772   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:35.082070  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.067201  8028 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:35.107120  1598 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.118245  1752 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
W20260709 13:00:35.119591  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 84748.9us
W20260709 13:00:35.136338  1566 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.597s (SENT)
W20260709 13:00:35.123481  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79472us
I20260709 13:00:35.051017  7924 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.129302  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.124672  1749 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:00:35.064824  8054 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:35.148322  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.143117  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.023622  8062 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.149477  1752 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:00:35.151752  1749 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:35.017598  7788 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.155228  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:35.156507  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.157452  1751 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:35.137434  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.163654  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:35.164548  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.132908  8068 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.033394  8086 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.169783  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:35.178793  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.151714  8070 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.147140  8054 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.182443  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.193197  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.202459  1600 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
W20260709 13:00:35.203486  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 163055us
W20260709 13:00:35.193775  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 127565us
I20260709 13:00:35.214310  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.216140  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.231649  1594 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 26.
I20260709 13:00:35.231997  1601 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:35.167999  8076 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.235997  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:35.240038  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.240017  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:35.243171  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.244448  8106 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:35.245843  8117 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:00:35.244724  8100 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:00:35.181005  7932 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.249282  8068 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.233429  7707 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:00:35.250841  8068 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:35.246642  8117 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.252312  8076 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.168303  8105 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:00:35.252259  8117 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.255146  8105 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:35.255981  8105 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.256888  8105 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.258405  8048 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:35.259066  8048 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.258781  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.260905  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.260303  8048 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:35.262238  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.258754  8105 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.226706  8044 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.273722  8045 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.000s
I20260709 13:00:35.263502  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.274457  8075 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:35.287714  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.305078  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.308025  1673 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:35.270071  7788 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:35.269069  8119 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:35.263810  8109 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:35.266450  8106 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.303503  8054 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.352975  7982 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:35.353575  7982 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.354585  7982 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.267504  8044 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.359040   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:35.328842  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 161701us
I20260709 13:00:35.355738  7932 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.356634  8095 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:35.329103  8119 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.332624  8109 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:35.385375  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 121941us
I20260709 13:00:35.387748  8116 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:35.388417  8116 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.389032  8004 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.380730  8119 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.395888  8061 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:35.396142  8119 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.396379  7982 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:35.397292  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:35.400122  2313 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:35.396647  8061 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.408281  7956 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:35.408826  7956 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.409578  8061 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:35.410200  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.411667  8045 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:35.412299  8045 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.413100  8004 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.415211  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:35.425357  8116 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:35.429189  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.436043  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:35.420754  8095 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:35.387032  8106 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:00:35.449645  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.450477  1752 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:00:35.451337  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.451874  1752 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.454375  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:35.446062  7985 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.007s
I20260709 13:00:35.455466  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:35.448300  8101 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:35.469606  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.470376  1751 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:35.470816  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:35.475648  1750 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:00:35.477933  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.478191  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.478924  1594 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:35.481276  1601 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:00:35.484727  1752 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:00:35.484593  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.487263  1752 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:00:35.487813  1752 pending_rounds.cc:85] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 10
I20260709 13:00:35.488152  1752 pending_rounds.cc:107] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:00:35.487978  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.488518  1752 raft_consensus.cc:2889] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.452673  8095 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.490742  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.459136  7924 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:35.492861  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.493430  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.496454  1596 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:35.494379  1677 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:35.494940  1597 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:35.492465  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.467970  8105 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:35.495313  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.496198  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.495445  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.463792  8075 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.501158  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.506560  1671 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:35.507295  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.507377  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.507830  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.508255  1601 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:00:35.508517  1600 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:35.490383  8101 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.511958  8128 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:35.495810  7924 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.526309  8128 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.527395  8128 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.530333  8028 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.533730  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:35.536250  1601 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:35.509680  7932 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:35.524732  8101 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:35.522260  1752 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:35.540107  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:35.544030  1601 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:00:35.538141  1566 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.639s (SENT)
I20260709 13:00:35.545677  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.544742  1752 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:35.541949  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:35.548563  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.509531  8105 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.526326  7924 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:35.550628  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.552946  1600 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:35.556166  1752 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:00:35.550707  8105 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:35.548786  8113 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260709 13:00:35.546370  8106 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:35.562357  1602 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:00:35.562440  1752 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:35.561750  2311 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.572175  8083 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:35.572688  8083 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:35.573843  1566 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.759s (SENT)
I20260709 13:00:35.557713  8075 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:35.574378  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.575703  8060 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:00:35.576030  8137 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:35.576267  8060 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:35.563885  8106 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:35.580116  8106 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:35.563947  8044 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:35.566614  8007 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.608s	user 0.014s	sys 0.001s
I20260709 13:00:35.584560  7991 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.586015  1748 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:35.588733  1566 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.811s (SENT)
W20260709 13:00:35.593142  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.598987  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.551899  7932 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:35.604776  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.559299  8070 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:35.611649  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:35.591682  8087 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.000s
I20260709 13:00:35.623945  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:35.614714  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.583215  8045 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:35.628844  1600 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:00:35.643918  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.586934  7991 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:35.654765  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:35.577417  8060 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.630956  8128 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:35.640377  8114 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.640972  8007 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:35.673285  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:35.679054  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 90331.2us
W20260709 13:00:35.680158  1566 leader_election.cc:336] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.840s (SENT)
I20260709 13:00:35.680640  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:35.655988  8075 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:35.684695  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.617583  8076 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:00:35.669173  8116 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:35.556469  8095 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:35.685078  8060 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:35.653410  8087 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.689996  7932 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:35.689775  8082 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:35.712996  8105 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.687973  7968 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:35.715919  7968 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.718050  8097 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:35.718760  8097 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:35.720376  8097 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.721920  8097 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.708936  8107 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:35.710064  1566 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.869s (SENT)
I20260709 13:00:35.730665  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.733734  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:35.699342  8075 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.701973  8007 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:35.700446  8116 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:35.699476  8028 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.749900  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:35.757349  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:35.704902  8076 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.768666  1743 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:35.730074  8045 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.771301  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:35.771530  1600 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:35.772027  1749 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:35.685361  8114 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.768666  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:35.730041  8082 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.775952  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:35.735622  7932 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.732041  8107 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:35.785650  8082 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.753402  8137 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:35.795480  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 85451.1us
I20260709 13:00:35.779372  7982 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:35.799804  2312 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEARNER]: Advancing to term 16
I20260709 13:00:35.772734  7985 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:35.798556  8107 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.802778  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:35.779331  8128 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:35.807920  1600 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:35.769779  8076 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.812125  7924 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:35.813597  1566 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.955s (SENT)
I20260709 13:00:35.822949  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:00:35.814544  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 57325.9us
I20260709 13:00:35.791823  8074 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:35.791584  7707 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.779134  8045 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:35.832190  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.808249  7982 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.833500  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.834653  1676 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:35.835901  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.803393  8129 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:35.837124  8129 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:35.837600  8129 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:35.841305  7924 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.806854  8121 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:00:35.844324  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.832998  7982 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:35.848340  8076 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.849161  8094 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:35.849926  8021 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.850219  8094 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.850613  8094 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:35.851085  7932 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.852006  1675 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:35.853947  8074 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.854979  8087 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:35.837649  8142 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:00:35.859158  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.863348  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58886us
I20260709 13:00:35.814713  7788 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.826337  8068 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.003s
I20260709 13:00:35.888614  1749 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:35.886860  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:35.855687  7990 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:35.896481  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:35.911464  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:35.912559  1677 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:35.913687  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:35.916224  8064 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.917078  8064 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:35.918239  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:35.918883  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.925354  8045 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:35.925908  7968 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.891208  8021 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.928172  8021 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.905791  8137 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:35.932111  8137 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:35.932633  8137 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:35.934161  8118 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.670s	user 0.005s	sys 0.000s
I20260709 13:00:35.934930  8007 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:35.935443  8007 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.935837  8007 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:35.945097  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.931118  8021 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:35.863090  8094 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:35.968194  8147 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:00:35.868386  8116 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:35.981752  8091 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:35.982373  8091 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:35.888403  7788 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.009341  8137 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.011555  7788 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:35.902330  7990 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:35.984969  8091 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:35.986822  7985 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.995415  8114 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:35.962981  1600 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:35.887861  8075 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.016638  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:36.025727  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.013861  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 109774us
I20260709 13:00:36.012761  8064 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.044858  7990 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.046583  7990 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.029201  7985 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.052304  8114 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:36.053220  8114 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.054028  7985 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:36.058643  8153 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:36.059234  8153 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:36.059613  8153 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:36.060211  7717 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.060985  7717 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.065572  8074 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:36.069629  8143 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
I20260709 13:00:36.071269  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:36.074100  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:36.075256  8101 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:36.077188  8101 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:36.035727  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:36.077602  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.078176  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.078365  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:36.078877  8021 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:36.079591  8021 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:36.080417  8124 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:36.081063  8124 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.080958  8021 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.083719  8070 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.084328  8070 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.085089  8076 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.086584  8070 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.087240  8070 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:36.077999  8101 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:36.131429  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:36.087345  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:36.077340  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.040202  8137 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.091410  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:36.079785  8109 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:36.093725  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3059) took 1154 ms. Trace:
I20260709 13:00:36.097855  7717 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.098721  8124 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.100811  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.101661  7956 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:36.102586  8106 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.000s
W20260709 13:00:36.134140  8086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.014s	sys 0.003s
I20260709 13:00:36.105031  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:36.111747  8054 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:36.115443  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.114809  8114 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:36.120816  8097 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:36.123615  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.124817  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.035452  8091 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:36.125957  8083 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.009s
I20260709 13:00:35.975334  8094 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.129097  7991 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.133762  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.136392  2313 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Advancing to term 17
W20260709 13:00:36.146579  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.148902  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.136359  2312 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:00:36.140198  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48896.4us
I20260709 13:00:36.192890  1678 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:36.141580  1673 rpcz_store.cc:276] 0709 13:00:34.939040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.943176 (+  4136us) service_pool.cc:224] Handling call
0709 13:00:34.954558 (+ 11382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.312014 (+357456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.093436 (+781422us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54003228d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:36.093654 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812143872}
I20260709 13:00:36.103209  1674 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:36.156083  1671 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 25. Current term is 26. Ops: []
I20260709 13:00:36.139096  8105 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:36.165810  8086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.015s	sys 0.004s
I20260709 13:00:36.152026  8137 raft_consensus.cc:2764] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:00:36.195891  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:36.197352  1751 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 13:00:36.157032  1501 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:36.180536  2315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.052s	sys 0.167s
W20260709 13:00:36.200114  2315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.053s	sys 0.167s
I20260709 13:00:36.200603  1501 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.185381  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 233) took 3098 ms. Trace:
I20260709 13:00:36.183848  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:36.203125  1598 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.139407  8047 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:36.136530  8070 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.137094  2311 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 13:00:36.215502  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:36.202129  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:36.216285  1752 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.137305  8136 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:00:36.220259  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.207494  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 16, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.185468  7956 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.224242  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:36.204728  1496 rpcz_store.cc:276] 0709 13:00:33.092004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.092239 (+   235us) service_pool.cc:224] Handling call
0709 13:00:36.185309 (+3093070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:33.631008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:33.732872 (+101864us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:33.734216 (+  1344us) write_op.cc:435] Acquired schema lock
0709 13:00:33.737404 (+  3188us) tablet.cc:662] Decoding operations
0709 13:00:33.862438 (+125034us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:33.932985 (+ 70547us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:33.940076 (+  7091us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:34.033913 (+ 93837us) tablet.cc:701] Row locks acquired
0709 13:00:34.033932 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:34.034173 (+   241us) write_op.cc:270] Start()
0709 13:00:34.034337 (+   164us) write_op.cc:276] Timestamp: P: 1783602034034102 usec, L: 0
0709 13:00:34.034362 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:34.035315 (+   953us) log.cc:844] Serialized 2089 byte log entry
0709 13:00:34.329616 (+294301us) op_driver.cc:464] REPLICATION: finished
0709 13:00:34.763813 (+434197us) write_op.cc:301] APPLY: starting
0709 13:00:34.778032 (+ 14219us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:34.850487 (+ 72455us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:34.850602 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:34.996914 (+146312us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:34.997187 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:00:34.997239 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:34.997510 (+   271us) log.cc:844] Serialized 57 byte log entry
0709 13:00:34.997712 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.997834 (+   122us) write_op.cc:454] Released schema lock
0709 13:00:34.997890 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:35.000172 (+  2282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:35.000209 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8192,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":407094,"apply.run_cpu_time_us":13072,"apply.run_wall_time_us":258676,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":14569,"prepare.run_cpu_time_us":7612,"prepare.run_wall_time_us":426250,"replication_time_us":276618,"thread_start_us":229427,"threads_started":1}]]}
I20260709 13:00:36.225812  1749 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:36.137365  8101 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.221818  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:36.235469  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.242822  1598 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:36.243736  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:36.205379  8083 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.217149  8070 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:00:36.361002  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 109275us
I20260709 13:00:36.249593  1743 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:36.253468  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.252781  1501 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.241483  7896 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.258652  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.247517  8105 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.208824  7991 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.180651  8106 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.410082  8106 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.251757  8060 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:00:36.248864  8148 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.344s	user 0.001s	sys 0.004s
I20260709 13:00:36.412456  7991 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.258030  8093 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:36.414958  1669 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: []
W20260709 13:00:36.419147  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.358037  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:36.191082  8097 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.426882  2313 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:36.359907  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:36.370239  7896 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.374390  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.245673  8107 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.216998  8050 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.139s
I20260709 13:00:36.413523  8060 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:00:36.405097  8129 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.010s
W20260709 13:00:36.421984  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 64194.3us
I20260709 13:00:36.404749   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:36.414603  7982 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.568s	user 0.020s	sys 0.006s
I20260709 13:00:36.413859  8093 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:36.453531  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 167687us
I20260709 13:00:36.479010  8093 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:36.479648  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.424448  8015 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:00:36.481583  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.436158  8095 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:36.482954  8095 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.485401  8095 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.431165  8114 raft_consensus.cc:2764] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:00:36.486502  1677 raft_consensus.cc:2410] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:00:36.487217  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.487764  7985 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:36.488374  7985 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:36.489660  8163 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:36.490818  1595 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:36.491058  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1391) took 1506 ms. Trace:
I20260709 13:00:36.491648  1745 rpcz_store.cc:276] 0709 13:00:34.984393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.984682 (+   289us) service_pool.cc:224] Handling call
0709 13:00:34.985192 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.985692 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.985748 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.986442 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.011902 (+1025460us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b18003ad320. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:00:36.187736 (+175834us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:36.187805 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.187904 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.490633 (+302729us) raft_consensus.cc:1685] finished
0709 13:00:36.490670 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.490966 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12532,"raft.queue_time_us":132,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4419,"spinlock_wait_cycles":4578688,"thread_start_us":175530,"threads_started":1,"wal-append.queue_time_us":1248768}
I20260709 13:00:36.455924  7982 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.458346  1673 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:36.459724  7991 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.363152  8007 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:36.460448  8157 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:00:36.462553  8109 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.463223  8062 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.430816  7896 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:36.466347  8161 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:36.466598  1598 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:36.467723  1600 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:36.469364  8097 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:36.400291  8061 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:36.470978  8136 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.472110  1676 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:36.474731  1743 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:00:36.476975  8011 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:36.440958  8060 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:36.497483  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.442004  1752 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:36.451989  8129 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.503428  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:36.428746  8105 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:36.513135  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:36.555116  8136 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.557507  8114 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.508910  7991 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.563683  7985 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:36.571609  1672 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:36.574479  7982 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:36.575997  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.577210  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.483016  8153 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:36.583292  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.588238  8130 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.594741  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91450.2us
W20260709 13:00:36.600329  1670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3055) took 1714 ms (client timeout 1572 ms). Trace:
I20260709 13:00:36.563663  8061 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.621439  1674 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.624657  1671 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
W20260709 13:00:36.676450  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.676904  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50159.2us
W20260709 13:00:36.677860  1670 rpcz_store.cc:269] 0709 13:00:34.880036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.880201 (+   165us) service_pool.cc:224] Handling call
0709 13:00:36.593798 (+1713597us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003e62d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:36.593966 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3600213888}
I20260709 13:00:36.681126  8054 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:36.684938  8054 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.507699  8051 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:00:36.590281  8011 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:36.695952  8124 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:00:36.696766  8152 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.602514  8097 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:36.605515  8104 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:36.623926  7991 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.697391  8152 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.705404  1674 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:36.571425  8070 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:36.709612  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 345329us
I20260709 13:00:36.553654  8062 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.675769  8106 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:00:36.713346  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.681718  8021 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.702347  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:36.687443  8054 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.611269  8114 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.730382  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:36.723659  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:36.724664  1749 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:36.725042  1671 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:36.732437  1671 pending_rounds.cc:85] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 8
I20260709 13:00:36.732774  1671 pending_rounds.cc:107] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:36.733071  1671 raft_consensus.cc:2889] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.734623  1598 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:36.735688  1602 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 24: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:36.737123  1749 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:00:36.737552  1749 pending_rounds.cc:85] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 10
I20260709 13:00:36.737255  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:36.737906  1749 pending_rounds.cc:107] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:00:36.738488  1749 raft_consensus.cc:2889] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.740427  1598 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:00:36.743119  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.743779  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:36.749543  1751 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:00:36.753908  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:36.715494  8091 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.679311  8130 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.760551  1598 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:00:36.762568  1598 pending_rounds.cc:85] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 13:00:36.762876  1598 pending_rounds.cc:107] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:00:36.763128  1598 raft_consensus.cc:2889] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.763037  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:36.764488  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:36.728556  8074 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:36.765379  1671 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:36.767786  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:36.730669  7982 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.770162  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:36.770623  8152 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.772795  1596 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:36.711573  8104 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.753582  8124 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:36.785120  1749 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:36.782461  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:36.753023  8159 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:00:36.762142  8076 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.007s
I20260709 13:00:36.720348  8106 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.765717  8051 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:36.712237  8060 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.786233  1670 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:36.790663  1675 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 13:00:36.789373  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 304616us
I20260709 13:00:36.779861  8082 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.788224  8152 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:36.765380  8091 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.729027  8021 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:36.797230  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:36.797521  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:36.799525  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.812755  8050 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:36.814144  8054 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:36.814560  8054 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:36.815522  8054 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.817195  8054 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.786926  8107 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.825091  8106 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.826164  8129 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.782351  7982 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:36.829535  7982 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:36.832402  7982 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:36.833599  8054 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:36.833163  8011 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.834429  8011 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.841166  8054 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:36.843029  8097 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:36.843438  8097 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:36.844308  8097 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.845512  8097 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:36.842892  8054 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.848544  8070 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.850813  7982 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:36.852304  7982 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:36.852675  7982 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:36.853760  7982 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.854875  7982 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.841811  8137 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:36.865033  1673 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:36.786746  8083 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.869225  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:36.866338  1746 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:36.791791  8074 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:36.874910  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:36.884603  1676 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:36.888808  1600 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:00:36.889601  1600 pending_rounds.cc:85] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 12
I20260709 13:00:36.792402  8082 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.890003  1671 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:36.890000  1600 pending_rounds.cc:107] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 16.13
W20260709 13:00:36.867461  8165 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:00:36.864293  8152 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:36.895452  8166 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.483s	user 0.004s	sys 0.006s
I20260709 13:00:36.878844  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:36.894853  8091 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.896306  2311 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:36.866925  8007 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.879487  7985 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.897403  8152 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.897809  8061 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.897768  7985 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.898907  8130 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.900525  7985 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.881443  8060 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.864616  8011 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:00:36.905519  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.892645  1600 raft_consensus.cc:2889] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.861581  8137 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:36.879266  8076 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:36.868216  8109 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:00:36.892477  8159 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.932430  8159 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.936056  8086 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:36.904316  8105 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.936580  8086 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:36.937635  8086 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.937817  8137 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.925256  8082 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.927323  8021 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.928082  8062 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:36.935237  8159 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.941087  8104 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:36.941982  8076 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:36.952250  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:36.983054  1715 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.519s (SENT)
I20260709 13:00:36.944566  8137 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:37.004304  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.012346  8076 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.013893  8064 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.014552  8064 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:37.015196  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.016857  8064 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.025606  8124 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:37.026222  8124 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:37.028143  8082 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.028740  8082 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.031005  8082 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:36.986842  7985 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:37.031872  7985 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.027282  8124 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.032302  7985 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:37.031219  1746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3139) took 1789 ms (client timeout 1744 ms). Trace:
W20260709 13:00:37.032800  1746 rpcz_store.cc:269] 0709 13:00:35.241901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.242096 (+   195us) service_pool.cc:224] Handling call
0709 13:00:37.030957 (+1788861us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540040abd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:37.031083 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3185113856}
W20260709 13:00:37.036393  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.039248  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 276211us
I20260709 13:00:37.043682  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:37.044924  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.039878  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 253863us
I20260709 13:00:37.049588  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:37.052763  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.985585  7896 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.058300  8067 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:00:37.061771  7997 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:37.062676  7997 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.047489  8064 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.049165  8137 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:37.064132  8062 raft_consensus.cc:2764] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:00:37.077361  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.081133  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.054174  8105 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:00:37.059182  8082 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:00:37.085394  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.085924  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.086526  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:37.088683  1598 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.088599  1602 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:37.092406  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.090173  8176 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:37.096487  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.097148  1599 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:37.100740  2314 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEARNER]: Advancing to term 16
I20260709 13:00:37.102799  1599 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:37.102452  1598 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:37.104949  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.105669  1599 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:37.108376  7997 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.109016  8114 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.109558  8136 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.111292  1595 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:37.113340  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.114171  1599 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:37.116204  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.117195  1598 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:37.120445  8054 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:37.120671  8114 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.121371  8114 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.124228  8114 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.079281  8076 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:00:37.072403  8067 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:37.131910  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.131973  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:37.133683  1599 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:37.133764  1598 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.074721  8152 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:00:37.140735  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.135726  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.135950  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:37.136498  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.142376  1595 raft_consensus.cc:2368] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:00:37.142531  1594 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:00:37.099618  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.137082  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.087965  8137 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:37.075397  8064 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.138688  7991 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.138911  7985 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.105360  8087 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:00:37.139945  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 1463) took 1228 ms. Trace:
I20260709 13:00:37.155654  1675 rpcz_store.cc:276] 0709 13:00:35.916927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.917943 (+  1016us) service_pool.cc:224] Handling call
0709 13:00:37.139753 (+1221810us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b5400194454. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:37.139876 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003968896}
I20260709 13:00:37.157866  1598 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 13:00:37.159098  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.142915  1599 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:37.143049  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.141420  1597 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:37.161211  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.150102  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.152609  1596 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:00:37.166280  1603 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
W20260709 13:00:37.268245  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 104979us
W20260709 13:00:37.198664  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.273681  1745 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.276433  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.277534  1603 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
W20260709 13:00:37.269573  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.292243  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.286548  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.295078  1597 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:37.297950  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:37.298661  1603 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.301241  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.287317  1598 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:00:37.302006  1601 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:37.302245  1598 pending_rounds.cc:85] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 13:00:37.267925  7990 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:37.272848  8076 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:37.304303  1597 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:00:37.313489  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.314862  2314 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:37.155905  8137 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.272373  8117 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:37.268666  8114 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:37.272028  8097 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.296788  8176 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.271070  8175 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:37.275521  8047 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.311295  1596 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:37.312458  1598 pending_rounds.cc:107] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:00:37.305101  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.306744  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.326184  1594 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:37.314574  1595 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:37.277587  8083 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:37.318456  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.341954  8086 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:37.327615  1598 raft_consensus.cc:2889] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:37.335150  8159 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.331413  8153 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.343070  8159 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:37.338120  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.339706  8021 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.345207  8021 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.340219  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.348053  8129 raft_consensus.cc:1064] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
W20260709 13:00:37.348588  8129 raft_consensus.cc:1068] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Unable to promote non-voter 570958eb733a4af7ae16ae020998c8b4: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:00:37.349225  8178 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:00:37.297200  8168 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:00:37.325819  1601 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:37.342049  1597 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:37.353951  1601 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:00:37.340826  8047 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.342263  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:37.350283  8124 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.361483  1595 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:00:37.356321  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 123242us
I20260709 13:00:37.277092  8082 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:00:37.283483  8075 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:00:37.360237  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:37.368448  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.371348  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.383733  1600 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:37.383795  2314 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:00:37.323863  8076 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:37.325789  7896 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.385242  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.377573  8083 consensus_queue.cc:1243] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:37.317656  7990 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.350973  8117 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:37.368263  8050 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.401031  2311 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.410380  7985 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.398361  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:37.416275  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.370849  8011 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:37.437282  8117 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.420751  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:37.438198  8136 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:37.438675  8136 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.439054  8136 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:37.390046  8054 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:37.439864  8054 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:37.440302  8054 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.446224  8047 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.351439  8176 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:37.448864  8155 log.cc:927] Time spent T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 1.044s	user 0.005s	sys 0.000s
I20260709 13:00:37.450563  8137 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:37.451217  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.356153  8175 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.454284  1603 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:37.327194  8114 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.418514  8093 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.435990  8021 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:37.417809  7982 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.007s
I20260709 13:00:37.398993  8062 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:37.388960  8130 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.462059  1594 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:37.467622  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.327432  8097 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:37.455683  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.378170  8129 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:00:37.418732  7924 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.465978  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.447394  8159 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.471431  1678 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:37.489903  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.490847  1674 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:37.469218  8109 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.488780  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.489625  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.492718  1672 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:00:37.488646  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.460427  8011 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:37.493927  1676 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:37.508599  1599 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:37.428908  8050 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.490355  8047 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:37.498085  8109 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.516891  8109 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.519845  8176 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.489629  8061 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:37.489344  7991 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.539924  7990 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.543561  8169 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.529405  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 214753us
I20260709 13:00:37.547313  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.550031  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.550364  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.551054  1677 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:37.551626  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.551862  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.488190  8093 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.556241  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:37.556468  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.544369  8169 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.559096  1678 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:37.562790  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.561556  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.564563  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.496312  7985 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:00:37.515165  8047 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:37.571746  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.492908  7924 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.570013  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:37.572551  1674 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:37.573036  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.527372  8064 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.482923  8130 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.577193  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.546331  8097 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.580334  1678 raft_consensus.cc:2368] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
W20260709 13:00:37.569362  8060 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.007s
I20260709 13:00:37.577731  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:37.591127  1677 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:37.580499  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 125621us
I20260709 13:00:37.590075  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.593613  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:37.510546  8076 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.595016  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.600724  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:37.602695  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.605976  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:37.607342  8193 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:37.633797  8193 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:37.634321  8193 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.634704  8193 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:37.611698  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 103018us
I20260709 13:00:37.580721  8064 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.604990  8062 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:37.620201  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.591817  8175 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.639873  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.640403  1745 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:37.649437  1603 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:37.628031  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.653959  1674 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:37.586318  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.660754  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:37.670645  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.671583  1678 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:00:37.671876  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:37.672770  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.672875  8124 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:37.673305  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:37.674106  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.674314  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:37.674957  1744 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:37.675704  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:37.674690  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.677748  1746 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:37.677773  1674 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:37.680074  1600 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.681723  1669 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:37.682770  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:37.687217  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.689095  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:37.689692  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.690001  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.691443  1566 leader_election.cc:400] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
I20260709 13:00:37.691957  1566 leader_election.cc:403] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:37.687960  1676 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:37.694494  1677 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:37.583104  8011 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.701527  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.663420  8062 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.705292  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:37.682412  7991 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.712033  1743 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:37.720001  1744 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:37.720148  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:37.713285  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.683472  8124 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:37.723389  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:37.674199  8097 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:37.724203  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:37.734109  2313 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:37.703962  8159 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:37.696688  7990 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:37.728206  8124 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.736099  8124 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:37.725154  8114 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.730298  8094 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:37.739811  8094 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:37.740295  8047 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.667903  8064 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:37.741072  1600 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:37.740823  8094 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.683848  8176 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.730535  7991 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.741882  8094 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.742235  8176 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.742717  8064 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.743736  7991 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.745208  8176 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.707116  8021 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 12. Current term is 13.
W20260709 13:00:37.749698  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.732220  8136 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:37.752321  1595 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:00:37.726127  1746 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:37.702323  8192 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:37.725610  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.757315  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:37.760234  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 154344us
I20260709 13:00:37.761382  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:37.758294  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:37.708225  8109 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:00:37.782526  8186 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.306s	user 0.000s	sys 0.004s
I20260709 13:00:37.753108  8117 raft_consensus.cc:2764] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:00:37.769385  7924 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.758239  8015 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:00:37.722039  8062 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:37.778717  8130 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.768319  8067 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:37.761684  8168 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:37.767792  8082 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:37.767285  8169 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.765830  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.790946  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:37.795095  1749 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:37.801101  7932 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.802368  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.804672  1752 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:00:37.839704  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48914.3us
I20260709 13:00:37.806167  1751 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:00:37.810626  1750 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:00:37.840988  1750 pending_rounds.cc:85] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 11
I20260709 13:00:37.841248  1750 pending_rounds.cc:107] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:00:37.799144  1715 leader_election.cc:400] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:00:37.754805  8192 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:37.762902  8021 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.824190  8050 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.760196  8047 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:37.760627  8176 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:00:37.841275  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:37.841670  1715 leader_election.cc:403] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:00:37.841482  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:37.872809  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73832us
I20260709 13:00:37.826998  7985 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:37.875406  1671 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:37.841506  1750 raft_consensus.cc:2889] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:37.832341  8067 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:37.851765  8021 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.852161  8047 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.857342  8136 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.823938  8109 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:00:37.838119  8082 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.884018  8067 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.893566  8082 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:37.845530  8169 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:37.861317  8193 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:37.862169  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.861779  8124 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.838989  8087 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:00:37.864038  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.845170  7932 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.873276  1751 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:37.873970  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:37.846835  8093 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:37.874552  8130 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:37.911373  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.912370  7932 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.912693  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.913978  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.915056  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:37.917088  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:37.918025  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:37.918557  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.918821  8136 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:37.919654  8136 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:37.921129  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.920949  8136 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:37.835033  8168 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:37.922036  1749 raft_consensus.cc:2410] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:00:37.922315  8168 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:37.923789  8050 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:37.924501  8060 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:37.922900  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.882861  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.844578  8192 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:37.886551  8015 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:37.888019  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.929569  1750 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
W20260709 13:00:37.889164  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.930171  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.875991  7985 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:37.937525  7985 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:37.937598  8193 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.900725  8169 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:37.909409  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.939178  8169 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:37.939505  1752 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:37.844336  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:37.940538  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:37.940793  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 96583.1us
I20260709 13:00:37.941427  1752 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:37.941927  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:37.942329  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.942531  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.958739  1752 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:37.926133  1746 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:37.924929  8060 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.918910  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:37.932029  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.924382  8050 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.924326  8021 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.942739  8093 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:37.943602  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:37.921173  8124 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:37.944475  8109 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:37.941817  8087 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:37.980237  1747 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:37.945657  8117 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:37.947506  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:37.949198  8054 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.002s
I20260709 13:00:37.953933  8047 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:37.936935  8076 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:37.961006  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.988574  1746 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:37.989637  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.990319  1746 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:37.962584  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:37.892526   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.966280  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.981891  8109 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.993702  1749 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 13:00:37.993772  8109 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:37.995216  1749 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:00:37.968253  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.995887  1752 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:37.945148  8015 consensus_queue.cc:1243] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:37.960470  8050 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:37.985137  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.997642  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
W20260709 13:00:38.003692  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.013639  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.015043  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:37.961510  8060 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:38.016441  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 53987.3us
I20260709 13:00:37.984176  8094 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:38.019264  1746 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:37.980602  8087 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:37.954022  8082 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.037840  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:37.988341  8129 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:38.038828  1749 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:38.042430  1749 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:38.044639  1749 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:38.018357  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:37.987979  8076 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:38.050822  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.051926  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.056412  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.057570  1677 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 13: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:38.057778  1746 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:38.038373  8087 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:38.059341  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.060123  1672 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:38.061045  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.016044  8095 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:00:38.037420  8028 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:38.064919  8028 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.065768  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:38.066381  2313 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:00:38.067123  8028 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.075802  7982 raft_consensus.cc:2764] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:38.075891  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:38.077307  1603 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:38.079501  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:38.080331  2314 raft_consensus.cc:2393] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:38.082170  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.084014  2311 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:38.090015  1603 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:38.097652  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.098863  2309 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 13:00:38.101351  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.101130  8076 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.102950  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.103832  1749 raft_consensus.cc:2368] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:00:38.111584  8192 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.113006  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.116219  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.103320  8076 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.116835  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:38.117516  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.119333  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.121279  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.122691  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.123433  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.123872  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.124148  1602 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:38.124058  7985 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.125262  1743 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:38.123396  1677 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 13:00:38.032202  8047 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:38.136859  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 193) took 3098 ms. Trace:
I20260709 13:00:37.989917  8054 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.139199  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.154291  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.038105  8094 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:38.157294  1750 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:38.159951  8075 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:38.160969  8094 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.163228  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:38.163749  8082 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.155398  1597 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 26.
I20260709 13:00:38.166087  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.167228  1602 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:38.172768  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:38.178639  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:38.180130  1749 raft_consensus.cc:2393] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 10: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:38.188226  1752 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:38.190811  2313 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:38.129465  8047 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.196400  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.198256  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:38.137678  1501 rpcz_store.cc:276] 0709 13:00:35.038804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.052011 (+ 13207us) service_pool.cc:224] Handling call
0709 13:00:38.136734 (+3084723us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:36.788891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:36.820683 (+ 31792us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:36.820736 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:00:36.820754 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:36.821488 (+   734us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:36.821553 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:36.821582 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:36.822153 (+   571us) tablet.cc:701] Row locks acquired
0709 13:00:36.822171 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:36.822358 (+   187us) write_op.cc:270] Start()
0709 13:00:36.822489 (+   131us) write_op.cc:276] Timestamp: P: 1783602036822296 usec, L: 0
0709 13:00:36.822511 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:36.823272 (+   761us) log.cc:844] Serialized 2152 byte log entry
0709 13:00:37.418372 (+595100us) op_driver.cc:464] REPLICATION: finished
0709 13:00:37.774347 (+355975us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f947e3830ac 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f9484ec3ef0
0709 13:00:37.800980 (+ 26633us) write_op.cc:301] APPLY: starting
0709 13:00:37.801134 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:37.811895 (+ 10761us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:37.811938 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:37.818637 (+  6699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:37.819015 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:00:37.819086 (+    71us) write_op.cc:312] APPLY: finished
0709 13:00:37.819423 (+   337us) log.cc:844] Serialized 57 byte log entry
0709 13:00:37.819734 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:37.819903 (+   169us) write_op.cc:454] Released schema lock
0709 13:00:37.819971 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:37.820553 (+   582us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:37.820606 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147507,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":382059,"apply.run_cpu_time_us":12317,"apply.run_wall_time_us":19609,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":341387,"prepare.run_cpu_time_us":31783,"prepare.run_wall_time_us":303713,"raft.queue_time_us":268735,"raft.run_cpu_time_us":10014,"raft.run_wall_time_us":413936,"replication_time_us":589210,"spinlock_wait_cycles":6621440,"thread_start_us":926804,"threads_started":4,"wal-append.queue_time_us":284012}]]}
I20260709 13:00:38.118849  8062 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.116293  8192 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:38.232576  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:38.230784  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52244.5us
I20260709 13:00:38.176488  8011 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:38.244793  1749 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:00:38.193439  8200 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:38.197781  8047 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:38.251050  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45946.4us
I20260709 13:00:38.264298  1745 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:38.232654  8130 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
W20260709 13:00:38.259933  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.260847  1752 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:38.199944  8194 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.251370  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:38.185895  8109 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.237810  8050 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.265959  7990 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.305140  1500 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 7 to 9, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.231410  8117 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:00:38.336560  1500 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 19, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:38.295650  7982 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:38.279633  8194 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.293490  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 128) took 4698 ms. Trace:
I20260709 13:00:38.236986  7991 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:38.248651  8136 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:38.338551  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:38.262984  8193 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:38.355372  1752 raft_consensus.cc:606] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.355933  1752 raft_consensus.cc:614] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:38.346213  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.339341  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 21, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 13:00:38.358443  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.354923  1497 rpcz_store.cc:276] 0709 13:00:33.594847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.599772 (+  4925us) service_pool.cc:224] Handling call
0709 13:00:38.293365 (+4693593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283974,"reported_tablets":7}
W20260709 13:00:38.361348  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.373378  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.377015  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.254274  8011 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.354308  7982 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.403434  1747 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:00:38.407137  1751 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:38.272480  8200 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.391649  8124 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:38.349646  7990 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.394986  8021 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:38.371747  7991 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.408699  7982 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:38.418979  8060 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.429347  7985 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:38.436421  7985 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.436733  8050 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:38.437312  7985 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.439134  7991 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:38.373808  8193 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.391772  7997 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:38.455201  7990 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.456040  7990 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.456291  8193 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:38.456643  7990 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.459380  8060 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:38.460237  8209 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:00:38.460557  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.461311  7985 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:38.441215  8054 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:38.459189  7990 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.472647  8109 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.473623  8109 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:38.472504  8062 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:38.475028  8109 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.483747  8109 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:38.484666  8194 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:38.485919  8208 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:38.436738  8124 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:38.436455  8169 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.505540  8200 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:38.514880  8169 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.517926  8047 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.520403  8087 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.523155  8087 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:38.526458  8011 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:38.534893  8067 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.001s
I20260709 13:00:38.558991  1747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22373089b38b498393c2161e53b5f016"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
W20260709 13:00:38.558648  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 290425us
I20260709 13:00:38.560076  1747 raft_consensus.cc:606] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.560751  1747 raft_consensus.cc:614] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:38.562788  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:38.615121  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:38.618866  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.627523  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.632668  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.557535  8067 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:38.615077  8129 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.639072  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.648360  1678 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21.
I20260709 13:00:38.641834  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.649371  1674 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
W20260709 13:00:38.636602  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 283255us
I20260709 13:00:38.639981  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.650471  2279 leader_election.cc:400] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:00:38.650794  2279 leader_election.cc:403] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:38.640296  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.645901  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:38.645907  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:38.638443  1673 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:38.651345  1677 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:38.646708  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 269757us
I20260709 13:00:38.641112  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.652851  1671 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:38.612795  8124 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:38.658833  1676 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:38.624979  8054 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.661345  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.662108  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.661571  1670 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:38.663635  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.665679  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.665236  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.665210  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.669194  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:38.675028  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 410300us
I20260709 13:00:38.647821  8129 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.681728  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.685237  1603 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:38.685649  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.687997  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:38.660933  8215 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:38.664830  7990 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:38.708041  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.709489  1596 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:38.681767  1677 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:38.698501  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:38.700897  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:00:38.684265  8047 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:38.671913  8021 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:38.715210  1746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69370730433544db93e2c777aba2b9b2"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:38.779574  1746 raft_consensus.cc:606] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:38.780201  1746 raft_consensus.cc:614] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:38.777647  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 79239.5us
I20260709 13:00:38.781679  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.687633  8129 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.682802  8221 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:00:38.793228  1600 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 8
I20260709 13:00:38.785787  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:38.788901  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.793706  1600 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:00:38.794081  1600 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.794374  1671 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:38.790463  1677 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:38.668804  8054 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.665844  8124 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.671432  7982 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:38.800546  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 112655us
W20260709 13:00:38.805256  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 136138us
I20260709 13:00:38.806130  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.806478  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.803455  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:38.698077  7991 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:38.816591  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:38.817462  1669 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:38.820941  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:38.791016  7744 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:38.880829  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:38.881598  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60761.8us
I20260709 13:00:38.882548  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.884665  1596 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:38.795169  7990 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:38.891880  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:38.893162  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.893433  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.895835  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.896939  1752 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:38.888756  1595 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
W20260709 13:00:38.891783  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 110205us
W20260709 13:00:38.901943  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 111493us
I20260709 13:00:38.902496  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.805111  8194 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:38.898417  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.914469  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:38.880604  8076 consensus_meta.cc:287] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.764s	user 0.014s	sys 0.000s
I20260709 13:00:38.921365  1751 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:38.915694  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.819034  7991 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:38.820030  8176 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.931092  1746 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:00:38.925925  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.988040  1750 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:00:38.904448  8219 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:38.712585  8215 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:38.940127  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:38.941016  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:38.975977  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.910077  7717 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:38.911194  8062 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:00:38.980499  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49046.2us
I20260709 13:00:38.899307  8130 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.887123  8011 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:38.989271  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:38.818392  8231 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:38.994728  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91345.9us
I20260709 13:00:38.996228  1596 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:39.001801  1744 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:39.016376  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:39.032164  1595 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:38.936616  8221 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:39.041504  1750 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:39.000133  8219 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.922372  8122 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:00:39.050117  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:39.059167  1596 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:39.050673  1751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:39.062260  1751 raft_consensus.cc:606] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:38.994462  7990 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:39.065209  8216 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.065469  8234 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:00:39.067034  8227 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:39.068344  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:39.070870  8223 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.071853  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:39.072561  8207 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.802s	user 0.011s	sys 0.007s
I20260709 13:00:39.072911  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:39.074455  8082 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:39.074782  1750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:39.079769  1595 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:39.020982  8062 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.997279  8176 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.028885  7717 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:00:39.123620  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 317176us
I20260709 13:00:39.127310  1750 raft_consensus.cc:606] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:39.128186  1744 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:39.142558  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:39.107292  8221 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:39.127199  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:39.131150  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:39.015853  8094 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:00:39.051664  8067 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.100237  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:39.164812  1746 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:39.133553  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60727.1us
I20260709 13:00:39.058586  8219 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:39.138916  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:39.128358  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.148545  8124 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.148800  7744 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:39.151732  8213 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.698s	user 0.008s	sys 0.004s
I20260709 13:00:39.152840  2311 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:39.153388  8054 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.138693  8011 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.130854  7991 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:39.232976  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50454.9us
I20260709 13:00:39.233539  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:39.044561  8130 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.155565  1596 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
W20260709 13:00:39.239964  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45125.5us
I20260709 13:00:39.156358  8215 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.156929  8176 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.259111  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.260541  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:39.155613   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:39.173832  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:39.134886  8062 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:39.137059  8220 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:39.178855  8117 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:00:39.269644  8215 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:39.137418  8021 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.144119  8230 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.111016  7990 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.183490  7744 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:39.278913  8028 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:39.180909  8233 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:39.183733  8060 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:39.263376  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 89664.7us
I20260709 13:00:39.281509  8176 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:39.301620  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:39.306386  1669 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:39.257403  1598 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:39.263376   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:39.267513  1747 raft_consensus.cc:2376] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18. Re-sending same reply.
I20260709 13:00:39.268885  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3181) took 1457 ms. Trace:
I20260709 13:00:39.270916  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:39.275713  8249 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.283146  8076 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:00:39.195312  8224 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:00:39.240041  8011 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.250649  1596 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:39.276569  7932 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:00:39.191380  8217 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:00:39.301445  8195 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.325709  1748 rpcz_store.cc:276] 0709 13:00:37.811614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.811769 (+   155us) service_pool.cc:224] Handling call
0709 13:00:37.812171 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.831044 (+ 18873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.831078 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.831737 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.032102 (+200365us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:38.032150 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.032238 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:38.931764 (+899526us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:39.260141 (+328377us) raft_consensus.cc:1685] finished
0709 13:00:39.260184 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.268772 (+  8588us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14597,"raft.queue_time_us":14494,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":2816,"spinlock_wait_cycles":14168320,"thread_start_us":199895,"threads_started":1,"wal-append.queue_time_us":365541}
I20260709 13:00:39.119647  8216 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.333877  7990 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.300081  7717 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.323320  8028 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.337080  7744 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.131772  8223 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:39.296741  8064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.030s
I20260709 13:00:39.184255  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:39.398907  8232 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:39.243237  8109 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:00:39.464165  1752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.017s
W20260709 13:00:39.465466  1752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.010s	sys 0.017s
I20260709 13:00:39.297519  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.325511  8060 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:39.398308  1746 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
W20260709 13:00:39.398619  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.381557  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:39.384318  1672 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:00:39.296247  8220 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:00:39.297179  8021 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.371800  8054 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:39.373157  8231 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.689126  8231 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:39.443673  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.399399  8176 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:00:39.450577  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 266394us
I20260709 13:00:39.285086  8243 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.393311  8194 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.300457  8230 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:39.471069  8168 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.548s	user 0.021s	sys 0.000s
W20260709 13:00:39.457226  8064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.016s	sys 0.030s
W20260709 13:00:39.606374  8237 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 13:00:39.504522  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 207196us
I20260709 13:00:39.779866  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.472333  8060 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.470803  7744 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:39.441507  8028 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:39.458303  7990 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:39.424650  8195 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.297585  8221 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.357780  8249 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.669812  8216 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.671710  7985 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.676291  1752 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:39.682927  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.685477  8220 consensus_queue.cc:1243] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:39.686753  8021 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.686960  8223 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.692404  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:39.808686  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 427283us
W20260709 13:00:39.809614  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 117280us
I20260709 13:00:39.810118  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:39.692401  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3325) took 1003 ms. Trace:
I20260709 13:00:39.691524  8176 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:39.662571  8082 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:39.660734  8075 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.662098  8076 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.665584  8086 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:39.784310  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.766393  8054 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.796123  2313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.038s	sys 0.095s
W20260709 13:00:39.840068  2313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.038s	sys 0.096s
I20260709 13:00:39.758383  8231 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:39.757858  8194 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.811299  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:39.782709  8130 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.811731  1603 rpcz_store.cc:276] 0709 13:00:38.688606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.689894 (+  1288us) service_pool.cc:224] Handling call
0709 13:00:38.690249 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.817963 (+127714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.818002 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.883499 (+ 65497us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.193920 (+310421us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:39.193966 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.194048 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.692166 (+498118us) raft_consensus.cc:1685] finished
0709 13:00:39.692190 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.692330 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31335,"raft.queue_time_us":301698,"raft.run_cpu_time_us":9702,"raft.run_wall_time_us":31186,"thread_start_us":330826,"threads_started":2,"wal-append.queue_time_us":540519}
I20260709 13:00:39.790684  8094 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:39.802480  7990 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.851953  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:39.817353  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:39.781167  8168 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:39.839063  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 54838.7us
I20260709 13:00:39.852907  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:39.853618  1673 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:39.790355  8087 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:39.848846  1677 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:00:39.766363  8243 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.855052  1677 pending_rounds.cc:85] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 8
I20260709 13:00:39.873162  1677 pending_rounds.cc:107] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 15.9
W20260709 13:00:39.873338  8257 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:39.873519  1677 raft_consensus.cc:2889] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.850670  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:39.858158  8263 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:00:39.858543  2281 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.047s	sys 0.079s
W20260709 13:00:39.878298  2281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.048s	sys 0.080s
W20260709 13:00:39.859346  8252 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:00:39.877480  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.859977  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:39.861901  8230 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.862188  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:39.862426  8011 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.863772  8220 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:39.864521  8130 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.886070  8130 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.863791  7990 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.866148  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:39.886837  8219 consensus_meta.cc:287] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
I20260709 13:00:39.866478  8194 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.820866  8082 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.868376  1669 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:39.869364  8249 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.869704  8168 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.852245  8075 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.932801  8130 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.872326  7896 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:39.880174  1670 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:39.829677  8223 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:39.934460  8062 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.000s
I20260709 13:00:39.935379  8223 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:39.935895  8062 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.936069  8223 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.936759  8117 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:39.937183  8117 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:39.938476  8223 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.938146  8117 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.934417  8075 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:39.939987  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3333) took 1131 ms. Trace:
W20260709 13:00:39.941488  8129 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.137s	user 0.014s	sys 0.002s
I20260709 13:00:39.940528  1595 rpcz_store.cc:276] 0709 13:00:38.809136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.129668 (+320532us) service_pool.cc:224] Handling call
0709 13:00:39.130902 (+  1234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.137574 (+  6672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.137610 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.143597 (+  5987us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.321668 (+178071us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:39.321905 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.322008 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.939627 (+617619us) raft_consensus.cc:1685] finished
0709 13:00:39.939658 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.939897 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6171,"raft.queue_time_us":6909,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":18587,"thread_start_us":173536,"threads_started":1,"wal-append.queue_time_us":323151}
I20260709 13:00:39.941951  8129 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.883107  8011 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.851992  8054 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.943006  8011 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.944849  8054 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.945257  7982 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:39.852907  8086 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:00:39.887614  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 76383.3us
I20260709 13:00:39.854121  8064 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.947115  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:39.947956  8086 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:39.948310  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3327) took 1241 ms. Trace:
I20260709 13:00:39.948765  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.950489  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.945778  1745 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:39.851675  8095 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.953011  8095 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.953624  8095 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.954593  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3190) took 1062 ms. Trace:
I20260709 13:00:39.958213  8232 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:39.958851  8232 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:39.875247  8087 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.959971  8087 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:39.954869  8233 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.001s
I20260709 13:00:39.922890  8246 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:39.922978  8230 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.922897  8021 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.874720  8243 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:39.883028  1673 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:39.945338  8011 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.945781  8150 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:39.851418  8094 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:39.955889  8249 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:39.956275  8124 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:39.837486  8076 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:39.881624  8192 raft_consensus.cc:1064] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:00:39.929050  8082 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:39.963853  8223 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:39.938494  8062 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.922926  8231 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.970005  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.975107  8195 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:39.882166  8215 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:39.957463  1745 rpcz_store.cc:276] 0709 13:00:38.892184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.898009 (+  5825us) service_pool.cc:224] Handling call
0709 13:00:39.954325 (+1056316us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540013a954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:39.954513 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356099968}
I20260709 13:00:39.948834  1600 rpcz_store.cc:276] 0709 13:00:38.707676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.708096 (+   420us) service_pool.cc:224] Handling call
0709 13:00:38.792912 (+ 84816us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:39.070557 (+277645us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 13:00:39.158994 (+ 88437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.159038 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:39.340673 (+181635us) log.cc:844] Serialized 532 byte log entry
0709 13:00:39.398506 (+ 57833us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:39.398563 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.399101 (+   538us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.947751 (+548650us) raft_consensus.cc:1685] finished
0709 13:00:39.947776 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.948227 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98123,"raft.queue_time_us":259839,"raft.run_cpu_time_us":2143,"raft.run_wall_time_us":4725,"spinlock_wait_cycles":6245760,"thread_start_us":272232,"threads_started":2,"wal-append.queue_time_us":78296}
I20260709 13:00:39.992452  1715 leader_election.cc:400] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21.
I20260709 13:00:40.001485  8216 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.040580  1715 leader_election.cc:403] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.994421  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3322) took 1311 ms. Trace:
W20260709 13:00:40.041484  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49218.7us
I20260709 13:00:40.050079  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:40.042116  1597 rpcz_store.cc:276] 0709 13:00:38.683285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.683465 (+   180us) service_pool.cc:224] Handling call
0709 13:00:38.684022 (+   557us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:38.705725 (+ 21703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.705767 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:38.791682 (+ 85915us) log.cc:844] Serialized 52 byte log entry
0709 13:00:39.300335 (+508653us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:39.356935 (+ 56600us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.357229 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.357329 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.994145 (+636816us) raft_consensus.cc:1685] finished
0709 13:00:39.994173 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.994348 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17769,"prepare.queue_time_us":58850,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":197447,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":29770,"thread_start_us":391198,"threads_started":2,"wal-append.queue_time_us":945443}
I20260709 13:00:39.876332  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:39.980319  8117 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:39.933314  8219 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:39.993084  7991 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.034066  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 65509.8us
I20260709 13:00:39.996239  8233 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:40.121460  2313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36896 (request call id 456) took 1082 ms. Trace:
I20260709 13:00:40.122093  2313 rpcz_store.cc:276] 0709 13:00:39.038565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.038733 (+   168us) service_pool.cc:224] Handling call
0709 13:00:39.039133 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.139666 (+100533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.139753 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.141373 (+  1620us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.848308 (+706935us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:39.848356 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.848436 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.121055 (+272619us) raft_consensus.cc:1685] finished
0709 13:00:40.121097 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.121360 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36579,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13489,"thread_start_us":797163,"threads_started":2,"wal-append.queue_time_us":921000}
I20260709 13:00:40.128185  8087 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.130085  8192 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 13, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.070305  8129 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.011700  8124 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:40.054287  8011 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21.
I20260709 13:00:40.056347  8216 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.132196  8124 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:40.013355  8150 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.105688  8094 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.134402  8094 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:40.135946  8150 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.079998  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3324) took 1391 ms. Trace:
I20260709 13:00:40.137372  1602 rpcz_store.cc:276] 0709 13:00:38.688237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.688891 (+   654us) service_pool.cc:224] Handling call
0709 13:00:38.689295 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.790963 (+101668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.791032 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.792105 (+  1073us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.928179 (+136074us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:38.928259 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.928339 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.079657 (+1151318us) raft_consensus.cc:1685] finished
0709 13:00:40.079689 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.079908 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4183,"raft.queue_time_us":245136,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":23522,"thread_start_us":221796,"threads_started":2,"wal-append.queue_time_us":1089294}
I20260709 13:00:40.139827  1749 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:40.088773  7990 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:40.140542  8240 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.988s	user 0.009s	sys 0.009s
I20260709 13:00:40.101938  8076 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.039363  8243 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:40.008558  8021 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.039677  8231 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.035444  8223 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:40.055220  8215 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.005597  8230 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.068763  8062 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:00:40.111476  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 235213us
I20260709 13:00:40.062281  8249 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:40.112304  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 60796.3us
I20260709 13:00:40.167528  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:40.169600  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:40.170943  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:40.115904  7932 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:40.115953  8246 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:40.116607  8200 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:40.119673  8028 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.120730  7991 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:40.106601  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.163151  8223 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:40.107756  7896 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:40.137821  8219 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:40.112934  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:40.131464  8087 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.172611  8011 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.178529  8129 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:40.033041  8176 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:40.190219  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.160905  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3191) took 1268 ms. Trace:
I20260709 13:00:40.164260  8062 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.190486  7932 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:40.201732  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 288021us
I20260709 13:00:40.172477  8274 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.175717  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.204674  2309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 457) took 1151 ms. Trace:
I20260709 13:00:40.205823  1676 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:40.187436  8064 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:40.205946  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3329) took 1421 ms. Trace:
I20260709 13:00:40.178215  8249 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:40.241549  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.178910  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:40.178649  8047 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:40.217933  8028 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.219874  8021 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.159137  8243 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:40.201493  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 88674.7us
I20260709 13:00:40.193915  7982 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:40.261147  8243 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.261608  7982 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:40.212847  1749 rpcz_store.cc:276] 0709 13:00:38.892553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.906393 (+ 13840us) service_pool.cc:224] Handling call
0709 13:00:38.906912 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.140397 (+1233485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.160499 (+ 20102us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400284e54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:40.160810 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834495360}
W20260709 13:00:40.224005  8267 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260709 13:00:40.230849  7991 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:40.231719  7990 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:40.232590  8231 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.232899  8230 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:40.235733  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 60088.5us
I20260709 13:00:40.206382  8246 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:00:40.237360  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.272787  8246 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:40.273002  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:40.240875  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.237141  1599 rpcz_store.cc:276] 0709 13:00:38.784369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.784573 (+   204us) service_pool.cc:224] Handling call
0709 13:00:38.785162 (+   589us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:38.887207 (+102045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.887250 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:38.888042 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 13:00:39.019824 (+131782us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:39.019887 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.019987 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.139823 (+1119836us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:40.200398 (+ 60575us) raft_consensus.cc:1685] finished
0709 13:00:40.200436 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.205870 (+  5434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24178,"raft.queue_time_us":237945,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":35168,"spinlock_wait_cycles":16567552,"thread_start_us":35382,"threads_started":1,"wal-append.queue_time_us":202649}
I20260709 13:00:40.235318  2309 rpcz_store.cc:276] 0709 13:00:39.053562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.053705 (+   143us) service_pool.cc:224] Handling call
0709 13:00:40.201602 (+1147897us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540053fa54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:40.204595 (+  2993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2181455104}
I20260709 13:00:40.244899  8216 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.245990  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3339) took 1315 ms. Trace:
I20260709 13:00:40.245869  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:40.248448  8064 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:40.247040  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68215.1us
I20260709 13:00:40.226167  8062 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:40.236630  8214 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.259087  8215 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.292659  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:40.263392  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.265102  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:40.300552  1601 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:40.246587  8249 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:40.237164  8129 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:40.245208  8176 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:40.275179  1596 rpcz_store.cc:276] 0709 13:00:38.930798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.374387 (+443589us) service_pool.cc:224] Handling call
0709 13:00:39.374801 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.791346 (+416545us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:39.803673 (+ 12327us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.994886 (+191213us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.084851 (+ 89965us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800464b60. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:00:40.172968 (+ 88117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:40.173043 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:40.173137 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.245722 (+ 72585us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400078fd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:40.245777 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.245926 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12803,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":124,"raft.queue_time_us":29716,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":37895,"spinlock_wait_cycles":963001472,"thread_start_us":362141,"threads_started":2,"wal-append.queue_time_us":438615}
I20260709 13:00:40.261345  7896 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.262642  8275 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:40.279987  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.280578  1595 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:40.343634  1674 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 8.
I20260709 13:00:40.284760  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:40.285246  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.281283  1749 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:40.284054  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:40.296257  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:40.347002  1602 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:40.242859  8274 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.290053  7985 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:40.307134  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:40.307989  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:40.309296  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:40.312332  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.289774  8076 raft_consensus.cc:1027] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: attempt to promote peer 570958eb733a4af7ae16ae020998c8b4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:00:40.300302  8231 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:40.313405  8243 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:40.314107  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:40.314704  8230 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.314565  8265 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:40.308722  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:40.315501  8261 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:00:40.317289  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:40.318089  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:40.318881  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:40.319936  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:40.319871  8064 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.321703  2316 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:40.322955  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:40.324025  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:40.326099  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7826984530000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:00:40.326586  8021 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.328274  8273 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:40.329205  1744 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 13:00:40.332077  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.269098  7990 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:40.271294  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3330) took 1474 ms. Trace:
W20260709 13:00:40.356973  8060 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.005s
I20260709 13:00:40.302704  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:40.348022  8277 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.415082  1598 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:40.344561  1599 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:40.305433  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:40.327778  7932 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.264487  7982 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.352708  1601 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:40.425251  7982 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:40.427722  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.356734  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:40.281968  8246 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.422068  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.366050  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:40.437796  1600 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:40.373102  1603 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
W20260709 13:00:40.345964  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 66174.6us
I20260709 13:00:40.388552  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:40.375954  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7790984530000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:00:40.440148  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5549984529999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 13:00:40.440330  1746 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
W20260709 13:00:40.440722  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2300984530000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
I20260709 13:00:40.349380  8275 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.276777  8095 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.418581  1594 rpcz_store.cc:276] 0709 13:00:38.797118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.797279 (+   161us) service_pool.cc:224] Handling call
0709 13:00:38.797692 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.901139 (+103447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.901174 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.946584 (+ 45410us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.073975 (+127391us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b48000030d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 13:00:39.369237 (+295262us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:39.369304 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.369412 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.266753 (+897341us) raft_consensus.cc:1685] finished
0709 13:00:40.266771 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.271219 (+  4448us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83916,"raft.queue_time_us":234859,"raft.run_cpu_time_us":1381,"raft.run_wall_time_us":25558,"spinlock_wait_cycles":49129344,"thread_start_us":339733,"threads_started":1,"wal-append.queue_time_us":1176762}
W20260709 13:00:40.424304  8269 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:00:40.337831  8082 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.360754  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:40.437601  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:40.441120  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2021984529999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2278s for a response
W20260709 13:00:40.416899  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 84906.6us
I20260709 13:00:40.358381  7985 consensus_queue.cc:1243] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:40.365170  8233 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:40.464970  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.468602  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:40.465482  1566 connection.cc:256] RPC call timeout handler was delayed by -1.092285272999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:00:40.470337  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0710677249999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:00:40.465512  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 104897us
I20260709 13:00:40.471968  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:40.473709  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.535s (SENT) [suppressed 13 similar messages]
I20260709 13:00:40.472832  2315 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:00:40.478613  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:40.479759  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:40.367394  8231 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.475608  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.485495  1670 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.420543  8219 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.422152  8021 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.490638  8216 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:40.490880  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:40.491322  8216 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:40.492295  8021 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.492451  8216 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.493140  8021 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:40.493681  8021 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.372524  8230 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.495942  8021 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.478878  8076 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:40.497061  8076 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:40.497705  8076 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:40.500001  8095 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.474104  8129 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.480158  8233 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.509268  8233 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.484855  8214 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:40.511003  8214 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:40.512315  8214 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:40.515959  8261 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:40.517467  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1425) took 1480 ms. Trace:
I20260709 13:00:40.517838  8219 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.518612  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.520504  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.475312  8047 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:40.523717  1676 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:40.524981  8082 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.524880  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.420998  8011 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:40.436437  8028 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:40.489367  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.439138  8277 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.422694  8060 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.529270  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:40.638705  8094 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.002s
I20260709 13:00:40.496737  8230 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:40.549144  7744 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.334s
I20260709 13:00:40.638809  7982 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.624825  8274 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:40.746508  8223 consensus_meta.cc:287] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.003s
W20260709 13:00:40.638939  8124 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.506s	user 0.016s	sys 0.000s
I20260709 13:00:40.517953  1743 rpcz_store.cc:276] 0709 13:00:39.037565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.057642 (+ 20077us) service_pool.cc:224] Handling call
0709 13:00:39.058059 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.108881 (+ 50822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.108919 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.120231 (+ 11312us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.453939 (+333708us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:39.476529 (+ 22590us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.665381 (+188852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.665499 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.949021 (+283522us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b18002a0a60. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:00:40.517014 (+567993us) raft_consensus.cc:1685] finished
0709 13:00:40.517173 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.517373 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188104,"prepare.queue_time_us":26344,"prepare.run_cpu_time_us":6556,"prepare.run_wall_time_us":82594,"raft.queue_time_us":271428,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":7615,"spinlock_wait_cycles":149825408,"thread_start_us":291388,"threads_started":1,"wal-append.queue_time_us":937001}
I20260709 13:00:40.737365  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:40.592875  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.421790  8265 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.880394  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.904819  1752 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:40.446080  8276 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.445715  8275 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:40.910171  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.902825  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:40.911710  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.912403  1752 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:40.913735  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:40.898108  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.881376  1746 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:40.831410  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:40.919437  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 88168.4us
I20260709 13:00:40.920817  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.893534  1751 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:40.933432  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:40.896355  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 408192us
I20260709 13:00:40.883834  8153 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:40.874511  8082 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.578632  7985 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:40.549324  8243 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:40.942268  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:40.543226  8047 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.525878  8011 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.936380  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:40.908808  8094 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:40.452252  8232 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:40.941160  8230 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:00:40.923424  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 449685us
I20260709 13:00:40.886212  7982 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.886777  7991 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.887820  8028 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.865940  8021 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:40.945922  1752 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:40.983325  8021 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.984017  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:40.984616  1752 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:40.938417  8153 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:40.988407  8153 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.989856  8153 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:40.922829  8274 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:40.942982  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:40.996886  1746 raft_consensus.cc:2393] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:40.998093  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.002822  8274 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:41.014635  8243 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.974596  1744 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
W20260709 13:00:40.979174  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.910476  8265 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.021221  8265 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:41.021644  8176 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.008s
I20260709 13:00:40.980677  7991 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.945416  7985 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:40.963752  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 324201us
I20260709 13:00:40.893440  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.015192  1745 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:00:40.976514  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.890442  8223 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.891058  8124 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:40.889871  8060 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:41.069410  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.968390  8231 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:40.944589  8095 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 13:00:41.050896  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 74470.4us
I20260709 13:00:41.082360  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:40.547248  7990 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.070744  1752 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:40.975315  8230 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:40.980170  8062 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.656s	user 0.015s	sys 0.000s
I20260709 13:00:41.049299  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:40.925904  8276 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:40.945030  8082 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.027755  8028 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:40.954823  8047 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.089857  1752 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:41.074702  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 133971us
I20260709 13:00:41.047053  7744 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.092069  1598 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:41.110829  1752 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:41.106845  1600 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:41.075382  8081 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:41.112377  7990 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:41.100508  8231 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:41.091951  8274 raft_consensus.cc:2764] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:41.112819  8277 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.143752  1598 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:41.091985  8284 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:41.122661  8249 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.004s
I20260709 13:00:41.116789  8223 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.149210  8231 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:41.153903  8094 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:41.180786  8276 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.182119  7991 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.108094  8062 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.119367  7744 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:41.199503  8272 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.022s	sys 0.040s
I20260709 13:00:41.169939  8249 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:41.202306  8076 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.704s	user 0.015s	sys 0.000s
I20260709 13:00:41.221932  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.224179  8275 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.225068  8062 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.224918  8094 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.225725  1751 raft_consensus.cc:2368] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:41.227972  8028 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.231024  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:41.148936  8081 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:41.200248  8231 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:41.166343  8284 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:41.245009  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92576.4us
W20260709 13:00:41.229597  8272 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.023s	sys 0.040s
I20260709 13:00:41.170382  8294 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 13:00:41.276651  8232 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.278959  8275 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.280625  8011 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.282379  7744 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.288676  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:41.286028  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 203626us
I20260709 13:00:41.267701  7896 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.294934  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:41.287562  8223 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.249806  8076 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.313316  1752 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:41.315526  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:41.207692  8230 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.287765  7982 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.321259  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:41.321559  1673 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:41.326539  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:41.313279  8124 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.332425  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:41.319065  7896 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:41.369263  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75602.9us
I20260709 13:00:41.370386  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:41.371483  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:41.322794  8232 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:41.378265  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45960.2us
W20260709 13:00:41.380051  8306 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:41.381536  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3212) took 1080 ms. Trace:
W20260709 13:00:41.382253  8293 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:00:41.382714  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:41.383009  8082 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.341094  8216 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:41.383435  8124 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:41.383653  8216 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:41.384104  8124 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:41.384241  8216 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.385146  8124 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.388196  8249 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.388396  8028 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.389115  8214 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:41.389626  8214 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:41.390064  8214 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.390501  8081 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.372897  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:41.376089  2317 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:00:41.349596  8277 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:41.282882  8297 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:41.329023  8274 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:41.383103  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:41.388626  8292 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:00:41.425046  8296 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:41.427026  8296 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.427471  8296 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.428671  8284 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:41.382004  1744 rpcz_store.cc:276] 0709 13:00:40.301260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.018155 (+716895us) service_pool.cc:224] Handling call
0709 13:00:41.018594 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.075782 (+ 57188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.075826 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.076465 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.244108 (+167643us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:41.244176 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.244288 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.381253 (+136965us) raft_consensus.cc:1685] finished
0709 13:00:41.381292 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.381460 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31911,"raft.queue_time_us":56604,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":22695,"thread_start_us":133783,"threads_started":1,"wal-append.queue_time_us":172812}
I20260709 13:00:41.422616  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:41.434537  1595 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.365370  8295 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.374820  2311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 691) took 1066 ms. Trace:
I20260709 13:00:41.373142  7896 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.451035  8076 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:41.513096  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.435258  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:41.478204  1595 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
W20260709 13:00:41.504855  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 132010us
I20260709 13:00:41.436133  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:41.608448  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:41.606832  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:41.612454  1594 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:41.613343  1595 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:41.606832  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:41.621943  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:41.640949  1568 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:41.445391  1669 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:00:41.448029  1677 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:41.444011  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:41.446126  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:41.623216  1599 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:41.448803  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:41.446642  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:41.652925  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:41.444584  1672 pending_rounds.cc:85] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 7
I20260709 13:00:41.653934  1675 raft_consensus.cc:2368] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:00:41.654434  1672 pending_rounds.cc:107] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:00:41.447331  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:41.655357  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:41.653929  1671 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.656374  1675 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:41.655048  1672 raft_consensus.cc:2889] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.655055  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:41.666635  1715 leader_election.cc:400] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:00:41.667196  1715 leader_election.cc:403] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.669324  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:41.458432  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.671355  1677 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:41.492067  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.678220  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.433431  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3217) took 1130 ms. Trace:
I20260709 13:00:41.680631  1745 rpcz_store.cc:276] 0709 13:00:40.302632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.068237 (+765605us) service_pool.cc:224] Handling call
0709 13:00:41.068699 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.079321 (+ 10622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.079380 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.080116 (+   736us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.244608 (+164492us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:41.244670 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.244770 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.433205 (+188435us) raft_consensus.cc:1685] finished
0709 13:00:41.433225 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.433366 (+   141us) inbound_call.cc:177] Queueing success response
0709 13:00:41.554831 (+121465us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
Metrics: {"mutex_wait_us":10019,"raft.queue_time_us":11325,"raft.run_cpu_time_us":3554,"raft.run_wall_time_us":472282,"spinlock_wait_cycles":41347840,"thread_start_us":157754,"threads_started":1,"wal-append.queue_time_us":242785}
I20260709 13:00:41.494419  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.447496  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 2966) took 1137 ms. Trace:
I20260709 13:00:41.492936  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.684230  1751 rpcz_store.cc:276] 0709 13:00:40.310322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.933187 (+622865us) service_pool.cc:224] Handling call
0709 13:00:41.447170 (+513983us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54004218d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:41.447331 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669637888}
I20260709 13:00:41.685732  1752 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:41.505911  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:41.688832  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:41.455158  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.564476  8246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.016s	sys 0.017s
W20260709 13:00:41.689230  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 183254us
I20260709 13:00:41.491056  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:41.698925  8246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.017s	sys 0.017s
I20260709 13:00:41.495889  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:41.452443  2311 rpcz_store.cc:276] 0709 13:00:40.308836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.313312 (+  4476us) service_pool.cc:224] Handling call
0709 13:00:40.313708 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.313984 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:40.985636 (+671652us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b18002c12e0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf
0709 13:00:40.985813 (+   177us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.374328 (+388515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.374409 (+    81us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:41.374458 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.374554 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.374740 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57483,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":39593,"raft.queue_time_us":30828,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":16853632,"thread_start_us":459817,"threads_started":3,"wal-append.queue_time_us":271898}
I20260709 13:00:41.485659  7896 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:41.707648  8095 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:41.708004  8307 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.708766  8095 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:41.709048  8307 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.521059  8047 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.426050  8081 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:00:41.490447  8153 consensus_meta.cc:287] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.000s
I20260709 13:00:41.499837  8087 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.547405  8214 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:41.446103  8215 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:41.493991  8216 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:41.323961  8223 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.562490  8232 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:41.560864  8231 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:41.421214  8294 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.780813  8087 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.781945  8294 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.784783  1602 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21.
I20260709 13:00:41.456106  8295 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:41.541256  8296 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.718238  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:41.786557  8231 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:41.721724  1641 connection.cc:256] RPC call timeout handler was delayed by -1.2224741819999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 13:00:41.787439  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:41.788369  8295 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.788499  1677 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:41.789160  8296 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.789259  1678 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:41.789893  8216 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:41.790827  1676 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:00:41.791045  8215 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:41.724211  8243 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:41.792461  8243 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.713485  7896 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.708277  7932 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:41.796006  7932 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.797158  7982 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:41.798219  7982 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.798810  8294 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.796635  7932 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:41.775322  8311 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:41.732223  1671 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:41.710685  8095 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.736627  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.641580  1568 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2824)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2803)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2811)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2825)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2831)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3361)
I20260709 13:00:41.748334  8011 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:41.749521  8265 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:41.750239  8233 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.753083  8060 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.806795  8265 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:41.807569  2311 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:41.806550  8233 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:41.809849  8265 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:41.810530  8233 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:41.757369  7990 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.004s
I20260709 13:00:41.811474  1677 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:41.765036  8076 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:00:41.766206  8307 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:41.765100  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.767064  8062 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:41.769749  1675 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:00:41.777575  1600 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:41.805373  1744 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.805395  1568 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2824)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2803)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2811)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2825)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2831)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3361)
I20260709 13:00:41.810729  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:41.816989  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:41.818030  2315 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:41.818778  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:41.820771  8087 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.821640  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3353) took 1519 ms. Trace:
I20260709 13:00:41.822120  1598 rpcz_store.cc:276] 0709 13:00:40.302059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.437298 (+135239us) service_pool.cc:224] Handling call
0709 13:00:41.821167 (+1383869us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400038c54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:41.821366 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442191232}
I20260709 13:00:41.825130  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:41.827919  8329 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:41.828936  8329 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:41.831832  8296 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.832278  8076 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.832697  8296 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.833462  8076 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:41.834123  8076 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:41.835829  8076 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.836849  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3348) took 1553 ms. Trace:
I20260709 13:00:41.837666  8076 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:41.833712  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 903) took 1100 ms. Trace:
I20260709 13:00:41.839884  8296 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.840667  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1495) took 1583 ms. Trace:
I20260709 13:00:41.841106  1670 rpcz_store.cc:276] 0709 13:00:40.256889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.257046 (+   157us) service_pool.cc:224] Handling call
0709 13:00:40.257479 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.517306 (+259827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.840041 (+1322735us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001d3dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:41.840452 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523805056}
I20260709 13:00:41.841773  8082 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.842762  8082 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.845297  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:41.848609  1597 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:00:41.849043  8214 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.851102  7982 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.837374  1603 rpcz_store.cc:276] 0709 13:00:40.283655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.283785 (+   130us) service_pool.cc:224] Handling call
0709 13:00:41.815839 (+1532054us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b54003b4054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:41.836644 (+ 20805us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60574592}
I20260709 13:00:41.852288  8223 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.853609  8329 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.853940  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3216) took 1551 ms. Trace:
I20260709 13:00:41.854414  8243 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.827389  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:41.855029  1746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3210) took 1554 ms. Trace:
I20260709 13:00:41.856676  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.858429  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.860230  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.860664  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:41.867074  8021 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.843475  1670 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:41.829066  1568 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3365)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2803)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2811)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2825)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2831)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3361)
I20260709 13:00:41.874943  1597 pending_rounds.cc:85] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 13:00:41.889648  1597 pending_rounds.cc:107] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:00:41.890112  1597 raft_consensus.cc:2889] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.840008  1594 rpcz_store.cc:276] 0709 13:00:40.733506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.733701 (+   195us) service_pool.cc:224] Handling call
0709 13:00:41.459779 (+726078us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 13:00:41.611759 (+151980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.613169 (+  1410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.833263 (+220094us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003b3650. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:41.833465 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368539776}
I20260709 13:00:41.887197  1744 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:41.887080  1671 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:00:41.892290  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47205.7us
I20260709 13:00:41.888772  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:41.897832  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:41.898926  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.899359  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:41.900470  1747 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15.
I20260709 13:00:41.901309  1749 raft_consensus.cc:2368] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17.
W20260709 13:00:41.903708  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 76534.7us
I20260709 13:00:41.907639  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.912034  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:41.912521  1598 raft_consensus.cc:2410] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:00:41.914471  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 904) took 1136 ms. Trace:
I20260709 13:00:41.916301  8214 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:41.988037  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:41.914752  1568 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3365)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2803)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2811)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2825)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2831)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3368)
I20260709 13:00:41.920327  1673 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:41.920557  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:41.920926  1750 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:41.887058  1746 rpcz_store.cc:276] 0709 13:00:40.300709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.999106 (+698397us) service_pool.cc:224] Handling call
0709 13:00:41.000311 (+  1205us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.085048 (+ 84737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.085084 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.086526 (+  1442us) log.cc:844] Serialized 532 byte log entry
0709 13:00:41.256321 (+169795us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.256384 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.854229 (+597845us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b540029de54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:41.854306 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.854407 (+   101us) raft_consensus.cc:1685] finished
0709 13:00:41.854431 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.854811 (+   380us) inbound_call.cc:177] Queueing success response
0709 13:00:41.868795 (+ 13984us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
Metrics: {"raft.queue_time_us":17432,"raft.run_cpu_time_us":8488,"raft.run_wall_time_us":764031,"spinlock_wait_cycles":205723392,"thread_start_us":169300,"threads_started":1,"wal-append.queue_time_us":332572}
I20260709 13:00:41.924585  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.990914  1748 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.884902  1743 rpcz_store.cc:276] 0709 13:00:40.302354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.049300 (+746946us) service_pool.cc:224] Handling call
0709 13:00:41.049585 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.090392 (+ 40807us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:41.120219 (+ 29827us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.229823 (+109604us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b180030f460. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 13:00:41.315089 (+ 85266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.315169 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:41.315230 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.853258 (+538028us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54001c3ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:41.853345 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.853637 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28657,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":4157,"raft.queue_time_us":113,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5262,"spinlock_wait_cycles":96512000,"thread_start_us":84878,"threads_started":1,"wal-append.queue_time_us":356380}
I20260709 13:00:41.899056  7982 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:41.930259  8297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 15) took 15324 ms. Trace:
I20260709 13:00:41.932103  1675 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:00:41.967226  1603 raft_consensus.cc:2376] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16. Re-sending same reply.
I20260709 13:00:41.968428  1601 rpcz_store.cc:276] 0709 13:00:40.777599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.777832 (+   233us) service_pool.cc:224] Handling call
0709 13:00:41.826963 (+1049131us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368e9c 00007f947e368a5b 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f9486466fc0 00007f9486451929 00007f94864513d2 00007f947f9c8bd4
0709 13:00:41.827433 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.904632 (+ 77199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.913748 (+  9116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.913844 (+    96us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:41.913901 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.914018 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.914222 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12964736}
I20260709 13:00:41.932180  8082 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:41.937587  7985 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.954635  8219 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:41.961233  7896 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:41.960903  8215 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.966128  8129 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.923365  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.984870  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:41.986254  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:42.007867  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 87501.7us
I20260709 13:00:41.992254  1752 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:41.988296  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:41.995319  1594 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:42.001156  1595 raft_consensus.cc:2410] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:41.935034  7932 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:41.991279  8214 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.014853  8214 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.017256  1749 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:42.018621  1744 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:42.019649  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.023798  8129 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:41.998728  8297 rpcz_store.cc:276] 0709 13:00:26.605328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.697718 (+ 92390us) service_pool.cc:224] Handling call
0709 13:00:27.179710 (+481992us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4c002b4900. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f730644 00007f947f757f2d 00007f947f757b93 00007f94813e61af 00007f94813e5f3e 00007f948146b888 00007f948148875c 00007f948148976a 00007f948148891b
0709 13:00:27.182179 (+  2469us) log.cc:844] Serialized 506 byte log entry
0709 13:00:41.886979 (+14704800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20072,"raft.queue_time_us":110304,"raft.run_cpu_time_us":1235,"raft.run_wall_time_us":117529,"spinlock_wait_cycles":12072448,"thread_start_us":672099,"threads_started":2,"wal-append.queue_time_us":601347,"wal-append.run_cpu_time_us":2263,"wal-append.run_wall_time_us":1010869}
I20260709 13:00:42.026770  8129 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:42.027765  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.028306  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.029100  1595 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.995694  7982 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.031869  7982 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:42.032166  8215 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:42.035930  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.037145  1603 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.037557  7932 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.038314  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.039376  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.039808  8276 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.040201  8276 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:42.040807  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.041739  1596 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 10: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:42.041244  8276 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.042702  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.042886  8276 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.995591  8021 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:00:42.037676  8315 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.610s	user 0.003s	sys 0.000s
I20260709 13:00:42.044807  1596 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:42.050468  1748 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:00:42.061897  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.064507  1750 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:42.062247  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.062497  1595 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:42.069432  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.070523  1671 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.060103  8294 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:42.071382  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.066241  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.076454  1601 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:42.072149  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:42.077167  1743 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:42.083108  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.088574  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.071382  8294 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:42.092128  1673 raft_consensus.cc:2368] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:42.098213  1600 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:42.099903  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.102283  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.103384  1594 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260709 13:00:42.104312  1603 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:42.117491  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3344) took 1839 ms. Trace:
I20260709 13:00:42.117969  1597 rpcz_store.cc:276] 0709 13:00:40.278387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.279686 (+  1299us) service_pool.cc:224] Handling call
0709 13:00:40.283511 (+  3825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.893754 (+1610243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.104971 (+211217us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54000daa54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:42.117403 (+ 12432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3596745600}
I20260709 13:00:42.123010  8294 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:42.126718  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72088.1us
I20260709 13:00:42.084722  8021 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.129834  8021 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.131754  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.131929  1598 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:42.120852  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.134382  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.135830  8064 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:42.136993  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.142145  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.141481  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.145691  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.146354  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.146935  1594 raft_consensus.cc:2368] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21.
I20260709 13:00:42.104802  7990 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.120554  8060 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:00:42.147902  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.148108  7990 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:42.149235  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.150254  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:42.150187  8060 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:42.150938  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.151149  8219 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:42.151746  1745 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:42.152486  8064 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:42.152743  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.154250  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.153906  8064 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.154919  1670 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:42.155992  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.156268  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.156734  1597 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:00:42.156948  1603 raft_consensus.cc:2376] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15. Re-sending same reply.
I20260709 13:00:42.157634  7896 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:42.158082  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.158828  8081 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:42.159221  8081 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:42.135866  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.160100  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.160564  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.160266  8081 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.160817  1596 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:42.161368  1673 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.161819  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.162222  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.162554  1596 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.150612  7990 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.159356  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.163414  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.163493  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.166384  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:42.163834  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.174947  1596 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:42.175859  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.176402  1595 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:42.168933  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.179601  2317 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 13:00:42.181500  1601 raft_consensus.cc:2410] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:00:42.166821  8219 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:42.182947  8219 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:42.184113  8219 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.182425  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:42.185695  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58282.5us
I20260709 13:00:42.186510  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.187223  1677 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:42.187160  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:42.188048  1603 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:00:42.188397  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:42.188689  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:42.189141  1677 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15.
I20260709 13:00:42.189092  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.190099  1603 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:42.191817  8223 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:42.192251  8223 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.192826  8223 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:42.193017  8021 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:42.193467  8021 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.193868  8021 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:42.194809  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.195322  7990 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:42.195773  7990 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.185732  8219 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:42.196219  7990 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:42.190125  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:42.200747  8243 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:42.201232  8243 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.201674  8243 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:42.201884  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.204279  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:42.205513  8236 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:42.205951  8236 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.206082  1671 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:42.206377  8236 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:42.208026  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.209051  1599 raft_consensus.cc:2410] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:42.210189  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.211190  1599 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:42.213403  8243 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.216058  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:42.217273  8233 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:42.199990  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:42.216805  2310 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:42.218873  1670 raft_consensus.cc:2368] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17.
I20260709 13:00:42.219125  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:42.219242  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:42.220806  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.229171  8233 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:42.229619  8233 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.230027  8233 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:42.223227  8243 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.224006  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.203337  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.191252  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.195482  1598 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:00:41.965175   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.196048  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.234550  1678 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:42.237651  8081 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.239508  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:42.240783  8232 raft_consensus.cc:2764] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:00:42.233280  1603 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:42.192188  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:42.243866  1677 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:42.244930  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.245327  1675 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.245748  1601 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:42.243417  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:42.246938  8095 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.250561  8095 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.252591  1602 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:42.253356  8095 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.253861  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.254654  1602 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:42.256224  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.256935  1602 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:42.277573  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.257951  8214 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.259756  8243 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:42.278510  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.260146  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:42.265134  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.280162  1603 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.281111  8214 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:42.265959  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.267300  8232 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.281734  8243 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.282403  8243 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.284108  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.285066  8243 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.285436  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.281764  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.286654  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.286954  1670 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:42.287827  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.282294  8232 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.289022  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 214) took 7156 ms. Trace:
I20260709 13:00:42.287919  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.273425  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:42.269876  8215 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.291628  7982 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.293121  1595 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:42.295811  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.296471  8236 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.278597  1602 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:42.300915  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.318694  1601 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:42.298838  7990 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.300587  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 16 to 17, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:42.302466  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:42.307487  8311 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.287364  1594 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:42.324715  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.312621  1597 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:00:42.290181  8232 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.316448  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.322836  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.330713  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.332175  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.333254  1675 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:42.329061  8311 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.335930  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.339159  1599 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 20.
I20260709 13:00:42.329890  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.428527  1677 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:42.346756  1603 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:42.359961  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:42.356079  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 82825.2us
I20260709 13:00:42.363787  1594 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:00:42.433117  1601 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
W20260709 13:00:42.431945  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 181455us
I20260709 13:00:42.434211  1676 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:00:42.438139  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.437371  1597 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:42.430444  1595 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:42.441162  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 178473us
I20260709 13:00:42.335992  8311 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.441493  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.343366  8060 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.447453  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.358291  8236 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.361354  7990 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:42.458652  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.458346  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.338488  8276 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:00:42.329284  8215 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.455845  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:42.461905  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.440760  8232 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:42.469193  1501 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 9 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:42.463862  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.467640  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:42.471988  1594 raft_consensus.cc:2410] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:00:42.476421  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.477030  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:42.480192  8192 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:42.480892  8192 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.481432  8192 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:42.479166  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:42.486666  8060 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:42.487603  8060 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:42.488670  8060 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:42.490612  1601 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:42.491562  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2793) took 1050 ms. Trace:
I20260709 13:00:42.491617  8232 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.492091  1601 rpcz_store.cc:276] 0709 13:00:41.440978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.489969 (+1048991us) service_pool.cc:224] Handling call
0709 13:00:42.490421 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.491215 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.491444 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.493788  1601 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:42.494273  8232 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:42.494424  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2796) took 1052 ms. Trace:
I20260709 13:00:42.495328  1601 rpcz_store.cc:276] 0709 13:00:41.442568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.492972 (+1050404us) service_pool.cc:224] Handling call
0709 13:00:42.493395 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.494167 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.494365 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.497068  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.340946  8223 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.501516  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:42.502507  1600 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 13:00:42.503288  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 142384us
I20260709 13:00:42.504722  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2804) took 1023 ms. Trace:
I20260709 13:00:42.506247  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.505124  1600 rpcz_store.cc:276] 0709 13:00:41.481123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.343467 (+862344us) service_pool.cc:224] Handling call
0709 13:00:42.504650 (+161183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.502249  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:42.516017  1602 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:42.517908  1600 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:42.445660  8021 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.522941  1597 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:42.520123  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:42.520476  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52049.1us
I20260709 13:00:42.486115  8064 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.523308  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:42.525048  1596 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:42.526348  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:42.526243  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2811) took 1035 ms. Trace:
I20260709 13:00:42.527235  1600 rpcz_store.cc:276] 0709 13:00:41.483206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.509207 (+1026001us) service_pool.cc:224] Handling call
0709 13:00:42.514619 (+  5412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.518356 (+  3737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.518801 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.533643  8233 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.549682  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:42.550297  8062 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:42.551128  8062 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.553726  8062 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:42.554427  8062 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:42.546120  8294 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:42.526782  8214 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:42.561218  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2825) took 1073 ms. Trace:
I20260709 13:00:42.561534  8214 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:42.547194  8064 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:42.561869  1600 rpcz_store.cc:276] 0709 13:00:41.487378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.528104 (+1040726us) service_pool.cc:224] Handling call
0709 13:00:42.560150 (+ 32046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.560657 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.560700 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.560764 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:42.560814 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.560916 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.561099 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.564503  1594 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:42.564873  8064 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:42.565287  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2803) took 1084 ms. Trace:
I20260709 13:00:42.565860  1676 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:00:42.566553  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.567075  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.568187  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.565136  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.549691  1566 leader_election.cc:400] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:42.570319  1566 leader_election.cc:403] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:42.562891  8214 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.519337  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 15 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194), now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:42.581056  1601 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:42.577327  1598 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:00:42.584417  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.586216  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.586615  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.587924  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.589694  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.590672  1745 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:42.591941  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.592954  1744 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:42.594247  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.596122  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.597018  1749 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:42.602782  8021 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.603716  1599 raft_consensus.cc:2393] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:42.604926  8223 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.598595  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 9 to 10, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.605898  1599 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:42.565694  1594 rpcz_store.cc:276] 0709 13:00:41.480848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.508421 (+1027573us) service_pool.cc:224] Handling call
0709 13:00:42.564037 (+ 55616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.565008 (+   971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.565228 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.609474  1748 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:42.579435  1751 raft_consensus.cc:2410] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:00:42.587455  1750 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:42.610935  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61435.3us
I20260709 13:00:42.613008  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2800) took 1165 ms. Trace:
I20260709 13:00:42.609022  1501 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 14 to 16, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:42.613564  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.613476  1601 rpcz_store.cc:276] 0709 13:00:41.445239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.516000 (+1070761us) service_pool.cc:224] Handling call
0709 13:00:42.580788 (+ 64788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.582156 (+  1368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.610014 (+ 27858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.614790  1595 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:42.615640  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2830) took 1126 ms. Trace:
I20260709 13:00:42.620976  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2829) took 1132 ms. Trace:
W20260709 13:00:42.622366  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 109972us
I20260709 13:00:42.621826  1598 rpcz_store.cc:276] 0709 13:00:41.488517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.155604 (+667087us) service_pool.cc:224] Handling call
0709 13:00:42.194683 (+ 39079us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5800003398. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368eee 0000000000375939 00007f94863dc1e0 00007f94864a50c4 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 13:00:42.620872 (+426189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8460800}
I20260709 13:00:42.622838  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.623813  1743 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:42.616210  1595 rpcz_store.cc:276] 0709 13:00:41.488792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.327238 (+838446us) service_pool.cc:224] Handling call
0709 13:00:42.615501 (+288263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.627002  1595 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:42.616593  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:42.627761  1600 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:42.628772  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:42.629719  1749 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:42.610200  8276 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:42.620505  8021 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:42.621501  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:00:42.640476  1746 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:00:42.315608  1500 rpcz_store.cc:276] 0709 13:00:35.132703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.182662 (+ 49959us) service_pool.cc:224] Handling call
0709 13:00:42.288707 (+7106045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:38.789562 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.057302 (+267740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.075922 (+ 18620us) write_op.cc:435] Acquired schema lock
0709 13:00:39.107210 (+ 31288us) tablet.cc:662] Decoding operations
0709 13:00:39.243504 (+136294us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.261552 (+ 18048us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.265406 (+  3854us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:39.273896 (+  8490us) tablet.cc:701] Row locks acquired
0709 13:00:39.273924 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:00:39.274170 (+   246us) write_op.cc:270] Start()
0709 13:00:39.274353 (+   183us) write_op.cc:276] Timestamp: P: 1783602039274094 usec, L: 0
0709 13:00:39.274387 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.275383 (+   996us) log.cc:844] Serialized 1312 byte log entry
0709 13:00:40.233964 (+958581us) op_driver.cc:464] REPLICATION: finished
0709 13:00:41.016446 (+782482us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f947e3830ac 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f9484ec3ef0
0709 13:00:41.320772 (+304326us) write_op.cc:301] APPLY: starting
0709 13:00:41.325819 (+  5047us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:41.499613 (+173794us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:41.499649 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:41.508221 (+  8572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:41.539960 (+ 31739us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:00:41.541987 (+  2027us) write_op.cc:312] APPLY: finished
0709 13:00:41.550034 (+  8047us) log.cc:844] Serialized 41 byte log entry
0709 13:00:41.565028 (+ 14994us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.565202 (+   174us) write_op.cc:454] Released schema lock
0709 13:00:41.565255 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:41.565666 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.565691 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30663,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1059626,"apply.run_cpu_time_us":13262,"apply.run_wall_time_us":250333,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":303009,"prepare.run_cpu_time_us":27732,"prepare.run_wall_time_us":788338,"raft.queue_time_us":315854,"raft.run_cpu_time_us":64423,"raft.run_wall_time_us":1089512,"replication_time_us":933073,"spinlock_wait_cycles":3543936,"thread_start_us":1602742,"threads_started":5,"wal-append.queue_time_us":521291,"wal-append.run_cpu_time_us":14744,"wal-append.run_wall_time_us":2212148}]]}
I20260709 13:00:42.635443  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:42.648314  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:42.649092  1603 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:42.650445  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.651494  1750 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:42.653528  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2787) took 1221 ms. Trace:
I20260709 13:00:42.655061  1602 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:42.660843  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:42.654172  1596 rpcz_store.cc:276] 0709 13:00:41.423688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.477711 (+1054023us) service_pool.cc:224] Handling call
0709 13:00:42.524873 (+ 47162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.526916 (+  2043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.644513 (+117597us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5400078ad0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:42.644681 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89222400}
I20260709 13:00:42.663420  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2831) took 1174 ms. Trace:
I20260709 13:00:42.665298  1603 rpcz_store.cc:276] 0709 13:00:41.489101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.531673 (+1042572us) service_pool.cc:224] Handling call
0709 13:00:42.625470 (+ 93797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.662982 (+ 37512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.663354 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.654357  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:42.667979  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48168.4us
I20260709 13:00:42.635588  8276 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:00:42.696938  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.674649  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3360) took 1035 ms. Trace:
I20260709 13:00:42.679908  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.704269  1598 rpcz_store.cc:276] 0709 13:00:41.638972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.623747 (+984775us) service_pool.cc:224] Handling call
0709 13:00:42.624238 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.674048 (+ 49810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.674082 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.674176 (+    94us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:42.674222 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.674310 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.674527 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26893,"raft.queue_time_us":31980,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":123}
I20260709 13:00:42.671921  1743 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:42.706393  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.647130  8060 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.679638  8095 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:42.711087  8095 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:42.711583  8095 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:42.715716  1750 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:42.718914  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:42.732293  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:42.738108  1600 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:00:42.755103  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:42.748587  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 132788us
I20260709 13:00:42.665035  8232 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:42.717515  8276 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:42.758960  8342 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:00:42.657486  8192 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:42.673722  8129 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:42.681890  7982 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:42.741149  1602 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:42.774834  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:42.809335  1597 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:42.806129  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 73981.2us
I20260709 13:00:42.743870  8233 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:42.817942  1600 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:42.754616  8311 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:42.759621  8021 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:42.763734  8215 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:42.842509  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:42.844555  1749 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:42.841939  1751 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:00:42.857743  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:42.833781  8311 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.832365  1597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51592
I20260709 13:00:42.864260  1597 raft_consensus.cc:606] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:42.864673  1597 raft_consensus.cc:614] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:42.876339  8313 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:42.876503  1750 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:42.879527  8236 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:42.880079  8236 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:42.881143  8236 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:42.882364  8236 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:42.908814  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.863107  8311 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:42.861306  7982 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:42.866727  8233 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:42.932399  1676 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:42.932466  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:42.933215  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90836.6us
W20260709 13:00:42.940634  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82956.2us
I20260709 13:00:42.951470  1715 leader_election.cc:400] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21.
I20260709 13:00:42.943086  8081 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:42.961448  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:42.965427  8346 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:00:42.975956  1746 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:42.977123  1748 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:42.979837  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3357) took 1337 ms. Trace:
W20260709 13:00:42.980371  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.988317  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 176849us
I20260709 13:00:42.989477  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:42.980613  1599 rpcz_store.cc:276] 0709 13:00:41.637466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.606991 (+969525us) service_pool.cc:224] Handling call
0709 13:00:42.607394 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:42.624166 (+ 16772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.624201 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:42.634388 (+ 10187us) log.cc:844] Serialized 52 byte log entry
0709 13:00:42.922300 (+287912us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:42.922362 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.923982 (+  1620us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.974190 (+ 50208us) raft_consensus.cc:1685] finished
0709 13:00:42.974222 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.974410 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7144,"raft.queue_time_us":13803,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":21419,"thread_start_us":232215,"threads_started":1,"wal-append.queue_time_us":309099}
W20260709 13:00:42.988411  8348 log.cc:927] Time spent T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:00:42.984725  8233 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:43.015640  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73343us
I20260709 13:00:43.032474  8357 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:00:43.036414  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.037528  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.015342  8192 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.039603  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:43.041968  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:43.048617  8192 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.049275  8192 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.049743  8192 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.052373  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.054373  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.058091  8233 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:43.067866  8233 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:43.069820  8095 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.073253  8095 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.076519  8276 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:43.078809  8359 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:00:43.081537  8357 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:43.101890  1749 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:00:43.097990  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:43.104457  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.108983  1599 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:43.087512  8313 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.096968  8357 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.111841  8153 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:00:43.119614  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77820.8us
W20260709 13:00:43.120095  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 130745us
I20260709 13:00:43.105360  8060 raft_consensus.cc:2764] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:00:43.121898  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:43.126035  1748 raft_consensus.cc:2410] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:00:43.126178  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:43.127615  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.120143  8357 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:43.130887  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:43.131464  1749 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:43.133742  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3359) took 1495 ms. Trace:
I20260709 13:00:43.134438  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:43.124521  8153 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:43.134594  1601 rpcz_store.cc:276] 0709 13:00:41.638545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.614917 (+976372us) service_pool.cc:224] Handling call
0709 13:00:42.630922 (+ 16005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.647443 (+ 16521us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:42.974935 (+327492us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.133177 (+158242us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.133383 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.133435 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:43.133489 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.133574 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.133685 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1948,"prepare.queue_time_us":394497,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":83,"raft.queue_time_us":5706,"thread_start_us":366919,"threads_started":2}
I20260709 13:00:43.134233  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:43.138763  1750 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:43.139828  8363 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:43.141669  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.134205  8214 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:43.145409  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:43.147836  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:43.148241  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:43.136889  7982 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:43.128109  8311 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.140429  8363 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.144560  8081 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:43.140681  8313 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.160842  8081 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:43.161312  8081 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:43.164709  8276 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.150859  8214 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.172493  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:43.173199  1750 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:43.173386  1743 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.175195  8364 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:43.176455  8364 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.177453  8364 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.154538  8153 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.192126  1743 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
W20260709 13:00:43.193336  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.196933  8362 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:00:43.198211  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.199736  8236 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.200445  8236 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.202325  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:43.204674  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:43.207003  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.207581  1669 raft_consensus.cc:2393] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:43.206307  8236 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.211179  8311 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.217254  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.218545  8060 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:43.220151  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46906.7us
I20260709 13:00:43.222043  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:43.223117  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:43.228803  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.158258  8363 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:43.229934  1669 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.230110  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:43.228869  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:43.232386  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 63475.9us
I20260709 13:00:43.236661  1748 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.219719  8214 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.240818  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:43.244884  1743 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:00:43.244475  8311 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:00:43.248468  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.249400  7982 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:43.243453  8095 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:43.250890  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.237323  8360 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:43.257279  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:43.271731  8360 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.273005  8360 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:43.282275  7982 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:43.295368  1669 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:00:43.297775  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:43.302053  8350 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:43.302986  8350 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:43.304319  8350 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.305568  8370 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:43.306315  8370 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:43.310343  1549 auto_rebalancer.cc:893] Removing replace marker failed: Replica 693257b3078444e0bd26d3e82159d452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:00:43.311134  1549 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:43.311520  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:00:43.311980  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 61150.8us
I20260709 13:00:43.312952  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.314392  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.315474  7982 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:43.315536  8064 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:43.316040  7982 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:43.316529  7982 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.316200  8081 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.318784  8081 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.320226  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:43.300424  8232 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.324153  8232 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.326859  8232 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.327662  8192 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.330336  8192 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.331691  8357 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.336299  1748 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:00:43.268292  8313 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:43.337982  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.338564  8021 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:43.338932  8366 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:00:43.339825  8233 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:43.340521  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 101383us
I20260709 13:00:43.268733  8095 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.345728  8095 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.299688  8153 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.350095  8153 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.350579  8153 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.339270  8021 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.370577  8370 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:43.372442  1566 leader_election.cc:400] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:43.375731  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.384944  7982 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.388307  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.400329  8233 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.400792  8233 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.372255  8357 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.389539  8021 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:43.401207  8233 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.397583  8313 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:43.400967  1566 leader_election.cc:400] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17.
I20260709 13:00:43.402557  1566 leader_election.cc:403] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:00:43.402052  8313 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.403479  1566 leader_election.cc:400] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15.
I20260709 13:00:43.403846  1566 leader_election.cc:403] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:43.404589  8232 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17.
I20260709 13:00:43.404870  8313 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.405339  8232 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 14. Current term is 15.
I20260709 13:00:43.402062  7982 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.406378  8214 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:43.407809  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.408123  7982 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:43.408408  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71073.1us
I20260709 13:00:43.408829  8021 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:43.409441  8021 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:43.410375  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.410458  8021 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.397617  8363 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.411532  7982 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.412127  7982 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:43.412493  7982 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.413429  8363 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.426028  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.439006  8233 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.446753  8233 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.401233  8060 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:43.465504  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73427.5us
W20260709 13:00:43.485307  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49600us
W20260709 13:00:43.492700  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.513832  8363 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:43.514792  8153 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.523799  8095 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:43.524950  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.525411  8153 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.515389  8375 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:00:43.527048  8364 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:43.527441  8364 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.528560  8364 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.529690  8364 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.526290  8363 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:43.530484  8363 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.531569  8363 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.533106  8363 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.535912  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:43.537007  8060 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.537664  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.538583  8060 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:43.539096  8060 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.539812  8060 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:43.540194  7982 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.543155  7982 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.545915  8214 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.475926  8021 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:43.556475  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 130538us
I20260709 13:00:43.557482  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.559674  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.560570  1669 raft_consensus.cc:2393] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 11: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:43.561735  8369 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:43.563828  8357 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:43.564954  8357 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:43.565398  8357 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.566406  8357 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.567690  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:43.568610  1748 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.579030  8380 raft_consensus.cc:2764] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:43.584144  8357 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:43.577266  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.594022  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.595031  8379 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:43.595791  8380 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:43.596195  8379 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.596307  8380 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.596673  8379 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.596755  8380 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:43.612094  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.611935  7982 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:43.618580  8313 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:43.629700  1748 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:00:43.630527  8232 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:43.629879  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.644459  8232 consensus_queue.cc:1243] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:00:43.638967  8060 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.661083  8021 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:43.661381  8060 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.661651  8021 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:43.645424  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:43.642196  8379 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:43.663404  7896 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:43.662760  8021 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.664000  7896 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:43.664667  8021 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:43.664997  8379 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.639653  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:43.666311  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45072.2us
I20260709 13:00:43.665134  7896 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.668283  8064 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.668717  8064 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:43.669099  8064 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.669132  8192 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:43.639729  8380 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:43.676875  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47084us
I20260709 13:00:43.678040  8232 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:43.678018  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.678704  8232 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.679106  8232 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.679263  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.679417  8233 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:43.683784  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 71809.7us
I20260709 13:00:43.680351  8233 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:43.693215  8233 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.686324  8379 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:43.695016  8379 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:43.696252  8380 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.680630  8060 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:00:43.702679  8387 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:43.703289  1748 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:43.709532  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.713441  8380 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:43.716214  8380 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:43.716701  8380 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:43.720330  8153 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:43.710369  8192 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:43.723493  8192 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:43.723915  8192 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:43.714178  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.710001  8387 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:43.728440  8153 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.747888  8153 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.750412  8153 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.753136  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:43.754205  1743 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:00:43.753136  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:43.696324  8379 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.758222  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.755983  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:43.756249  1669 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:00:43.762207  8380 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.724831  8192 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:43.764247  8153 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.764662  8380 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.764864  8153 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.771049  8153 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.741165  8064 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.743757  8233 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.745642  8021 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:43.781232  8192 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:43.785378  1743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48436
I20260709 13:00:43.790191  1749 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:43.791862  8388 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:00:43.792135  8350 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:43.792868  8380 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:43.793300  8380 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:43.794340  8380 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.796268  8380 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:43.800721  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 129) took 1764 ms. Trace:
I20260709 13:00:43.787602  8064 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.788029  8021 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:43.814764  8021 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.815913  8060 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:43.816522  8060 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:43.787668  8233 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.815032  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.819738  7896 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:43.820725  7896 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.828013  8060 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:43.836637  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.805166  1501 rpcz_store.cc:276] 0709 13:00:42.015677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.030310 (+ 14633us) service_pool.cc:224] Handling call
0709 13:00:43.779248 (+1748938us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:43.027820 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:43.028829 (+  1009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:43.028917 (+    88us) write_op.cc:435] Acquired schema lock
0709 13:00:43.028947 (+    30us) tablet.cc:662] Decoding operations
0709 13:00:43.030229 (+  1282us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:43.030385 (+   156us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:43.030436 (+    51us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:43.031456 (+  1020us) tablet.cc:701] Row locks acquired
0709 13:00:43.031522 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:00:43.082563 (+ 51041us) write_op.cc:270] Start()
0709 13:00:43.082780 (+   217us) write_op.cc:276] Timestamp: P: 1783602043082458 usec, L: 0
0709 13:00:43.082830 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:00:43.122742 (+ 39912us) log.cc:844] Serialized 3217 byte log entry
0709 13:00:43.448170 (+325428us) op_driver.cc:464] REPLICATION: finished
0709 13:00:43.564224 (+116054us) write_op.cc:301] APPLY: starting
0709 13:00:43.564335 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:43.642869 (+ 78534us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:43.643067 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:43.760906 (+117839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:43.761256 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:00:43.761321 (+    65us) write_op.cc:312] APPLY: finished
0709 13:00:43.761697 (+   376us) log.cc:844] Serialized 73 byte log entry
0709 13:00:43.761921 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:43.762061 (+   140us) write_op.cc:454] Released schema lock
0709 13:00:43.762128 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:43.762658 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:43.762690 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165305,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":106657,"apply.run_cpu_time_us":16770,"apply.run_wall_time_us":198464,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":321845,"prepare.run_cpu_time_us":86565,"prepare.run_wall_time_us":247210,"raft.queue_time_us":20482,"raft.run_cpu_time_us":18052,"raft.run_wall_time_us":118698,"replication_time_us":351060,"spinlock_wait_cycles":2432,"thread_start_us":410957,"threads_started":4,"wal-append.queue_time_us":120358}]]}
W20260709 13:00:43.851503  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 104123us
I20260709 13:00:43.832525  8095 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:43.860733  7896 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.860453  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 15 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:43.866628  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:43.862784  1497 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 18, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:43.858244  8387 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:43.871569  8387 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.834642  8232 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:00:43.874728  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 160560us
I20260709 13:00:43.876433  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.886636  8064 raft_consensus.cc:2764] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:43.890203  1497 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 17, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:43.893379  1497 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.895514  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:43.900861  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:43.902902  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:43.903960  1677 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:43.908638  1675 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:00:43.899930  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.915459  1670 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.903873  1497 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 15 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.918079   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:43.878050  8232 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:43.921906  2310 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:00:43.922608  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:43.922920  1671 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:43.923704  1674 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:43.924849  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:43.923177  2310 pending_rounds.cc:85] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 9
I20260709 13:00:43.928643  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.929145  2310 pending_rounds.cc:107] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:43.929579  2310 raft_consensus.cc:2889] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:43.919273  1497 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.930943  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.932715  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.915570  8379 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:43.940757  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:43.941098  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.907581  8095 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:00:43.938964  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:43.958516  1669 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:00:43.959640  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58857.3us
I20260709 13:00:43.961443  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.931149  8364 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:43.915373  8313 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:00:43.941030  8379 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:43.967737  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:43.914942  8192 consensus_queue.cc:1059] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:43.968562  1597 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:43.976110  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 51853.6us
I20260709 13:00:43.984637  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.990446  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:43.972223  8357 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:00:44.042732  8399 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:43.997013  7982 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.047791  7982 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.050143  7982 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:43.997237  8064 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.977937  8364 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:43.984297  8375 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.051064  8064 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:43.969853  8370 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:00:44.060575  1670 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:44.071771  1597 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:00:43.994781  8360 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:44.063030  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:44.076647  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.082188  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.091883  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.092818  1601 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:44.075245  8380 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.105880  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.111150  1673 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:44.075080  8300 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.076133  8363 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:44.109875  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:44.111204  1745 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:44.100800  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:44.117820  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.107051  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.122838  1751 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:44.112771  1749 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:44.114601  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.125772  1746 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 27.
I20260709 13:00:44.062148  8375 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.144650  1749 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:44.119479  8360 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:44.114141  8379 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.158136  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.158607  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.159219  1747 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:44.164449  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.165184  1751 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:44.167939  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.062413  8364 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:44.120714  8300 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:44.170639  8300 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.172039  1748 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.159127  1746 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:44.125919  8021 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:44.176074  8021 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.120108  8380 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.182092  1745 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:44.190568  1747 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:44.142081  8232 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:44.198285  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:44.180639  8153 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:44.206314  8064 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:44.208526  8389 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:44.163273  8375 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.182542  8380 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.218338  8393 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:44.250466  8064 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:44.250558  8393 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:44.253816  8393 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:44.263135  8064 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.264766  1743 raft_consensus.cc:606] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:44.264253  8064 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.265331  1743 raft_consensus.cc:614] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:44.268224  8064 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:44.227706  8021 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.303872  8060 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:44.304453  8060 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:44.305528  8060 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:44.306579  7982 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:44.307075  8060 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:44.307309  7982 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.309945  7982 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:44.217733  1745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03d13a42db4a4920828af42492055735"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:44.215857  1751 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:00:44.230618  1748 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
W20260709 13:00:44.224871  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 125680us
I20260709 13:00:44.325628  1745 raft_consensus.cc:606] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:44.326071  1745 raft_consensus.cc:614] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:44.219949  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 110575us
I20260709 13:00:44.246184  8232 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:44.324542  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 261577us
I20260709 13:00:44.328627  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:44.246582  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48447.2us
I20260709 13:00:44.330812  1743 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:44.336541  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.337548  1676 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:00:44.338342  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:44.319324  8363 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:44.345724  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.348101  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.333516  8192 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:44.352151  1603 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260709 13:00:44.352324  1669 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:44.353014  1669 pending_rounds.cc:85] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 8
I20260709 13:00:44.353180  1669 pending_rounds.cc:107] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:44.353320  1669 raft_consensus.cc:2889] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.340912  7982 raft_consensus.cc:2764] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:44.355468  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.356285  1598 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:44.359295  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.359952  1597 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:44.361372  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.361655  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.362177  1602 raft_consensus.cc:2368] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:00:44.369645  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.370179  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.367908  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.388381  1603 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:44.388710  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:44.389041  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.389194  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.389581  1601 raft_consensus.cc:2368] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20.
I20260709 13:00:44.390043  1598 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:44.389779  7982 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:44.389216  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.391268  1602 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:44.391698  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.395394  1597 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:44.396612  1600 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:00:44.397090  1600 pending_rounds.cc:85] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 11
I20260709 13:00:44.397395  1597 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.339857  8300 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:00:44.401480  1602 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:00:44.397426  1600 pending_rounds.cc:107] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:00:44.399940  7982 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:44.402446  1600 raft_consensus.cc:2889] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.404665  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:44.408402  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.409189  1596 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:44.408493  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:44.406289  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69265.8us
I20260709 13:00:44.410329  1601 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:44.366671  8064 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:00:44.388257  8153 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.415848  1594 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 13:00:44.422005  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.422748  1599 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:44.427402  1748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:44.428237  1748 raft_consensus.cc:606] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:44.410853  7896 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:44.430214  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 94583us
I20260709 13:00:44.431301  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:44.443629  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:44.400375  8387 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:00:44.445608  8363 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:44.422061  8393 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.451936  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.452243  1597 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:44.454535  1594 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:44.457533  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.458329  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.460315  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:44.461745  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63696.1us
I20260709 13:00:44.462694  1744 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:44.464634  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:44.472298  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.473214  1600 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:44.474309  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.475381  1745 raft_consensus.cc:2393] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 11: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:44.478266  1602 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:44.480290  1749 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:44.481513  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.482396  1594 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:44.485805  1746 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:44.496378  1676 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.512756  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.516070  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.514918  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.519273  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.520375  1673 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:44.519480  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.524474  1674 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [15.8-16.9]
I20260709 13:00:44.462010  8363 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:44.530750  2310 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:44.537536  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.538003  1670 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:44.538371  1670 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:44.535185  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79848.7us
I20260709 13:00:44.538859  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.539886  1600 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:44.545516  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.546253  1751 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:44.547070  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.547128  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.548553  1751 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:44.550879  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:44.550567  8363 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.551672  1601 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:44.555351  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.502091  8417 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:44.545083  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:44.561290  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:44.562553  1743 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:44.563314  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.564823  1750 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:44.553927  1670 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.532948  8387 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:44.563514  1600 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:44.563583  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:44.568166  1746 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:44.568523  2310 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:44.569065  1752 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:44.573037  7982 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:44.575269  1601 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:44.576176  1600 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:44.576432  1601 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 18. Ops: []
I20260709 13:00:44.571882  1594 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:44.577409  1600 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:44.579772  1749 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:44.581415  1747 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:44.581620  1549 auto_rebalancer.cc:893] Removing replace marker failed: Replica fab19506de7242869c29d70c9fffb739 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } } pending_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:44.582125  1549 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:44.582418  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:44.588752  8418 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.589506  8418 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:44.591224  1598 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:00:44.592780  1598 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:00:44.592828  1743 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:44.595383  1598 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:00:44.597420  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:44.598151  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:44.599740  1750 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:00:44.603643  1599 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:44.602898  1751 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:44.606837  1599 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:44.573697  7982 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.610014  8064 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:44.610541  1746 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:00:44.610543  8064 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:44.624719  1751 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:44.625069  1743 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:44.633287  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:44.639153  1752 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.639524  1746 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25. Ops: [22.14-24.15]
I20260709 13:00:44.573099  8232 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.636215  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:44.634022  1743 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:44.640686  1750 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 18. Ops: []
I20260709 13:00:44.641986  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:44.642602  1751 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:00:44.645182  1674 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:44.647079  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.651630  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:44.599064  8387 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:44.653749  7982 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:44.599716  8418 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:44.658080  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.660344  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:44.662272  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.662495  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.663245  1678 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:44.659832  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.673516  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.678341  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.704298  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.704038  8064 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:44.705423  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.722337  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.642622  7896 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:44.656872  8232 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.641705  8393 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:00:44.650593  8021 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:44.662643  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:44.713878  1752 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:44.714231  1744 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:44.721073  1599 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:00:44.738922  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.748674  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.750036  1675 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:44.744745  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.741647  1597 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.746845  1677 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:44.663005  8233 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:44.754516  1674 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:44.754249  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46080b3c17204e34b7cfa66296431876"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:44.754742  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.755262  1752 raft_consensus.cc:606] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:44.755640  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.758391  1671 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:44.758605  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.761960  1599 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:44.755815  1752 raft_consensus.cc:614] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:44.735347  8380 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:44.661391  8379 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:00:44.748250  8021 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.752259  8192 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:44.771215  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.754688  7896 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:44.783713  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:44.786728  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.787911  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.789150  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:44.789500  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 244478us
I20260709 13:00:44.791046  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:44.770541  8064 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.773161  8021 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:44.801133  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:44.823173  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.803931  1599 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:00:44.810181  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:44.788486  8192 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:44.942528  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:44.960724  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:44.962997  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 13:00:44.969869  1596 consensus_meta.cc:287] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
I20260709 13:00:44.971724  1596 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:00:44.981068  1595 raft_consensus.cc:1240] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25. Ops: []
I20260709 13:00:44.983628  1596 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.811522  8406 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:44.947826  8060 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.001682  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.016847  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:45.013136  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:45.017627  1749 raft_consensus.cc:606] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.026626  1672 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:44.798262  8387 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:45.031977  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 221907us
I20260709 13:00:45.019773  8406 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:45.011813  8427 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:00:45.050103  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75404.9us
I20260709 13:00:45.012574  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:45.055387  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:45.067905  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.072280  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:45.030200  8379 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:45.080863  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:45.015094  8393 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.016587  8418 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.093588  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:45.090922  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 428296us
I20260709 13:00:45.057374  8434 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.057183  8425 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.053565  8233 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:45.097076  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:45.103807  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.095188  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:45.079959  8363 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:45.108723  2316 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:45.108727  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:45.091568  8432 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:45.107867  1677 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:45.012101  8060 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.053459  8406 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.120364  1678 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 27.
I20260709 13:00:45.127512  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:45.128635  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:45.100159  8433 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:45.137187  1678 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:45.138353  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:45.141726  1749 raft_consensus.cc:606] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.142385  1749 raft_consensus.cc:614] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:45.108690  8379 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:45.145108  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:45.052268  7896 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.114459  8432 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:45.152482  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48761.1us
I20260709 13:00:45.096057  8393 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.157528  1677 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:45.109876  8397 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:00:45.152205  8430 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
I20260709 13:00:45.129477  8406 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.100481  8418 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.129285  8431 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:00:45.185869  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.187031  1715 leader_election.cc:400] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:00:45.110037  8425 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:45.186137   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:45.190155  1674 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:45.190696  1715 leader_election.cc:403] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:45.196314  8438 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 13:00:45.197458  1678 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:45.192282  1670 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:45.140879  8433 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:45.199368  1672 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:45.200249  1715 leader_election.cc:400] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20.
I20260709 13:00:45.195137   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:45.178510  8429 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:00:45.203963  1672 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:45.205379  1715 leader_election.cc:403] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.211051  1672 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:45.198808  8440 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:00:45.192641  8442 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.223076  8418 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:45.223241  8420 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.547s	user 0.001s	sys 0.002s
I20260709 13:00:45.223642  8442 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.226313  8442 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:45.209659  8433 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:45.227679  2282 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.016s
W20260709 13:00:45.228108  2282 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.016s
I20260709 13:00:45.228868  8393 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:45.161600  8448 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:45.228884  8431 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20.
I20260709 13:00:45.237069  8425 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:45.237936  8233 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:45.225786  8379 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.243530  8452 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:45.244455  8192 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.253084  8432 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.208077  8434 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:00:45.280414  1670 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:00:45.281184  1670 pending_rounds.cc:85] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 12
I20260709 13:00:45.281504  1670 pending_rounds.cc:107] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:00:45.281832  1670 raft_consensus.cc:2889] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:45.285130  1594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.008s	sys 0.021s
W20260709 13:00:45.285614  1594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.021s
I20260709 13:00:45.283720  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:45.290652  1678 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
W20260709 13:00:45.289433  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 94893.3us
W20260709 13:00:45.287153  8439 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:00:45.296482  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:45.291961  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92312.2us
I20260709 13:00:45.298746  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.289844  1672 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:45.303838  1751 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:45.306106  1751 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:45.308408  1751 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:45.301608  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:45.317119  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.310526  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:45.318478  1751 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.321741  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:45.322954  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:45.220379  8364 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:00:45.326643  7982 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:45.328477  1745 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:45.327790  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:45.331357  7982 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:45.334295  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.300518  8434 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.336725  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 233515us
W20260709 13:00:45.345273  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.344359  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:45.320598  8445 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.329885  8442 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.356016  8442 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.359023  8442 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:45.325695  8425 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.327798  8432 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:45.293946  8021 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.366083  8406 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.367928  8021 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:45.368464  8434 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.353003  8455 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:45.354709  8407 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:45.299737  8448 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:45.342224  8418 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:45.384119  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49938.4us
I20260709 13:00:45.407506  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:45.395277  7982 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.424288  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.438941  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.447683  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:45.419633  1751 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:00:45.390192  8021 raft_consensus.cc:2764] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:00:45.393610  8425 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:45.456135  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 138113us
I20260709 13:00:45.462072  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:45.428905  8418 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.463996  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:45.422523  8434 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:45.443048  8300 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.449391  8416 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:45.442780  8060 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:45.482961  8436 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:45.483770  8436 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:45.485162  8436 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.426162  8442 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:00:45.487699  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:45.458238  8431 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:45.483650  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45488.6us
I20260709 13:00:45.496023  1751 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:45.490080  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:45.497953  1748 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:45.469499  8364 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:45.501226  8364 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:45.501797  8364 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:45.502820  8364 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.459574  8379 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:45.466922  8363 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:45.371747  8445 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.469164  8233 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.422240  8393 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:00:45.552213  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.536662  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.531180  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:45.529927  8431 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:45.528822  8060 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:45.541335  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:45.468568  8418 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:45.536664  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:45.544248  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:45.458567  8450 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:45.537514  8021 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.481482  8425 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.569291  1600 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:45.587704  7982 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:00:45.587973  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51481.3us
I20260709 13:00:45.614032  8060 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:45.537789  8442 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.615072  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 78491.4us
I20260709 13:00:45.660951  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:45.661765  1600 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:45.583228  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:45.576527  8471 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:45.565567  8233 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.587710  8416 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:45.539870  8434 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:00:45.573458  8192 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:45.663197  1748 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:45.557677  8379 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.532212  8466 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:00:45.672521  1672 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:45.694022  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:45.673852  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:45.663772  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:45.696669  1602 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:45.654762  8406 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:45.600807  8021 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.706981  1748 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28.
I20260709 13:00:45.708318  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:45.711942  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 120422us
I20260709 13:00:45.715420  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:45.715929  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51745us
I20260709 13:00:45.713238  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:45.716250  1748 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:45.727612  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:45.671625  8476 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.632958  8425 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.687726  8407 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:45.732645  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.732085  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:45.724642  8434 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:45.668491  8442 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:45.632366  8450 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.673363  8461 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 13:00:45.567162  8448 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:45.744158  8060 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:45.797946  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3258) took 1242 ms. Trace:
I20260709 13:00:45.798065  8407 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:45.803016  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.803514  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 296429us
W20260709 13:00:45.805544  8424 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.098s	user 0.003s	sys 0.005s
I20260709 13:00:45.806313  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:00:45.827204  1744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3248) took 1341 ms (client timeout 1595 ms). Trace:
W20260709 13:00:45.829962  8435 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.773s	user 0.002s	sys 0.000s
I20260709 13:00:45.687888  8416 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.743091  8393 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:45.796921  8364 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:45.764531  8434 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:45.670709  8471 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:45.734690  8466 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:00:45.843139  1747 rpcz_store.cc:276] 0709 13:00:44.555661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.582263 (+ 26602us) service_pool.cc:224] Handling call
0709 13:00:44.582549 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.608881 (+ 26332us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:44.634359 (+ 25478us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.788080 (+153721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.788143 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:44.788284 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.796988 (+1008704us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800346480. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e36e2a6 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419
0709 13:00:45.797580 (+   592us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54000d4154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:45.797637 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.797825 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9273,"prepare.queue_time_us":31583,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":113,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6989,"spinlock_wait_cycles":65253888,"thread_start_us":127563,"threads_started":1,"wal-append.queue_time_us":303516}
I20260709 13:00:45.673225  8467 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 13:00:45.872152  1744 rpcz_store.cc:269] 0709 13:00:44.485484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.486260 (+   776us) service_pool.cc:224] Handling call
0709 13:00:45.826903 (+1340643us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54002e6b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:45.827076 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453826304}
I20260709 13:00:45.883183  8416 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:45.893102  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46740.9us
I20260709 13:00:45.919171  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 2992) took 1274 ms. Trace:
I20260709 13:00:45.919363  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:45.901186  8456 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:00:45.841729  8192 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.873072  8472 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:45.898157  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:45.919750  1671 rpcz_store.cc:276] 0709 13:00:44.644978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.645110 (+   132us) service_pool.cc:224] Handling call
0709 13:00:44.656863 (+ 11753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.758961 (+102098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.918862 (+1159901us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400322dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:45.919106 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232844544}
I20260709 13:00:45.905100  8393 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:45.738693  8476 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:45.873764  8060 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:45.904526  8364 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:45.918637  8232 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.915051  8445 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:45.928874  8192 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:45.942404  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 207178us
I20260709 13:00:45.934633  8393 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:45.993438  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:45.980337  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3406) took 1454 ms. Trace:
I20260709 13:00:45.996959  1675 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:45.997427  1598 rpcz_store.cc:276] 0709 13:00:44.526323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.596306 (+ 69983us) service_pool.cc:224] Handling call
0709 13:00:44.596633 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.597030 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.597066 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.597682 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.770185 (+172503us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:44.770249 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.770371 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.829085 (+1058714us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:45.966838 (+137753us) raft_consensus.cc:1685] finished
0709 13:00:45.966879 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.980214 (+ 13335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8303488,"thread_start_us":172041,"threads_started":1,"wal-append.queue_time_us":367144}
I20260709 13:00:46.002133  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3005) took 1347 ms. Trace:
I20260709 13:00:45.932296  8472 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.007175  1675 rpcz_store.cc:276] 0709 13:00:44.650235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.756908 (+106673us) service_pool.cc:224] Handling call
0709 13:00:45.897986 (+1141078us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b5800091898. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e368b71 00007f947e368a22 00007f9487281c09 00007f94863dbee0 00007f94864a50ab 00007f94864a5131 00007f94864530a0 00007f9486452984 00007f947f9cd6d4 00007f947f9cd662
0709 13:00:45.997684 (+ 99698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3045632}
I20260709 13:00:46.010917  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:45.980935  8433 consensus_meta.cc:287] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.754s	user 0.016s	sys 0.000s
I20260709 13:00:46.015401  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:46.015777  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 96507.2us
I20260709 13:00:45.979211  8233 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:46.013511  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:45.981491  8477 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.023701  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.024454  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:46.023041  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 216804us
I20260709 13:00:45.964049  8416 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:00:46.029807  8416 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:45.999099  8445 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:45.992985  8475 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:46.028800  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.034432  1675 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:46.011309  8387 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.031081  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:45.957664  8434 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.027235  8462 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
I20260709 13:00:46.044389  8490 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:46.019167  8021 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:46.020641  8300 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.056267  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:46.018849  8479 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:46.058324  1675 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:46.070030  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:46.071055  8483 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.071679  8493 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:00:46.087159  8464 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 13:00:46.039098  8445 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.091827  8463 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:46.093497  8445 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:46.099725  8468 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:00:46.101455  8470 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:46.102090  8470 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.102566  8470 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:46.103436  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3407) took 1576 ms. Trace:
I20260709 13:00:46.103924  1595 rpcz_store.cc:276] 0709 13:00:44.528286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.598820 (+ 70534us) service_pool.cc:224] Handling call
0709 13:00:44.980806 (+381986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.981671 (+   865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.103178 (+1121507us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000258d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:46.103360 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877546752}
I20260709 13:00:46.049702  8364 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.106245  8364 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:46.107016  8426 consensus_queue.cc:1175] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1a40ab12c220464db732562e88c32c11" responder_term: 17 status { last_received { term: 13 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [15.8-16.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:46.108315  8425 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:46.109067  8486 consensus_queue.cc:1059] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:00:46.110055  8459 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.084537  8479 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.110813  8459 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.112928  8479 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:46.113646  8459 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:46.115007  8386 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.155s
I20260709 13:00:46.116024  8418 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.117684  8441 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:46.118933  8418 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:46.121505  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.122224  8441 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:46.123927  8489 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:00:46.129307  8472 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:46.132180  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 62229.2us
I20260709 13:00:46.136248  8363 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:46.137639  8363 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:46.139830  8452 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:46.139907  8450 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:46.135277  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:46.021878  8433 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.025283  8060 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.140463  8452 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.170948  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:46.045848  8387 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.142552  8064 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:46.036636  8484 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 13:00:46.089121  8493 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.034646  8477 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.178768  1675 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:46.157968  8450 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:00:46.193735  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.226852  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.238615  1568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.036s	sys 0.072s
W20260709 13:00:46.241158  1568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.036s	sys 0.072s
I20260709 13:00:46.241606  8488 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:46.243307  1595 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:46.243508  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72636.5us
I20260709 13:00:46.244771  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:46.245855  8472 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:46.246366  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:46.152221  8363 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:00:46.175853  8471 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:46.088936  8483 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.253140  8472 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:46.279464  8473 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:00:46.281435  8494 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.282306  8494 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.283844  8474 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:00:46.299028  8471 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:46.300119  8471 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.303651  8471 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.316372  8452 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.318682  8452 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:46.321620  8477 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:46.326993  8433 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.341776  1750 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:46.356248  8387 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.357936  8493 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.360287  8493 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:46.368039  8483 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.261992  8192 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.267881  8476 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:46.385084  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.402089  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.408311  8375 raft_consensus.cc:1064] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:00:46.413439  8379 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:46.417811  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.411154  8375 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.425033  8064 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:46.425705  8064 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:46.430473  8434 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:46.433218  8364 raft_consensus.cc:3055] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:46.433898  8364 raft_consensus.cc:740] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.444696  8364 consensus_queue.cc:260] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.447064  8467 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:46.447781  8467 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.449028  8467 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.450398  8467 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:46.454387  8481 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.455624  8481 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.464942  8386 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:46.465739  8386 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:46.467146  8386 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.469071  8386 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:46.472892  7982 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:46.473353  7982 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:46.474119  7982 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.475193  7982 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.476118  8449 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:46.476589  8449 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.477494  8449 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.478902  8449 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.480417  8441 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:46.495772  8417 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.496536  8417 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.499421  8417 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:46.499931  1643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.031s	sys 0.038s
W20260709 13:00:46.502336  1643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.032s	sys 0.038s
W20260709 13:00:46.500705  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 447660us
W20260709 13:00:46.506187  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.511907  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.514242  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.509631  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.518322  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 493290us
I20260709 13:00:46.527346  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.528040  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.528774  1676 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:46.544507  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:46.545447  2316 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:46.549927  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.550207  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.551434  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:46.553021  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.550798  1676 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
W20260709 13:00:46.544555  1567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.063s	sys 0.090s
W20260709 13:00:46.593842  1567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.063s	sys 0.090s
I20260709 13:00:46.555271  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:46.594717  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:46.596168  7982 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:46.596647  7982 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.596943  7982 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.403429  8442 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.517874  8192 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.625130  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 371835us
W20260709 13:00:46.625401  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89837.6us
I20260709 13:00:46.622673  2309 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:46.595453  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:46.626823  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.645133  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:46.632587  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.505954  8364 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:46.644246  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.646505  2310 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:46.655187  1675 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:46.657203  7982 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.664553  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:46.646929  8387 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:46.621091  8500 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:46.569835  8486 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:00:46.675714  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:46.630190  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:46.691244  1676 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:46.688738  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 56576.8us
I20260709 13:00:46.628706  8379 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.645821  8477 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.692360  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 62263.4us
I20260709 13:00:46.668159  8433 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:46.666741  8459 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:46.716459  8459 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:46.673842  8471 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:00:46.702593  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.624362  8192 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.708042  1669 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:46.676745  8387 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:46.708707  8426 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:46.710134  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.669s (SENT) [suppressed 42 similar messages]
I20260709 13:00:46.696044  8442 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:46.711081  8492 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:00:46.712407  8417 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:46.645757  8503 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:00:46.706825  8433 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.728439  1669 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.701726  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:46.729197  8393 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.003s
I20260709 13:00:46.694723  8500 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.729808  8481 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:46.766585  8192 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:46.754604  8433 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:46.671504  8501 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:00:46.726071  8471 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.754261  8504 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.758224  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:46.758818  8486 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:46.754462  8491 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:46.766507  8500 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:46.752868  1669 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.779060  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1491) took 1116 ms. Trace:
W20260709 13:00:46.756650  8470 consensus_meta.cc:287] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.003s
I20260709 13:00:46.790230  1748 rpcz_store.cc:276] 0709 13:00:45.663204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.732725 (+ 69521us) service_pool.cc:224] Handling call
0709 13:00:45.733101 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.926381 (+193280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.926419 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.926472 (+    53us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:45.926515 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.778655 (+852140us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000d4b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:46.778737 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.778966 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443922816}
I20260709 13:00:46.726455  8477 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.783036  8488 consensus_meta.cc:287] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.001s
I20260709 13:00:46.772250  8481 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.808205  1669 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:46.783905  8471 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:46.816008  8481 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.807042  8488 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:46.785548  8486 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:46.793639  8491 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.819741  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 118109us
W20260709 13:00:46.820104  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.821138  1676 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:00:46.812808  8387 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.813622  8466 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:46.789352  8504 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.829742  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.835108  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.853644  1744 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:00:46.784859  8459 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:46.849200  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.861817  1752 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
W20260709 13:00:46.866312  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.844607  8060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.016s
I20260709 13:00:46.773286  8393 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:46.881340  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.785507  8380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.001s	user 0.023s	sys 0.019s
I20260709 13:00:46.876048  1752 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:46.707773  8379 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:46.888433  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.848022  8488 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:46.847332  8466 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:46.891765  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 222089us
I20260709 13:00:46.901713  1669 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:46.799726  8470 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.901997  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:46.904683  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.906143  8459 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:46.909655  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.917696  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:46.918388  1672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.047s	sys 0.136s
W20260709 13:00:46.918800  1672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.047s	sys 0.136s
I20260709 13:00:46.927150  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.912039  8459 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:46.927609  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:46.931772  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:46.905639  8380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.119s	user 0.024s	sys 0.019s
W20260709 13:00:46.877627  8060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.014s	sys 0.016s
I20260709 13:00:46.933152  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.912865  8475 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.972868  8488 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:46.992192  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64704.2us
I20260709 13:00:46.992683  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.993155  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:46.993408  1747 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
W20260709 13:00:46.957254  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3053086230000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 13:00:46.963948  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.994385  1751 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:46.965477  1743 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:46.986213  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:46.972823  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:46.973301  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:46.998520  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 286999us
I20260709 13:00:46.986626  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:47.013365  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:47.028141  1745 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:46.972543  8380 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:46.929248  8407 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:46.916286  8486 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:46.977547  8459 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.945299  1752 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:46.980161  8485 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:47.029603  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:46.930895  8503 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.979101  8502 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.035935  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 325767us
I20260709 13:00:46.930387  8501 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.097s
W20260709 13:00:47.053675  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.060621  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.071770  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:47.039745  8386 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.004s
I20260709 13:00:46.991282  8488 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.089442  8503 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.095928  2312 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Advancing to term 18
I20260709 13:00:47.003263  8475 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.098359  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:47.034265  8516 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:47.038427  8407 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:47.068516  8485 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:47.104065  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.103336  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 107973us
W20260709 13:00:47.107179  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.102754  1745 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:47.114126  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.133760  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:47.175715  2312 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:47.135926  8506 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:00:47.135939  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:47.181126  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 67092.1us
I20260709 13:00:47.182291  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:47.186362  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.187096  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.187812  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.190819  8496 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:00:47.128548  8448 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.105702  8509 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.191774  8386 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.191921  8448 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.192402  8386 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.131726  8455 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:47.139658  8407 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:47.134940  8060 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.195837  8500 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:47.199810  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:47.130716  8064 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.004s
W20260709 13:00:47.135699  8511 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:00:47.189293  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.103315  8481 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:47.154352  8488 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:47.210103  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 217013us
I20260709 13:00:47.015793  8466 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.115173  8486 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:47.208611  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.138746  8393 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:47.195658  8192 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:47.136442  8513 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:00:47.195212  8448 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:47.145927  8504 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:47.205977  8516 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.216449  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:47.095297  8502 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.214125  8446 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:00:47.224840  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.198897  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 176478us
I20260709 13:00:47.206662  8496 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.202134  8442 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:47.216059  8477 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:47.254670  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:00:47.316411  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.460760  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.202479  8060 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.138096  8380 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.245127  8379 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:47.239833  8481 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:47.465431  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.502323  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.502792  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.503208  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.463030  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.210137  8064 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.496646  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:47.498505  1670 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:47.254431  8466 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:47.457847  8442 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.247275  8488 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.249s
I20260709 13:00:47.192368  8509 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.252719  8470 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:47.465431  8446 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 28 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:47.483876  8504 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.526587  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3186) took 1516 ms. Trace:
W20260709 13:00:47.528815  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 306868us
I20260709 13:00:47.532297  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.530835  1671 rpcz_store.cc:276] 0709 13:00:46.010116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.017440 (+  7324us) service_pool.cc:224] Handling call
0709 13:00:46.034186 (+ 16746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.103469 (+ 69283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.103517 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.401408 (+297891us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b2c0013c2c8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 13:00:46.402021 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.754230 (+352209us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:46.754297 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.754397 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.519631 (+765234us) raft_consensus.cc:1685] finished
0709 13:00:47.519665 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.526476 (+  6811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19724,"raft.queue_time_us":104689,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"spinlock_wait_cycles":80298752,"thread_start_us":393787,"threads_started":2,"wal-append.queue_time_us":505071}
I20260709 13:00:47.535837  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.537200  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.502910  8192 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.501899  8481 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.546171  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.507089  8506 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.514034  8455 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.559857  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.505285  8524 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:00:47.551744  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 297085us
I20260709 13:00:47.521593  8442 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:47.256938  8516 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.466754  8496 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.247557  8485 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:47.589149  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.545969  8477 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:47.587949  1749 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:47.561652  8481 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:47.573179  8518 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:47.545706  8379 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:00:47.626516  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.552449  8504 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.588670  8470 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:47.625178  8514 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.526s	user 0.000s	sys 0.002s
I20260709 13:00:47.573331  8506 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.627498  8533 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:47.636794  8536 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.624564  8446 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.638245  8516 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:47.624100  8524 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:00:47.640097  8523 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:00:47.643002  8433 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.875s	user 0.012s	sys 0.000s
I20260709 13:00:47.644265  8502 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:47.646731  8471 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.001s
W20260709 13:00:47.648610  8521 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
I20260709 13:00:47.607782  8535 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:00:47.651695  8518 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:47.573222  8455 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.653699  8504 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:47.562114  8192 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.654481  8064 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:47.656428  8496 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:47.656771  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.593575  8477 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.594983  8387 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.610321  8467 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.159s	user 0.017s	sys 0.003s
W20260709 13:00:47.629154  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52595.1us
I20260709 13:00:47.613689  8153 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:00:47.673596  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 130719us
I20260709 13:00:47.698982  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:47.773654  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:47.672546  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:47.739794  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:47.854287  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.849504  8512 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.554s	user 0.001s	sys 0.001s
W20260709 13:00:47.850785  8452 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.531s	user 0.016s	sys 0.000s
I20260709 13:00:47.885708  1678 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:00:47.867924  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 330767us
I20260709 13:00:47.666759  8533 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.794457  8459 consensus_meta.cc:287] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
W20260709 13:00:47.697188  8493 consensus_meta.cc:287] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.336s	user 0.012s	sys 0.004s
I20260709 13:00:47.899088  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:47.900485  1677 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:47.856855  8364 consensus_meta.cc:287] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.188s	user 0.013s	sys 0.003s
I20260709 13:00:47.672928  8488 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:47.846279  8494 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:47.848641  8506 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:47.855940  8477 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:47.926256  8481 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.915331  1672 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:00:47.666453  8470 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:47.916419  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.868095  8379 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:47.847851  8538 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.923797  8192 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:47.918143  8488 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.947335  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94058us
W20260709 13:00:47.848733  8434 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.417s	user 0.013s	sys 0.004s
I20260709 13:00:47.796597  8540 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.860828  8387 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.930686  8493 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:00:47.897377  8064 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.958875  8528 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.959273  8529 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.864873  8471 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.960726  1677 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:47.904385  8533 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:47.867198  8153 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.866528  8433 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.932371  8501 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.920915  8431 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:47.674297  8536 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.971696  8549 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.952469  8488 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:47.914695  8459 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.958001  8192 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.943574  8452 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:00:47.983698  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.928934  8502 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:47.948272  8509 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.018049  1594 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:48.018251  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 119239us
W20260709 13:00:48.018585  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.958933  8385 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.029237  1671 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 13:00:48.027309  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:48.030432  1595 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:48.030725  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:47.951372  8379 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:48.036301  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.039844  1603 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:48.039369  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.043939  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.047009  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.048978  1594 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:48.051492  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:48.052436  1603 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.053884  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.054644  1601 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:48.021670  8470 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:47.970247  8064 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.020006  8550 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:48.063911  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.064707  1598 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:48.064711  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:48.014104  8535 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:00:48.016101  8442 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.015254  8431 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.073988  1602 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:48.067574  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.075311  1594 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:47.997053  8501 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:47.960294  8540 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.081055  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.088052  1594 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:48.089406  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.090129  1597 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:47.959911  8518 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.085691  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.082053  1595 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:00:48.039721  8509 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.089406  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.091838  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.094448  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:47.966434  8528 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.097553  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.070446  8550 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.070307  8541 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.103677  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.027468  8192 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:48.106331  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:47.966818  8538 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:47.964053  8529 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.110682  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.111488  1752 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:48.119956  1641 connection.cc:256] RPC call timeout handler was delayed by -2.0830747730000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:00:48.102206  8504 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.104760  8552 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.137593  8534 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:00:48.039714  8385 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.138685  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.111151  8481 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.025311  8549 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.105976  8550 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:48.138971  8551 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:00:48.114081  8455 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.165609  8506 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.179241  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 226778us
I20260709 13:00:48.106889  8509 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:48.168095  8532 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260709 13:00:48.182556  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:48.186434  1597 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.169483  8516 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:48.168018  7896 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.130674  8541 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:48.209321  1597 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:48.222080  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:48.225637  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3209) took 1015 ms. Trace:
I20260709 13:00:48.226096  1674 rpcz_store.cc:276] 0709 13:00:47.210293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.210584 (+   291us) service_pool.cc:224] Handling call
0709 13:00:47.220375 (+  9791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.240739 (+ 20364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.240795 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.241746 (+   951us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.563901 (+322155us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:47.563948 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.564077 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.225394 (+661317us) raft_consensus.cc:1685] finished
0709 13:00:48.225421 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.225572 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21393,"raft.queue_time_us":236607,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":31269,"thread_start_us":321325,"threads_started":1,"wal-append.queue_time_us":426355}
I20260709 13:00:48.231359  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:48.232594  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.137017  8557 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:00:48.235895  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.243707  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3026) took 1422 ms. Trace:
I20260709 13:00:48.172456  8504 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:48.259019  1717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.007s
W20260709 13:00:48.259801  1717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.007s	sys 0.008s
I20260709 13:00:48.261278  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:48.261610  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.262060  1597 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:48.244258  1748 rpcz_store.cc:276] 0709 13:00:46.821403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.826300 (+  4897us) service_pool.cc:224] Handling call
0709 13:00:46.826836 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.892976 (+ 66140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.893031 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.893685 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.203207 (+309522us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:47.203271 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.243167 (+1039896us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b540040a6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:48.243230 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.243290 (+    60us) raft_consensus.cc:1685] finished
0709 13:00:48.243305 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.243625 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10944,"raft.queue_time_us":12018,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7249,"spinlock_wait_cycles":125527424,"thread_start_us":280487,"threads_started":1,"wal-append.queue_time_us":606727}
I20260709 13:00:48.264242  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.221339  8387 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.227815  7896 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.273257  8442 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.273461  7896 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.185937  8506 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.291745  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3206) took 1112 ms. Trace:
I20260709 13:00:48.236188  8459 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.296988  8539 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.246644  8153 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.312156  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:48.301962  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.289696  8434 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.303892  8192 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.294524  1676 rpcz_store.cc:276] 0709 13:00:47.178959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.179932 (+   973us) service_pool.cc:224] Handling call
0709 13:00:47.180374 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.217314 (+ 36940us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:47.217363 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.217905 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.492811 (+274906us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:47.492957 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.493094 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.291410 (+798316us) raft_consensus.cc:1685] finished
0709 13:00:48.291442 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.291660 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36262,"raft.queue_time_us":64222,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5292,"thread_start_us":274440,"threads_started":1,"wal-append.queue_time_us":393554}
I20260709 13:00:48.219463  8516 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.308084  8548 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.328804  8495 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.331176  8407 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.124s	user 0.004s	sys 0.010s
I20260709 13:00:48.176936  8552 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.332821  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.438242  1603 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:48.379221  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:48.290577  8379 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.363268  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:48.377477  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.441190  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.441841  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.442621  1603 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:48.443511  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.452878  1603 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:48.458187  1676 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:48.459476  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.461637  1595 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:48.465188  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.437369  8536 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.478029  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.370579  8538 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.485368  7982 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.486954  8509 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:48.489575  8466 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.968s	user 0.012s	sys 0.000s
I20260709 13:00:48.491742  8524 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.436959  8434 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.465270  8431 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.501900  8540 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.503242  8549 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.498208  8433 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.508104  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 3042) took 1541 ms. Trace:
I20260709 13:00:48.508567  1745 rpcz_store.cc:276] 0709 13:00:46.966967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.028940 (+ 61973us) service_pool.cc:224] Handling call
0709 13:00:48.507847 (+1478907us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5400420ed4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:48.507994 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33023360}
I20260709 13:00:48.509938  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.510859  1745 raft_consensus.cc:2410] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:00:48.511922  8528 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:48.517797  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.523722  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.439858  8407 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.525681  8552 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.527441  1745 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:48.529450  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:48.532842  1746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.017s
W20260709 13:00:48.533602  1746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.017s
I20260709 13:00:48.535770  1748 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.479146  8503 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.473799  8548 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:48.541455  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.463053  8495 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:48.548887  8510 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 1.530s	user 0.010s	sys 0.013s
I20260709 13:00:48.494589  8524 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.553542  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:48.390424  8539 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.565060  8539 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.534541  8431 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.536484  8477 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.004s
I20260709 13:00:48.528851  8407 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.374701  8550 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.571956  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.576848  8434 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.577682  8504 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.566463  8431 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.580488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:48.577749  8486 consensus_meta.cc:287] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.338s	user 0.011s	sys 0.003s
I20260709 13:00:48.584965  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.611874  1602 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:48.598829  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.612300  1743 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:48.603140  1601 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:48.606216  1748 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:48.613442  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:48.579257  8541 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.614681  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:48.607013  8488 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.007s
I20260709 13:00:48.620301  1678 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
W20260709 13:00:48.623145  1670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3208) took 1443 ms (client timeout 1696 ms). Trace:
W20260709 13:00:48.623602  1670 rpcz_store.cc:269] 0709 13:00:47.179677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.181038 (+  1361us) service_pool.cc:224] Handling call
0709 13:00:48.622958 (+1441920us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54003e71d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:48.623086 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683605888}
I20260709 13:00:48.624845  8431 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.624992  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:48.625507  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.627264  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:48.629913  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:48.633545  8550 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.634629  8486 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.620716  8503 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.635725  8503 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.635820  8431 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:48.636219  8503 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.618675  8528 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:48.638079  8528 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:48.638500  8528 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:48.636122  8375 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.635320  8486 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.639648  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.640885  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:48.640986  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:48.640378  1594 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:48.644582  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.593969  8477 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.645231  1594 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:48.602061  8387 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.647293  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.650983  1594 raft_consensus.cc:2410] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:48.645427  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:48.644013  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:48.651782  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7977292190000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:00:48.652125  1602 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
W20260709 13:00:48.652216  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7959292190000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:00:48.652259  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:48.652729  1566 connection.cc:256] RPC call timeout handler was delayed by -1.7644292190000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 13:00:48.653136  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:48.649313  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.656019  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.659814  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.662580  1602 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:00:48.667614  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:48.668589  2311 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:48.619504  8407 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:48.674083  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:48.642007  8431 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:48.643990  8504 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:48.657785  8533 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 13:00:48.676975  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:48.679847  1597 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:48.680372  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.622314  8488 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.665112  8492 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:48.665362  8434 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:48.680720  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 495682us
I20260709 13:00:48.683058  7982 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:48.683207  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:48.690889  7982 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.691339  7982 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.658618  8530 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:48.681908  8555 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:48.686753  8492 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.675956  8539 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:00:48.706372  8477 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.707836  2311 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:48.712883  8380 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:48.713629  1600 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:48.714623  8488 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.686084  8533 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:48.715922  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.745609  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3213) took 1034 ms. Trace:
I20260709 13:00:48.717060  8516 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.757767  1596 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:48.717361  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.753659  1677 rpcz_store.cc:276] 0709 13:00:47.711518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.711742 (+   224us) service_pool.cc:224] Handling call
0709 13:00:48.745420 (+1033678us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b540036e7d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:48.745546 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76831488}
W20260709 13:00:48.761165  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.744231  1675 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:48.761924  1675 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:48.651154  8375 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.765751  8375 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.678516  8431 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.723958  8555 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.766760  8555 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:48.767679  8539 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:48.768280  8539 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.725126  8492 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:48.770634  8539 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.742406  8380 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:48.670532  8387 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.772033  8380 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.773192  8380 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:48.773368  8387 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.775228  8407 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.775876  8407 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:48.730221  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47055.8us
I20260709 13:00:48.731123  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:48.778069  8407 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.732367  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:48.778673  8407 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.734150  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:48.779582  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45503.1us
I20260709 13:00:48.780812  8493 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:48.779721  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:48.729040  8471 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.734736  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.781390  8493 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.782234  8471 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:48.782373  1743 raft_consensus.cc:2393] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 28: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:48.782794  8471 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:48.783869  8471 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.785980  8536 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:48.786525  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.778682  8492 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:48.741413  1672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3204) took 1645 ms (client timeout 2003 ms). Trace:
I20260709 13:00:48.787200  1751 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
W20260709 13:00:48.787492  1672 rpcz_store.cc:269] 0709 13:00:47.095629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.097917 (+  2288us) service_pool.cc:224] Handling call
0709 13:00:48.741114 (+1643197us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400433854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:48.741330 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861408000}
I20260709 13:00:48.787984  8555 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.788895  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.646536  8541 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:48.790009  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:48.790889  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.757660  8060 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.790077  8466 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:48.792380  8466 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:48.792992  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.793857  1677 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:48.793316  8466 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.762707  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3207) took 1583 ms. Trace:
I20260709 13:00:48.733353  8483 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.730448  7982 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.757735  8385 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.757016  8533 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.791642  1747 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 7.
I20260709 13:00:48.758354  8495 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.812820  8386 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.786551  8536 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.816532  1596 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 13:00:48.818256  8536 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:48.791085  8541 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:00:48.818843  8543 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.871s	user 0.003s	sys 0.000s
I20260709 13:00:48.819100  8541 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:48.820356  8386 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.820130  8541 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.820894  8386 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.821657  8541 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.822141  1603 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:00:48.793326  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.762917  1675 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:48.795125  1748 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
I20260709 13:00:48.791378  8433 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:48.798108  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:48.794530  1673 rpcz_store.cc:276] 0709 13:00:47.179321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.180930 (+  1609us) service_pool.cc:224] Handling call
0709 13:00:47.191125 (+ 10195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.201516 (+ 10391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.201588 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.201667 (+    79us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:47.201714 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.762437 (+1560723us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b540006de54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:48.762502 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.762650 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23147904}
W20260709 13:00:48.795619  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52051.5us
W20260709 13:00:48.809078  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 155880us
I20260709 13:00:48.797336  8516 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.818421  1596 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:48.822564  1603 pending_rounds.cc:85] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 10
I20260709 13:00:48.796345  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.828908  1603 pending_rounds.cc:107] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:00:48.829141  1677 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 10.
I20260709 13:00:48.823316  1745 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:00:48.823413  1675 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.827250  8536 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:48.830404  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.831089  1745 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:48.779280  8407 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.829249  1603 raft_consensus.cc:2889] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.823330  7982 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.795879  8555 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.827715  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.856706  1603 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:48.857110  1748 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:48.857132  1603 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:48.833643  1566 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.732s (SENT)
I20260709 13:00:48.835319  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.831936  8516 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.840806  8064 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:48.846338  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 234) took 8512 ms. Trace:
I20260709 13:00:48.849900  2311 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:46.252349   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.850575  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.851861  1501 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 11, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.852986  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.853868  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3029) took 2028 ms. Trace:
I20260709 13:00:48.868763  1501 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.851476  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.854918  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.839171  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.871043  1501 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 16 to 19, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:48.860482  1566 leader_election.cc:336] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.733s (SENT)
I20260709 13:00:48.860438  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:00:48.878320  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5070292190000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
I20260709 13:00:48.863660  1675 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:00:48.879871  1675 pending_rounds.cc:85] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 9
I20260709 13:00:48.880286  1675 pending_rounds.cc:107] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:48.880678  1675 raft_consensus.cc:2889] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.868188  1749 rpcz_store.cc:276] 0709 13:00:46.825281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.825520 (+   239us) service_pool.cc:224] Handling call
0709 13:00:46.858152 (+ 32632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.593703 (+735551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.853613 (+1259910us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54001c39d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:48.853803 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677486336}
I20260709 13:00:48.896983  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.897692  1677 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 8.
I20260709 13:00:48.898838  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.899178  1672 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:00:48.896704  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.899623  2311 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:48.901002  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:48.901571  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.901775  2310 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEARNER]: Advancing to term 18
I20260709 13:00:48.902499  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1557) took 2219 ms. Trace:
I20260709 13:00:48.902906  1675 rpcz_store.cc:276] 0709 13:00:46.662393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.672568 (+ 10175us) service_pool.cc:224] Handling call
0709 13:00:46.673037 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.744064 (+2071027us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b540035d020. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481404dc0 00007f948148f1c0 00007f9481490231 00007f948148cd8f 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c
0709 13:00:48.881334 (+137270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.881617 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180456320}
I20260709 13:00:48.899951  1745 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:48.875104  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:48.904536  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.905465  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.904481  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.908280  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.909046  1675 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:00:48.910246  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:48.910285  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.912840  1749 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:48.915695  1750 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:48.911038  1673 raft_consensus.cc:2376] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17. Re-sending same reply.
I20260709 13:00:48.917572  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.917924  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:48.918708  1747 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:48.919395  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.919852  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3205) took 1819 ms. Trace:
I20260709 13:00:48.920578  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:48.924011  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:48.924678  1748 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:48.925928  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.928931  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.865186  1497 rpcz_store.cc:276] 0709 13:00:40.337332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.342845 (+  5513us) service_pool.cc:224] Handling call
0709 13:00:41.804176 (+1461331us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 13:00:48.846227 (+7042051us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:44.299954 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:44.300710 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:44.300744 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:00:44.300763 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:44.301581 (+   818us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:44.301643 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:44.301669 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:44.302201 (+   532us) tablet.cc:701] Row locks acquired
0709 13:00:44.302221 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:44.302478 (+   257us) write_op.cc:270] Start()
0709 13:00:44.302609 (+   131us) write_op.cc:276] Timestamp: P: 1783602044302420 usec, L: 0
0709 13:00:44.302632 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:44.358649 (+ 56017us) log.cc:844] Serialized 2482 byte log entry
0709 13:00:44.611631 (+252982us) op_driver.cc:464] REPLICATION: finished
0709 13:00:44.792231 (+180600us) write_op.cc:301] APPLY: starting
0709 13:00:44.797613 (+  5382us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:45.252650 (+455037us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:45.293695 (+ 41045us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:45.494125 (+200430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:45.494487 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:00:45.494539 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:45.494834 (+   295us) log.cc:844] Serialized 65 byte log entry
0709 13:00:45.904077 (+409243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.923440 (+ 19363us) write_op.cc:454] Released schema lock
0709 13:00:45.929984 (+  6544us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:45.974224 (+ 44240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.978975 (+  4751us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":323548,"reported_tablets":26,"spinlock_wait_cycles":1537265536,"child_traces":[["op",{"apply.queue_time_us":154494,"apply.run_cpu_time_us":49161,"apply.run_wall_time_us":1174524,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":299148,"prepare.run_cpu_time_us":4293,"prepare.run_wall_time_us":59087,"replication_time_us":270233,"thread_start_us":664250,"threads_started":3,"wal-append.queue_time_us":411426,"wal-append.run_cpu_time_us":1373,"wal-append.run_wall_time_us":1006785}]]}
I20260709 13:00:48.920367  1669 rpcz_store.cc:276] 0709 13:00:47.100704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.100937 (+   233us) service_pool.cc:224] Handling call
0709 13:00:47.101402 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:47.252016 (+150614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.252075 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:47.504317 (+252242us) log.cc:844] Serialized 52 byte log entry
0709 13:00:47.614319 (+110002us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:47.614372 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.614466 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.818130 (+1203664us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:48.901033 (+ 82903us) raft_consensus.cc:1685] finished
0709 13:00:48.901060 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.919755 (+ 18695us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26646,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":23586048,"thread_start_us":200720,"threads_started":2,"wal-append.queue_time_us":300427}
I20260709 13:00:48.933012  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.933337  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.934438  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.934804  2314 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEARNER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 18. Ops: []
I20260709 13:00:48.935729  8386 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:48.937541  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.938819  1673 raft_consensus.cc:2410] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:48.938869  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:48.937716  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.941650  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.942504  1749 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:00:48.929471  1603 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:48.944022  1603 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.944316  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.952778  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.954056  1750 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:48.958338  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.960273  2314 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEARNER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 18. Ops: []
I20260709 13:00:48.960984  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.962540  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:48.961894  1744 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:48.964352  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:48.964975  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:48.965596  1749 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
W20260709 13:00:48.969743  1671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3211) took 1299 ms (client timeout 1519 ms). Trace:
W20260709 13:00:48.970211  1671 rpcz_store.cc:269] 0709 13:00:47.670402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.670690 (+   288us) service_pool.cc:224] Handling call
0709 13:00:48.969559 (+1298869us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540006d954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:48.969678 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372228992}
I20260709 13:00:48.975271  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:48.976655  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:48.980744  2311 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 9: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 13:00:48.994782  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.998128  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:48.999109  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.000792  1745 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:00:49.005141  1747 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:49.006464  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.011821  2310 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEARNER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:48.974402  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:49.013437  1675 raft_consensus.cc:2376] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17. Re-sending same reply.
I20260709 13:00:49.014526  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:49.019873  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.021216  1750 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:48.968775  8466 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.024466  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:49.026034  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:49.027882  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:49.028978  2314 raft_consensus.cc:2393] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:49.031256  1603 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:00:49.035702  1745 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 18. Ops: [16.10-16.10]
I20260709 13:00:48.957130  8503 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:49.036744  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:49.039829  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.043175  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3276) took 1003 ms. Trace:
I20260709 13:00:49.050350  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.060211  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.056288  2317 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:49.045781  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.057700  1745 rpcz_store.cc:276] 0709 13:00:48.039432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.002066 (+962634us) service_pool.cc:224] Handling call
0709 13:00:49.034425 (+ 32359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.042817 (+  8392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.043111 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.061522  1677 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:49.058584  1748 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:49.045198  1750 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:49.064138  1748 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:00:49.065028  1748 pending_rounds.cc:85] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 9
I20260709 13:00:49.065402  1748 pending_rounds.cc:107] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:00:49.059116  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:49.066263  1748 raft_consensus.cc:2889] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.065526  1676 raft_consensus.cc:2376] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17. Re-sending same reply.
I20260709 13:00:49.033111  8492 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:49.030274  8431 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:49.092784  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.105654  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:49.233702  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.173322  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.209406  8578 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:00:49.036751  8466 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.235930  1671 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:49.237957  8466 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.119369  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3282) took 1023 ms. Trace:
I20260709 13:00:49.239826  1748 rpcz_store.cc:276] 0709 13:00:48.096251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.063348 (+967097us) service_pool.cc:224] Handling call
0709 13:00:49.063797 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.119042 (+ 55245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.119295 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.242169  1748 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:49.242977  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3283) took 1143 ms. Trace:
I20260709 13:00:49.244047  1748 rpcz_store.cc:276] 0709 13:00:48.099921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.241555 (+1141634us) service_pool.cc:224] Handling call
0709 13:00:49.241966 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.242685 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.242910 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.245664  1748 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:49.232565  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 155937us
I20260709 13:00:49.118525  8300 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:49.063766  8528 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.064118  8547 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.175s
I20260709 13:00:49.234023  1677 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 13:00:49.069149  1673 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:00:49.133074  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.086280  1675 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:00:49.261436  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3029) took 1137 ms. Trace:
I20260709 13:00:49.263088  1743 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:49.286873  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2872) took 1254 ms. Trace:
I20260709 13:00:49.248220  8300 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.291427  8300 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:49.292711  1603 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:49.291261  1598 rpcz_store.cc:276] 0709 13:00:48.032376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.108668 (+ 76292us) service_pool.cc:224] Handling call
0709 13:00:48.118479 (+  9811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.128238 (+  9759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.128277 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.128824 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.236536 (+107712us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:48.274117 (+ 37581us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.518969 (+244852us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b180044b360. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:00:49.286093 (+767124us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b180044b360. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 13:00:49.286364 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.286483 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.286554 (+    71us) raft_consensus.cc:1685] finished
0709 13:00:49.286577 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.286781 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10335,"prepare.queue_time_us":38501,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":1043902,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":14564,"spinlock_wait_cycles":43409664,"thread_start_us":64638,"threads_started":1,"wal-append.queue_time_us":149075}
I20260709 13:00:49.294914  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.264737  1745 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:49.288367  8545 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:00:49.296589  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3280) took 1223 ms. Trace:
I20260709 13:00:49.296994  1745 rpcz_store.cc:276] 0709 13:00:48.072812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.068175 (+995363us) service_pool.cc:224] Handling call
0709 13:00:49.264195 (+196020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.296026 (+ 31831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.296523 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:49.297834  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.298662  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.299082  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.300519  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.300834  8300 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:49.301716  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.302412  1600 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 25.
I20260709 13:00:49.298619  1745 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:00:49.303710  8300 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:49.303334  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3286) took 1192 ms. Trace:
I20260709 13:00:49.305462  8552 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.304828  1745 rpcz_store.cc:276] 0709 13:00:48.111434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.298001 (+1186567us) service_pool.cc:224] Handling call
0709 13:00:49.298379 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.303063 (+  4684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.303273 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.306032  8552 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.308462  8552 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.266757  8431 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:49.272214  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3284) took 1168 ms. Trace:
W20260709 13:00:49.309329  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4332292189999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 13:00:49.309749  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4323292189999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:00:49.309476  1748 rpcz_store.cc:276] 0709 13:00:48.104301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.245055 (+1140754us) service_pool.cc:224] Handling call
0709 13:00:49.245452 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.271907 (+ 26455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.272146 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:49.310290  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3756292190000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:00:49.310632  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3720292190000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 13:00:49.310952  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3576292190000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:00:49.311240  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3189292190000401s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:00:49.273572  8548 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:49.311697  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3421) took 1273 ms. Trace:
W20260709 13:00:49.311902  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3018292190000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:00:49.312420  1566 connection.cc:256] RPC call timeout handler was delayed by -1.134429219000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23399999999999999s for a response
I20260709 13:00:49.312389  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2887) took 1066 ms. Trace:
I20260709 13:00:49.177794  8407 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:49.313133  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1308292190000202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2344s for a response
I20260709 13:00:49.263935  8529 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.264672  8455 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:49.288724  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3285) took 1179 ms. Trace:
I20260709 13:00:49.332089  1743 rpcz_store.cc:276] 0709 13:00:48.109661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.262339 (+1152678us) service_pool.cc:224] Handling call
0709 13:00:49.262774 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.288437 (+ 25663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.288667 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.334264  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3291) took 1105 ms. Trace:
I20260709 13:00:49.266724  8528 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.287074  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2881) took 1146 ms. Trace:
I20260709 13:00:49.337790  1601 rpcz_store.cc:276] 0709 13:00:48.141149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.493724 (+352575us) service_pool.cc:224] Handling call
0709 13:00:49.286857 (+793133us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b54000d9b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.287013 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166789504}
I20260709 13:00:49.287377  1595 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:49.287698  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3039) took 1155 ms. Trace:
I20260709 13:00:49.339613  1673 rpcz_store.cc:276] 0709 13:00:48.132333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.068466 (+936133us) service_pool.cc:224] Handling call
0709 13:00:49.068808 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.287397 (+218589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.287637 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.287992  1672 rpcz_store.cc:276] 0709 13:00:48.123624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.788599 (+664975us) service_pool.cc:224] Handling call
0709 13:00:49.250398 (+461799us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540036ecd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.261344 (+ 10946us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251604864}
I20260709 13:00:49.306418  8481 raft_consensus.cc:476] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:49.136323  1676 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: [17.7-17.7]
I20260709 13:00:49.342387  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3041) took 1209 ms. Trace:
I20260709 13:00:49.342536  1672 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:49.342902  1676 rpcz_store.cc:276] 0709 13:00:48.132858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.068409 (+935551us) service_pool.cc:224] Handling call
0709 13:00:49.135960 (+ 67551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.342062 (+206102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.342319 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.267342  1750 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:49.344270  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3281) took 1254 ms. Trace:
W20260709 13:00:49.299091  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.311733  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.314167  1596 rpcz_store.cc:276] 0709 13:00:48.246360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.829083 (+582723us) service_pool.cc:224] Handling call
0709 13:00:48.856750 (+ 27667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.312018 (+455268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.312051 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.312097 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:49.312142 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.312221 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.312334 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454884,"raft.queue_time_us":455522}
I20260709 13:00:49.288056  1675 pending_rounds.cc:85] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 11
I20260709 13:00:49.347226  1675 pending_rounds.cc:107] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:00:49.347610  1675 raft_consensus.cc:2889] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.318302  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.312188  1602 rpcz_store.cc:276] 0709 13:00:48.038554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.664000 (+625446us) service_pool.cc:224] Handling call
0709 13:00:48.664425 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.311218 (+646793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.311261 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.311314 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:49.311378 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.311460 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.311628 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646339,"raft.queue_time_us":646826}
I20260709 13:00:49.334689  1743 rpcz_store.cc:276] 0709 13:00:48.228898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.333222 (+1104324us) service_pool.cc:224] Handling call
0709 13:00:49.333608 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.333836 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.333876 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.333931 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:49.333984 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.334052 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.334185 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.349798  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3292) took 1075 ms. Trace:
I20260709 13:00:49.350205  1743 rpcz_store.cc:276] 0709 13:00:48.274740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.348905 (+1074165us) service_pool.cc:224] Handling call
0709 13:00:49.349231 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.349432 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.349459 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.349503 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:49.349545 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.349599 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.349724 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.344638  1750 rpcz_store.cc:276] 0709 13:00:48.090218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.063012 (+972794us) service_pool.cc:224] Handling call
0709 13:00:49.267142 (+204130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.344007 (+ 76865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.344210 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.353232  8503 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:49.344290  8491 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.355368  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.357425  1601 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:49.360484  1745 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 18. Ops: []
I20260709 13:00:49.361271  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3288) took 1236 ms. Trace:
I20260709 13:00:49.361617  1745 rpcz_store.cc:276] 0709 13:00:48.124632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.317020 (+1192388us) service_pool.cc:224] Handling call
0709 13:00:49.360134 (+ 43114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.361004 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.361209 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.281842  8516 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.366731  1602 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
W20260709 13:00:49.367465  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 49262.1us
I20260709 13:00:49.371320  1745 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:00:49.312754  8379 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:49.378907  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.375936  1602 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:49.378937  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.381696  1602 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:49.382180  1675 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:49.329952  8490 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:49.386642  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.388175  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.336186  8455 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:49.389515  1677 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:49.389051  8481 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:00:49.397082  8455 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.398530  8455 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:49.389526  8446 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:49.399268  1596 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:49.404670  8580 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:00:49.407509  8485 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:00:49.411028  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.412259  8446 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:49.413746  8483 consensus_meta.cc:287] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:00:49.413321  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.373528  8552 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:49.422480  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.426308  8524 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.428900  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3274) took 1396 ms. Trace:
I20260709 13:00:49.443625  1744 rpcz_store.cc:276] 0709 13:00:48.032008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.965185 (+933177us) service_pool.cc:224] Handling call
0709 13:00:49.008284 (+ 43099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.008675 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.008705 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.009229 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.200882 (+191653us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:49.200950 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.201064 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.428559 (+227495us) raft_consensus.cc:1685] finished
0709 13:00:49.428595 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.428807 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9886,"spinlock_wait_cycles":17322240,"thread_start_us":168162,"threads_started":1,"wal-append.queue_time_us":354422}
I20260709 13:00:49.432080  8431 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:49.446985  8431 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:49.449646  8506 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:49.450650  8431 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:49.451617  1674 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:00:49.414868  8557 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 13:00:49.437251  8536 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 13:00:49.455890  8536 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:49.444707  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.457412  8557 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:49.416127  8479 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:00:49.416334  8490 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:49.464097  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:49.464476  8490 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:49.466079  8441 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:49.466526  8441 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:49.466962  8441 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:49.390239  8379 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.417423  8448 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:49.422499  8483 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:49.499854  1669 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28.
I20260709 13:00:49.514782  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:49.516287  1566 leader_election.cc:336] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.603s (SENT)
I20260709 13:00:49.523891  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:49.529323  1566 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.926s (SENT)
I20260709 13:00:49.527472  1596 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:00:49.530018  2314 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEARNER]: Advancing to term 19
I20260709 13:00:49.538012  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 2889) took 1244 ms. Trace:
I20260709 13:00:49.538658  1597 rpcz_store.cc:276] 0709 13:00:48.293610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.322889 (+ 29279us) service_pool.cc:224] Handling call
0709 13:00:49.537702 (+1214813us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000938d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.537924 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541972352}
I20260709 13:00:49.540163  1599 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:00:49.541301  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2873) took 1508 ms. Trace:
W20260709 13:00:49.557457  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3026) took 1434 ms (client timeout 1603 ms). Trace:
I20260709 13:00:49.557938  1670 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:00:49.558583  1670 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 10
I20260709 13:00:49.558966  1670 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.11
I20260709 13:00:49.559310  1670 raft_consensus.cc:2917] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Aborting config change with OpId 16.11: Aborted: Op aborted by new leader
I20260709 13:00:49.559875  1670 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.560616  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3430) took 1500 ms. Trace:
I20260709 13:00:49.561264  1595 rpcz_store.cc:276] 0709 13:00:48.060488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.789742 (+729254us) service_pool.cc:224] Handling call
0709 13:00:49.287039 (+497297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.339217 (+ 52178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.560262 (+221045us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54000d9b50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.560510 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142811008}
W20260709 13:00:49.558139  1674 rpcz_store.cc:269] 0709 13:00:48.122732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.235628 (+112896us) service_pool.cc:224] Handling call
0709 13:00:49.557185 (+1321557us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400183dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.557381 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793194240}
I20260709 13:00:49.568545  1746 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
W20260709 13:00:49.570433  1566 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.008s (SENT)
I20260709 13:00:49.584705  8486 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:49.585525  1566 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.009s (SENT)
W20260709 13:00:49.586337  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.586585  8493 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:49.587224  1566 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.072s (SENT)
I20260709 13:00:49.587457  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:49.588426  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.589504  8393 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:49.586603  1749 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:00:49.591873  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3275) took 1557 ms. Trace:
I20260709 13:00:49.592298  1749 rpcz_store.cc:276] 0709 13:00:48.034541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.966517 (+931976us) service_pool.cc:224] Handling call
0709 13:00:49.586229 (+619712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.590691 (+  4462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.591593 (+   902us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400283f50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.591797 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354899840}
I20260709 13:00:49.593217  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:49.593943  1749 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:49.595968  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:49.596699  1566 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.092s (SENT)
I20260709 13:00:49.597172  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:49.597958  8479 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:49.548172  8446 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:49.602679  1566 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.135s (SENT)
W20260709 13:00:49.603729  1566 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.154s (SENT)
I20260709 13:00:49.604410  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:49.605048  1746 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:49.605283  1751 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.605801  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3425) took 1558 ms. Trace:
I20260709 13:00:49.606222  1599 rpcz_store.cc:276] 0709 13:00:48.047899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.739691 (+691792us) service_pool.cc:224] Handling call
0709 13:00:49.539666 (+799975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.540765 (+  1099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.605604 (+ 64839us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54000938d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.605736 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838621440}
I20260709 13:00:49.541832  1594 rpcz_store.cc:276] 0709 13:00:48.032649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.656036 (+623387us) service_pool.cc:224] Handling call
0709 13:00:48.656338 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.656567 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:48.675890 (+ 19323us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.276208 (+600318us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b18001dc500. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 13:00:49.540809 (+264601us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.540886 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:49.540955 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.541052 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.541218 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21362,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":833,"spinlock_wait_cycles":14037248,"thread_start_us":263378,"threads_started":1}
I20260709 13:00:49.608865  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.609720  1599 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:49.612035  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.612859  1594 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:00:49.615725  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.616402  1594 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:49.624920  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.570742  8475 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:49.575450  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3052) took 1108 ms. Trace:
I20260709 13:00:49.628965  1671 rpcz_store.cc:276] 0709 13:00:48.467241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.989710 (+522469us) service_pool.cc:224] Handling call
0709 13:00:49.575231 (+585521us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54003e62d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.575374 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542259456}
I20260709 13:00:49.576738  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.580484  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:00:49.630702  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50327.6us
W20260709 13:00:49.584177  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.581971  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.631937  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.632477  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.634786  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:49.630795  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.641019  1672 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:00:49.637658  1595 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:49.645882  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.649691  1594 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:49.652179  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:49.558818  8380 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.785s	user 0.009s	sys 0.006s
I20260709 13:00:49.668309  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.676312  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.676652  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.677724  1670 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
W20260709 13:00:49.681747  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.709513  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.709313  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.653234  1599 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:49.710968  1597 raft_consensus.cc:2376] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18. Re-sending same reply.
I20260709 13:00:49.710830  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.711229  1594 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:49.711786  1672 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
W20260709 13:00:49.699529  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.641237  8493 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:49.714133  1603 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:49.716240  1595 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:49.716034  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.718899  1594 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:49.719162  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:49.720013  1672 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:49.721508  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.645792  8350 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:49.728336  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.729066  1595 raft_consensus.cc:2376] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14. Re-sending same reply.
I20260709 13:00:49.733067  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.734442  1595 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:49.735950  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.738708  1751 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:49.740007  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.740840  1602 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:49.746240  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.747074  1594 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:00:49.747339  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.755601  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:49.756877  1746 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:49.758731  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.760187  1594 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:00:49.759987  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.763949  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:49.764902  1676 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:49.765064  1602 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:00:49.641019  8485 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:49.768249  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.769127  1670 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:00:49.770358  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.771160  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.768307  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.772257  1599 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:00:49.773500  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.675676  8537 consensus_queue.cc:1059] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 13:00:49.778937  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:49.779876  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.779991  1595 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:49.782542  1602 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:49.787477  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.789844  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:49.790985  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.791045  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:49.821460  1672 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:49.732956  8350 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:49.853298  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62327.7us
I20260709 13:00:49.856508  1746 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:00:49.857577  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.950951  1599 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:49.859028  8524 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.861999  8379 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.863597  8407 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.955878  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.956666  1599 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:49.869088  1751 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:00:49.957573  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.731057  8427 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.140s
W20260709 13:00:49.871398  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.880131  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.881283  8486 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:49.885957  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.713158  8493 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.901021  1676 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:49.905616  1602 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:49.962924  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:49.963842  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.971259  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:49.911819  2314 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:00:49.924973  1743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.036s
W20260709 13:00:49.973680  1743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.008s	sys 0.036s
W20260709 13:00:49.925413  1745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.017s	sys 0.028s
W20260709 13:00:49.974714  1745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.017s	sys 0.028s
W20260709 13:00:49.925822  1715 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.025s
I20260709 13:00:49.927949  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:49.930086  1669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3038) took 1798 ms (client timeout 2340 ms). Trace:
I20260709 13:00:49.948844  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:49.975603  1715 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.006s	sys 0.025s
I20260709 13:00:49.954376  1672 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:49.763607  8300 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:00:49.851688  8485 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:49.958447  1599 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:49.971285  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:49.975795  1669 rpcz_store.cc:269] 0709 13:00:48.132089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.938610 (+806521us) service_pool.cc:224] Handling call
0709 13:00:49.929814 (+991204us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54001833d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:49.930004 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189081856}
I20260709 13:00:49.976459  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:49.978782  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:49.986480  1602 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:00:49.976022  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 557934us
I20260709 13:00:49.982080  1746 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:49.983346  1673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.020s	sys 0.059s
I20260709 13:00:49.952625  8350 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.983134  8557 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.006s
I20260709 13:00:49.989909  8557 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:49.983413  8536 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:49.991030  8536 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.993408  8427 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:49.993780  8485 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:49.994112  8427 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:49.994628  8485 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:49.995081  8485 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.008018  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.010282  1676 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
W20260709 13:00:49.988036  1673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.020s	sys 0.059s
I20260709 13:00:49.965831  8477 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.976861  8407 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:49.997399  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:49.955957  8501 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:49.998579  8541 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 1.176s	user 0.014s	sys 0.004s
I20260709 13:00:49.954237  8524 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:49.991403  8536 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:50.002812  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:50.004196  1715 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.669s (SENT)
I20260709 13:00:50.049973  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:50.004936  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:50.005851  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:50.008018  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:50.009140  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.053761  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:50.053798  1669 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 29 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260709 13:00:50.012837  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:50.056195  1603 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:50.013932  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.015563  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.015821  1599 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:50.058414  1674 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:50.058877  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:50.056221  1752 raft_consensus.cc:2410] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:50.059935  1599 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:00:50.061126  1599 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:00:50.011893  8485 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:50.020610  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:50.065351  1602 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:49.906625  1597 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:49.997087  8427 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:50.023098  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:50.054293  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.062587  1599 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:50.019045  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:50.068605  1670 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:50.062798  1672 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:50.016320  8475 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.073226  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:50.073479  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.074004  1746 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:49.984560  1594 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:50.063817  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1561) took 1302 ms. Trace:
I20260709 13:00:49.968709  8441 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.069438  1599 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:50.079960  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:50.073660  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.081704  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.082481  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.083484  1675 raft_consensus.cc:2410] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:00:50.077162  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:50.064231  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.055415  8524 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.080780  1599 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.089556  1599 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:50.090636  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:50.085261  1669 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:50.093696  8541 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:50.098201  8547 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:50.098894  8547 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:50.079224  8475 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.102612  8475 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:50.105726  8493 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.108065  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:50.109197  1751 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:50.110411  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:50.112311  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:50.046437  8477 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:50.116078  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.117053  1670 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:50.115499  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:50.118422  8477 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:50.118772  1597 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:50.121038  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46136 (request call id 1509) took 1276 ms. Trace:
I20260709 13:00:50.121642  1752 rpcz_store.cc:276] 0709 13:00:48.845067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.852692 (+  7625us) service_pool.cc:224] Handling call
0709 13:00:50.120775 (+1268083us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540013a954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:50.120961 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731886848}
I20260709 13:00:50.122264  8547 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:50.124452  8584 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:00:50.126020  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3277) took 2069 ms. Trace:
I20260709 13:00:50.126478  1747 rpcz_store.cc:276] 0709 13:00:48.056477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.006014 (+949537us) service_pool.cc:224] Handling call
0709 13:00:49.006503 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.023241 (+ 16738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.023293 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.048940 (+ 25647us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.678514 (+629574us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:49.678559 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.678648 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.125751 (+447103us) raft_consensus.cc:1685] finished
0709 13:00:50.125776 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.125946 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":22400,"thread_start_us":487198,"threads_started":1,"wal-append.queue_time_us":849245}
I20260709 13:00:50.111495  1751 raft_consensus.cc:2410] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:00:50.132645  1596 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:50.133988  8441 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:50.134851  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.135939  1596 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:50.135936  8547 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:50.137943  8407 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.139315  1752 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:50.137004  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:50.140992  1746 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 25.
W20260709 13:00:50.141855  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.064529  8490 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.014s	sys 0.017s
W20260709 13:00:50.064651  1750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.006s	sys 0.025s
W20260709 13:00:50.146695  1750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.006s	sys 0.025s
I20260709 13:00:50.148136  1603 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:50.080953  1673 rpcz_store.cc:276] 0709 13:00:48.761401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.340821 (+579420us) service_pool.cc:224] Handling call
0709 13:00:49.341234 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.341446 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:49.385249 (+ 43803us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.063318 (+678069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.063382 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:50.063431 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.063611 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.063737 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47801,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":50695,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":626786,"threads_started":1}
W20260709 13:00:50.158281  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.145991  8490 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.014s	sys 0.018s
I20260709 13:00:50.177953  1669 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
W20260709 13:00:50.173509  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.179003  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.179617  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:50.199625  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.168895  1599 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:00:50.201622  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.168881  1674 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:50.191735  1670 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:00:50.186527  1594 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
W20260709 13:00:50.180943  2316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.019s
I20260709 13:00:50.175068  8350 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:50.204726  2316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.009s	sys 0.020s
W20260709 13:00:50.180716  8581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.039s	sys 0.058s
I20260709 13:00:50.243750  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3048) took 1565 ms. Trace:
I20260709 13:00:50.247802  1743 rpcz_store.cc:276] 0709 13:00:48.678053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.370016 (+691963us) service_pool.cc:224] Handling call
0709 13:00:49.370340 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.381279 (+ 10939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.381338 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.382004 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.974272 (+592268us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:49.974337 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.974439 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.243490 (+269051us) raft_consensus.cc:1685] finished
0709 13:00:50.243511 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.243674 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":11315,"thread_start_us":574266,"threads_started":1,"wal-append.queue_time_us":838105}
I20260709 13:00:50.245873  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:50.258570  2309 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 10: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 13:00:50.286119  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.029s
W20260709 13:00:50.288403  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.029s
W20260709 13:00:50.288635  8593 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:00:50.298708  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.310400  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.033s	sys 0.015s
W20260709 13:00:50.311089  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.033s	sys 0.016s
W20260709 13:00:50.247706  8581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.045s	sys 0.058s
W20260709 13:00:50.311595  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 587455us
W20260709 13:00:50.314998  1748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.020s	sys 0.018s
W20260709 13:00:50.318776  1748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.021s	sys 0.018s
I20260709 13:00:50.323674  1748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3287) took 2207 ms. Trace:
W20260709 13:00:50.335251  2280 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.330235  1748 rpcz_store.cc:276] 0709 13:00:48.115934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.310611 (+1194677us) service_pool.cc:224] Handling call
0709 13:00:49.312995 (+  2384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.313252 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:49.737325 (+424073us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.323069 (+585744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.323163 (+    94us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:50.323234 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.323354 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.323581 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":996739,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":1598,"thread_start_us":975319,"threads_started":2}
I20260709 13:00:50.287977  8536 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:50.386065  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.394249  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.398729  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3054) took 1688 ms. Trace:
I20260709 13:00:50.399457  1744 rpcz_store.cc:276] 0709 13:00:48.710573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.445680 (+735107us) service_pool.cc:224] Handling call
0709 13:00:49.446231 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.452668 (+  6437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.452712 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.453441 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.923843 (+470402us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:49.923889 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.923980 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.398361 (+474381us) raft_consensus.cc:1685] finished
0709 13:00:50.398395 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.398613 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5352,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"thread_start_us":469892,"threads_started":1,"wal-append.queue_time_us":722657}
I20260709 13:00:50.404982  1676 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:00:50.416517  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.404654  8590 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:00:50.431775  8441 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.436282  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.464428  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.465078  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.437729  8350 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.441977  8524 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:50.444993  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3050) took 1757 ms. Trace:
I20260709 13:00:50.450117  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:50.453214  8536 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:50.477998  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.467828  1750 rpcz_store.cc:276] 0709 13:00:48.687208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.366846 (+679638us) service_pool.cc:224] Handling call
0709 13:00:49.392952 (+ 26106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.393464 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:49.393507 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.394127 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.147324 (+753197us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:50.147378 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.147466 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.444675 (+297209us) raft_consensus.cc:1685] finished
0709 13:00:50.444706 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.444905 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21281,"raft.queue_time_us":1640,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":677183,"threads_started":1,"wal-append.queue_time_us":925142}
W20260709 13:00:50.431777  8589 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:00:50.512724  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3053) took 1802 ms. Trace:
I20260709 13:00:50.484421  8428 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:50.513317  1745 rpcz_store.cc:276] 0709 13:00:48.710318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.374622 (+664304us) service_pool.cc:224] Handling call
0709 13:00:49.394140 (+ 19518us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:49.394540 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.394570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:49.395870 (+  1300us) log.cc:844] Serialized 52 byte log entry
0709 13:00:49.975172 (+579302us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:49.975244 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.975339 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.512442 (+537103us) raft_consensus.cc:1685] finished
0709 13:00:50.512467 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.512649 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22096,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":3310,"thread_start_us":578883,"threads_started":1,"wal-append.queue_time_us":805039}
W20260709 13:00:50.518563  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.520553  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 516642us
I20260709 13:00:50.473198  8485 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.488624  8562 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:00:50.481153  8441 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.556795  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3435) took 1263 ms. Trace:
I20260709 13:00:50.557499  1600 rpcz_store.cc:276] 0709 13:00:49.293109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.313250 (+ 20141us) service_pool.cc:224] Handling call
0709 13:00:49.313601 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.316155 (+  2554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.316191 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.336940 (+ 20749us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.603353 (+266413us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b1800465940. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:00:50.024039 (+420686us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:50.024085 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.024158 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.554748 (+530590us) raft_consensus.cc:1685] finished
0709 13:00:50.554783 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.556697 (+  1914us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2149,"raft.queue_time_us":2685,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":15652,"spinlock_wait_cycles":18293120,"thread_start_us":420464,"threads_started":1,"wal-append.queue_time_us":1123173}
W20260709 13:00:50.566798  1718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.029s	sys 0.031s
W20260709 13:00:50.568593  1718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.030s	sys 0.031s
W20260709 13:00:50.570834  1749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.023s	sys 0.029s
W20260709 13:00:50.574323  1749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.024s	sys 0.029s
W20260709 13:00:50.566438  8486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.020s	sys 0.040s
I20260709 13:00:50.576200  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1511) took 1329 ms. Trace:
W20260709 13:00:50.579385  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.028s
W20260709 13:00:50.575522  8486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.020s	sys 0.040s
W20260709 13:00:50.584697  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.578212  1749 rpcz_store.cc:276] 0709 13:00:49.247219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.601275 (+354056us) service_pool.cc:224] Handling call
0709 13:00:49.601570 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.601794 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:50.047143 (+445349us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.575792 (+528649us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.575853 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:50.575905 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.575994 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.576128 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":513,"prepare.queue_time_us":711945,"prepare.run_cpu_time_us":11913,"prepare.run_wall_time_us":67130,"thread_start_us":972522,"threads_started":2}
W20260709 13:00:50.585820  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.580848  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.008s	sys 0.028s
I20260709 13:00:50.591244  8524 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:50.606803  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:50.608038  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.001s	sys 0.009s
W20260709 13:00:50.605362  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.613830  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.002s	sys 0.009s
W20260709 13:00:50.611471  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.614235  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 638139us
I20260709 13:00:50.611104  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:50.611115  1749 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:50.612347  1677 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.006s
W20260709 13:00:50.616031  1677 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.004s	sys 0.007s
I20260709 13:00:50.608800  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:50.617964  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 377848us
W20260709 13:00:50.623680  8604 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 13:00:50.592612  8486 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:50.623219  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:50.605261  8427 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:50.621745  8600 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:50.620105  8485 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.634548  8524 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.635454  8524 consensus_queue.cc:1243] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:50.635979  8524 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:50.636322  8524 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:50.637221  8524 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.638706  8524 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:50.632006  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 159753us
W20260709 13:00:50.650982  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.652817  8547 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:50.655812  8610 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:00:50.657781  8485 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.658449  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:50.658985  8485 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:50.661620  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:50.662716  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:50.671952  8441 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.672683  2309 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:50.672921  8441 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:50.673410  8441 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:50.674263  8441 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.675835  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:50.678406  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3221) took 1028 ms. Trace:
I20260709 13:00:50.647943  8608 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:50.679620  8608 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.680213  8608 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:50.678915  1678 rpcz_store.cc:276] 0709 13:00:49.649821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.650162 (+   341us) service_pool.cc:224] Handling call
0709 13:00:49.650529 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.012540 (+362011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.012573 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.013106 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.587182 (+574076us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:50.587233 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.592393 (+  5160us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54002fba54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:50.592447 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.677930 (+ 85483us) raft_consensus.cc:1685] finished
0709 13:00:50.677961 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.678321 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831907584,"thread_start_us":518739,"threads_started":1,"wal-append.queue_time_us":598867}
I20260709 13:00:50.683732  8607 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:50.684989  8607 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:50.685319  8607 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:50.686231  8607 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.695330  8407 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:50.697180  8407 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:50.697573  8407 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:50.697880  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.699281  8596 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.149s	user 0.001s	sys 0.001s
I20260709 13:00:50.650360  8541 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:00:50.712194  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.698431  8407 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.720759  1744 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:00:50.633581  8536 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:00:50.702277  8607 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.740715  8610 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:50.741434  8610 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:50.772745  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63386.7us
W20260709 13:00:50.773626  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 150531us
I20260709 13:00:50.768260  8407 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:50.768555  8605 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.780346  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:50.776023  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:50.782999  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 156354us
I20260709 13:00:50.784055  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.788024  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3220) took 1153 ms. Trace:
I20260709 13:00:50.767977  8608 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:50.794260  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 145004us
I20260709 13:00:50.796084  2312 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:50.800048  8608 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:50.800758  8608 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.801302  8608 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:50.785530  8562 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:50.742617  8610 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.802110  8485 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:50.804242  1677 rpcz_store.cc:276] 0709 13:00:49.634160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.636257 (+  2097us) service_pool.cc:224] Handling call
0709 13:00:49.715686 (+ 79429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.992589 (+276903us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:50.616632 (+624043us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.781289 (+164657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.781345 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:50.781405 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.787770 (+  6365us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54003232d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:50.787823 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.787957 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":685456,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":10015,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":8099,"spinlock_wait_cycles":636216064,"thread_start_us":783435,"threads_started":2}
I20260709 13:00:50.812610  8541 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:50.814092  8608 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:50.814615  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.786029  8605 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.820953  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.822804  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:50.841137  1744 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.782891  8547 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:00:50.835575  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
W20260709 13:00:50.838892  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.779309  8486 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:50.830479  8490 raft_consensus.cc:2764] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:00:50.856400  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:50.832043  8541 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:50.844142  8618 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 13:00:50.867373  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 64793.9us
I20260709 13:00:50.844341  8631 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:00:50.844144  8622 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:50.856648  8610 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:50.870280  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.875702  8623 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.876492  8623 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:50.879686  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.866808  8536 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:50.865108  8541 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:50.881350  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.866470  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82536.2us
I20260709 13:00:50.867393  8490 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:50.890000  8623 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.895807  1744 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:00:50.896040  8605 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:50.887327  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.899601  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.915089  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.915097  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.866997  8626 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:50.884613  8536 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:50.924258  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.926545  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.928436  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.929581  8620 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:50.930197  8620 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.930608  8620 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:50.922612  8607 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:50.921854  8610 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:50.933813  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77548.9us
I20260709 13:00:50.937001  8524 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:50.924930  8605 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:50.939198  8605 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.939638  8605 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:50.931738  8627 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:00:50.940671  8627 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:50.941104  8627 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:50.933748  8608 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:50.942348  8608 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.942451  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.942770  8608 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:50.944555  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.922417  8626 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:50.951387  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.946642  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.925823  8475 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:50.952484  8626 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:50.955302  8475 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:50.964469  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.964761  8475 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.944741  8610 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:50.966192  8610 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:50.966289  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.967156  1675 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:50.956998  8627 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.956830  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:50.969002  1675 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:00:50.951423  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:50.971443  8632 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:50.971912  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.971767  8536 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:50.971951  8632 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.972522  1675 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:50.957278  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.973176  8536 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:50.973702  1669 raft_consensus.cc:2376] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28. Re-sending same reply.
W20260709 13:00:50.974417  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.975096  1675 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:00:50.952701  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:50.977662  8628 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:50.946082  8607 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.981491  8607 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:50.968959  8627 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:50.988935  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.989805  1675 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:00:50.990475  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.989977  1676 raft_consensus.cc:2410] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:00:50.992244  1669 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:00:51.015127  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.002526  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:50.993454  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.992974  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.992564  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:51.018009  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:51.018930  1674 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:00:51.021850  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.023846  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:51.024964  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.025168  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:51.025717  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.025812  1669 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:00:50.985944  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:51.031961  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48730.3us
I20260709 13:00:51.033248  1677 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:51.033380  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:51.034682  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:51.035346  1672 raft_consensus.cc:2376] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28. Re-sending same reply.
W20260709 13:00:51.035516  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.030661  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:51.039397  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:50.952908  8634 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:51.042757  8634 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.043223  8634 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:51.043376  1669 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:51.048107  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.047930  8350 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:51.049316  8350 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:51.049738  8350 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:51.050328  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.032791  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:51.054822  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:50.987102  8632 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:51.058662  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.050944  8605 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.051265  8350 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.060658  8350 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.060459  8623 consensus_queue.cc:1059] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:51.058471  8441 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:51.061321  8605 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.062074  8605 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:51.064913  1671 raft_consensus.cc:2368] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:51.065673  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.068693  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:51.069999  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:51.071746  8618 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:51.072284  8618 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:51.072553  8490 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:51.073074  8490 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:51.073491  8490 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:51.073251  8618 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.036415  8407 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:51.075317  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:51.076876  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:51.056171  8300 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:51.057580  8485 raft_consensus.cc:2764] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:00:51.086849  8640 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:51.088277  1673 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:00:51.088855  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:51.057435  8631 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:51.075793  8441 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.063562  8628 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:51.083001  8622 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:51.105010  8300 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:51.082778  8608 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.106956  8631 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.131333  8628 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.131367  8639 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:51.140064  8631 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.131625  8620 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.192750  8639 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:51.212551  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 226833us
W20260709 13:00:51.225793  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 175623us
I20260709 13:00:51.230578  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.215902  8618 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:51.262542  8639 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.268754  8634 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.272094  8608 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:51.272778  8620 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:51.285709  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.291461  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 202763us
I20260709 13:00:51.237993  8622 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:51.237123  8605 raft_consensus.cc:3055] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:51.212249  8300 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.292742  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:51.302837  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:51.295645  8536 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:00:51.307837  8485 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:00:51.297504  8637 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:00:51.274147  8634 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.309592  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.277864  8618 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:51.312563  8623 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.347488  8649 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:51.348019  8649 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.347945  8623 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.348474  8649 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:51.350391  8623 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.345609  8607 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.352535  8607 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.297885  8407 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:51.352041  8541 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:51.353981  8610 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.354877  8541 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:51.346462  8441 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:51.355993  8441 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:51.357455  8441 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:51.359500  1678 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:00:51.297420  8635 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:00:51.365371  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.297156  8630 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:51.366807  8596 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:51.358785  8608 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.379776  8486 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:51.382718  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 130) took 7280 ms. Trace:
W20260709 13:00:51.386405  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 76962.7us
I20260709 13:00:51.387265  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:51.319906  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:51.383167  1501 rpcz_store.cc:276] 0709 13:00:44.102059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.105936 (+  3877us) service_pool.cc:224] Handling call
0709 13:00:51.382632 (+7276696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:49.134253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:49.390586 (+256333us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:49.394431 (+  3845us) write_op.cc:435] Acquired schema lock
0709 13:00:49.415959 (+ 21528us) tablet.cc:662] Decoding operations
0709 13:00:49.438763 (+ 22804us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:49.438845 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:49.438877 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:49.439306 (+   429us) tablet.cc:701] Row locks acquired
0709 13:00:49.439326 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:49.439522 (+   196us) write_op.cc:270] Start()
0709 13:00:49.439676 (+   154us) write_op.cc:276] Timestamp: P: 1783602049439460 usec, L: 0
0709 13:00:49.439699 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:49.501142 (+ 61443us) log.cc:844] Serialized 1745 byte log entry
0709 13:00:50.799181 (+1298039us) op_driver.cc:464] REPLICATION: finished
0709 13:00:50.933283 (+134102us) write_op.cc:301] APPLY: starting
0709 13:00:50.945671 (+ 12388us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:50.978687 (+ 33016us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:50.978798 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:51.242007 (+263209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:51.266685 (+ 24678us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:00:51.266738 (+    53us) write_op.cc:312] APPLY: finished
0709 13:00:51.267042 (+   304us) log.cc:844] Serialized 49 byte log entry
0709 13:00:51.267241 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.267362 (+   121us) write_op.cc:454] Released schema lock
0709 13:00:51.267409 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:51.267932 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.267966 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2379088,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":125945,"apply.run_cpu_time_us":11106,"apply.run_wall_time_us":341367,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":148058,"prepare.run_cpu_time_us":110044,"prepare.run_wall_time_us":1247545,"raft.queue_time_us":98195,"raft.run_cpu_time_us":5918,"raft.run_wall_time_us":56792,"replication_time_us":1359248,"thread_start_us":1032971,"threads_started":4,"wal-append.queue_time_us":1027367}]]}
I20260709 13:00:51.299665  8626 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.406973  8626 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:51.399597  8651 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:51.412242  8651 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.413383  1500 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.317080  8632 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.418326  8632 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.372779  8647 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.403668  8622 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:51.423595  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 103855us
I20260709 13:00:51.431341  1500 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:51.403110  8610 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:51.446811  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:51.448083  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.449442  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.446787  1500 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 16, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 13:00:51.446943  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 132296us
I20260709 13:00:51.456087  1500 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 18 to 19, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.459367  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.452589  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:51.415323  8651 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.458894  1500 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:51.466005  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.467875  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.469203  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:51.446527  8635 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:51.309337  8605 raft_consensus.cc:740] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:51.397187  8640 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:51.445595  8632 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.482004  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:51.475327  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:51.375990  8618 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.420194  8647 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.472613  1500 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:51.665042   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.671577  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 13:00:51.594877  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.567845  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.674175  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 192428us
W20260709 13:00:51.483850  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.675166  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:51.502780  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:51.685015  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 182416us
W20260709 13:00:51.646397  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.461527  8536 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:51.465787  8475 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:51.460331  8634 raft_consensus.cc:2764] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:00:51.673323  1500 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 19 to 20, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:51.475153  8638 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:00:51.561915  8655 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:00:51.474891  8623 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:51.480150  8610 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:51.552138  8486 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:51.727051  1500 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 18 to 19, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:51.567622  8646 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.352s	user 0.000s	sys 0.004s
I20260709 13:00:51.683743  8608 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:51.532203  8485 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:51.466183  8407 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.260s
I20260709 13:00:51.700851  8628 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:51.742256  1500 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:51.694104  8536 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.483975  8644 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:51.502909  8490 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.646826  8654 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:00:51.682834  8632 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.570206  8649 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.740096  8610 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:51.735394  8623 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:51.626828  8631 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.763020  8536 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.749374  8634 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:51.582335  8605 consensus_queue.cc:260] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:00:51.776613  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90657us
I20260709 13:00:51.740345  8638 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:51.730885  8639 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 13:00:51.789898  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94603.9us
I20260709 13:00:51.783439  8623 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:51.783236  8610 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:51.797961  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:51.783232  8485 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:51.805728  8485 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:51.807104  8485 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.790545  8644 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:51.825692  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:51.803207  8634 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:51.821182  8608 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:51.775204  8640 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.799810  8669 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.795750  8628 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:51.835873  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:51.826156  8670 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:51.840009  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:51.834837  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 297056us
I20260709 13:00:51.800830  8627 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:51.843605  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:51.834379  8485 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:51.846920  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.840605  8475 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:51.852504  8475 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.852912  8475 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.853479  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:51.854486  8608 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:51.854934  8608 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.855329  8608 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:51.856251  8490 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.856930  8490 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:51.857259  8490 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:51.858199  8490 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.858455  8638 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.863802  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:51.692499  8441 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:51.847975  8639 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:51.845716  8654 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:51.836225  8661 consensus_queue.cc:1059] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:00:51.885771  8665 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.864679  8666 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.864707  8407 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:51.844909  8673 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:00:51.884907  8490 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:51.898125  8639 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.897346  8622 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.910120  8654 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:51.926771  8630 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:51.848551  8669 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.851111  8670 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.921640  8679 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:51.940395  8639 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.942597  8632 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.889014  8644 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.948879  8630 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:51.972218  8630 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.959124  8649 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.975067  8654 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:51.925704  8634 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.974301  8630 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.993037  8669 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:51.996938  8639 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:51.997414  8631 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:52.073980  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 220399us
W20260709 13:00:52.075148  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.077598  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.090619  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 226897us
I20260709 13:00:52.094363  1749 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:52.100296  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 200587us
I20260709 13:00:52.113642  8407 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.946731  8622 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.003263  8639 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.009388  8647 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.032255  8665 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.005365  8670 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:51.966312  8679 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:52.237797  8652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.011s	sys 0.024s
I20260709 13:00:52.238368  8524 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:52.248939  8486 raft_consensus.cc:3055] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:00:52.257119  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.272603  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.266139  8652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.011s	sys 0.025s
I20260709 13:00:52.268261  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:52.243111  8669 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.287166  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.360597  8691 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:00:52.360208  8669 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.364884  1669 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:52.365305  8694 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.288592  8541 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:52.265203  8667 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.309154  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.366266  8541 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:52.363214  8669 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.366871  8541 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.366796  8667 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:52.369936  8667 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.309486  8660 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.310590  8680 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:52.310585  8628 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:52.376194  8680 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.376713  8628 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.379190  8680 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.376202  8660 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.382705  8660 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:52.315625  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.021s
W20260709 13:00:52.383844  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.010s	sys 0.022s
W20260709 13:00:52.384511  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 909658us
I20260709 13:00:52.273368  8407 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:52.367107  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 116122us
I20260709 13:00:52.391566  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:52.392616  8694 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:52.322269  8679 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.393042  8694 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:52.332024  8671 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.332811  1748 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:52.393543  8694 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:52.393770  8622 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.255023  8524 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:52.394037  8671 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.315039  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:52.395463  8524 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:52.396831  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 82071.9us
I20260709 13:00:52.396994  8671 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:52.397495  8524 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:52.397987  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:52.355983  8684 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.358681  8673 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.365437  1669 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:52.291636  8627 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.400162  8627 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.400569  1669 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.401851  1669 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.379226  8628 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:52.402856  8627 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:52.387424  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:52.256480  8486 raft_consensus.cc:740] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:52.398543  8407 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.399367  8684 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.404374  8622 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:52.404759  8486 consensus_queue.cc:260] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.406069  8684 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.406487  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:52.399459  8673 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.406157  8486 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.327121  8605 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.425643  8634 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:52.426447  8634 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:52.429704  8475 consensus_meta.cc:287] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.016s
I20260709 13:00:52.430047  8696 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.430341  8475 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.431341  8696 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.433344  8475 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.434401  8693 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.435178  8693 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.438143  8693 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.437904  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.438843  8684 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:52.439493  8684 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:52.439363  1749 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:00:52.440923  8684 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.443464  8696 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:52.446439  1745 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:52.448632  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.448819  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.416282  8407 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.452939  1600 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:00:52.455790  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.456893  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.466099  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.467228  1601 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:00:52.482197  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90936.6us
I20260709 13:00:52.428109  8634 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.473462  8673 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:52.507795  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 101618us
I20260709 13:00:52.508191  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:52.510391  8697 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.510677  8622 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:00:52.512053  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.511677  8697 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.512210  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.514199  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.515152  1600 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:52.515468  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.516278  1599 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:52.517817  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:52.510462  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:52.520327  8640 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:52.520769  8640 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.521281  8640 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.514237  8697 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:52.524569  8656 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.525267  8656 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.544286  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:52.568629  8630 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.570s	user 0.017s	sys 0.002s
W20260709 13:00:52.569840  8485 consensus_meta.cc:287] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.012s
W20260709 13:00:52.570868  8490 consensus_meta.cc:287] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.640s	user 0.015s	sys 0.002s
I20260709 13:00:52.577083  1669 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:52.577554  1669 pending_rounds.cc:85] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 8
W20260709 13:00:52.580186  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 97238.6us
I20260709 13:00:52.583014  8656 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.584921  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.585300  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.585669  1745 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:52.586108  1749 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.581543  1669 pending_rounds.cc:107] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:52.591367  1669 raft_consensus.cc:2889] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.593611  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.594172  1752 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:00:52.594657  1750 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:52.599848  8608 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.717s	user 0.016s	sys 0.008s
I20260709 13:00:52.600512  8608 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.601795  1748 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:52.605064  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.607792  1745 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
W20260709 13:00:52.613897  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70916us
I20260709 13:00:52.615062  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:00:52.615664  8623 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.792s	user 0.018s	sys 0.000s
I20260709 13:00:52.616288  8623 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.617030  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:52.618059  8610 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.009s
I20260709 13:00:52.618803  8623 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.618577  8610 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.572827  8697 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.603020  8608 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.630159  8610 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:52.631847  8696 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:52.642266  8541 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.642436  8694 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.643909  8696 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:52.644748  1744 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:00:52.644847  8698 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:52.647720  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.649490  8536 consensus_meta.cc:287] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.854s	user 0.017s	sys 0.007s
W20260709 13:00:52.676828  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.677330  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.653120  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:52.656033  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.657104  8640 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.680550  8654 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.681214  8654 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.682086  8640 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.657872  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.682955  1745 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:52.658543  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:52.683461  8654 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.683954  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.684685  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:52.659570  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:52.659938  8702 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:52.661295  8300 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:52.668112  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:52.668886  8656 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:52.655269  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:52.649740  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.681083  8696 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.660614  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:52.687500  1749 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:52.682875  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.681267  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.693164  1746 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:52.694226  8697 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:52.694804  8427 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:52.672179  8623 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.704718  1751 raft_consensus.cc:1240] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
W20260709 13:00:52.706384  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51355.9us
I20260709 13:00:52.710052  1749 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:52.713101  1752 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
W20260709 13:00:52.714840  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6220372060000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:00:52.715364  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6193372060000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:00:52.715777  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3934372059999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:00:52.700644  8475 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:52.716130  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3358372060000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 13:00:52.716672  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.721786  1746 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:52.722606  8490 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:52.723697  8654 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.723374  8490 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.724520  8654 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.726500  8490 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.728726  8694 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.728863  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:52.691632  8536 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:52.729660  1748 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:52.730603  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:52.730805  1671 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:52.731474  1599 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:52.731935  8536 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.735742  8684 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.740404  1744 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:52.727262  8490 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:52.747581  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:52.751503  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0667372060000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:00:52.752204  1566 connection.cc:256] RPC call timeout handler was delayed by -1.05593720600001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
I20260709 13:00:52.753643  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:52.708266  8623 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.753290  8640 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.758177  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.757676  8640 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.736554  8684 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.727281  8654 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.766570  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.769681  8640 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.771927  8475 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:52.775877  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:52.776886  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.777439  8475 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.780373  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.781701  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:52.781874  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:52.782085  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:52.782572  1597 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:00:52.782960  1595 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:52.784484  1602 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:52.789180  8702 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:52.780440  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:52.791615  8541 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:52.759567  8490 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:52.795400  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:52.795857  8654 raft_consensus.cc:1064] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:00:52.796442  1743 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:52.802112  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.806044  2317 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:00:52.810319  1599 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 26.
W20260709 13:00:52.817052  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.753803  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:00:52.826815  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.827633  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47848.6us
W20260709 13:00:52.829326  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47585.4us
I20260709 13:00:52.843024  2317 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:52.844458  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.846519  1751 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:52.846664  1599 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:00:52.826273  8490 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.825815  8475 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:52.850900  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:52.835654  8623 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.840514  8684 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:52.866778  1601 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:52.870636  2314 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:52.875082  1597 raft_consensus.cc:2468] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:00:52.873430  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.878134  1748 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:52.882122  1599 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:52.886116  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.892158  8486 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.896343  2309 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 17. Ops: []
I20260709 13:00:52.876423  8490 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.928679  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.969462  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.970005  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:52.895844  8486 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:52.975276  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.916695  8694 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:52.977383  1601 raft_consensus.cc:1240] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 17. Ops: []
I20260709 13:00:52.976569  8670 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:52.959050  8536 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:53.001667  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 159514us
I20260709 13:00:52.982028  8656 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.000661  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:52.959510  8490 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:53.009256  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.010847  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.011583  1596 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:00:53.012259  8605 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:53.012984  8605 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.015168  8605 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.016108  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.016829  1597 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:52.991304  8634 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.018203  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:53.021513  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 170040us
I20260709 13:00:53.019194  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.035593  1599 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
W20260709 13:00:53.035708  8712 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:00:53.037591  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.069150  1596 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:53.070619  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.009459  8536 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.076337  1751 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:53.077116  1595 raft_consensus.cc:2410] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:00:53.069176  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.073688  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:53.084789  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.066109  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:53.095919  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.097286  1748 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:53.107645  8679 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.108458  8616 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:53.108937  8616 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.109997  8616 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.111243  8616 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:53.127945  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 108050us
I20260709 13:00:53.111591  1597 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:00:53.108423  8679 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.130018  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.130577  8679 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.132869  8679 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:53.134953  8536 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:53.135164  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 97026.3us
I20260709 13:00:53.037047  8634 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.128216  8300 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:53.136478  8300 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.137614  8634 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.138010  8475 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:53.140151  8654 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.042691  8656 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.143376  8603 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:53.144258  8603 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.145757  8656 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:53.146962  8486 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.137684  8300 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.148521  8490 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.148428  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:53.145810  8603 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.171033  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:53.171841  1751 raft_consensus.cc:3060] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:53.172098  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.173467  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.173768  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.174469  1745 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:53.087203  1743 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:53.176234  1746 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:53.170889  8670 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:00:53.176702  8710 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
I20260709 13:00:53.177341  8670 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.177866  8670 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.178408  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.172130  8603 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:53.180581  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.184020  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:53.184815  1748 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:53.186473  1751 raft_consensus.cc:2468] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 26.
I20260709 13:00:53.176738  1743 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:53.188621  1744 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:53.196035  8300 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.188562  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:53.196738  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.197494  1743 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:00:53.201687  1743 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:53.190294  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.175426  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:53.191831  1746 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:53.192215  8711 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:53.203318  1745 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:00:53.193367  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.204370  8711 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:53.204967  8711 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.206314  8711 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.174640  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.208340  1752 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:53.209920  8711 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:53.211835  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 80339.4us
I20260709 13:00:53.212165  1743 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.212811  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:53.213646  8541 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:53.214038  8541 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:53.214501  8541 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:53.211324  1752 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:53.219324  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.221012  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.188869  8670 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.227471  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:53.229899  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.230413  8702 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:53.230851  8702 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.231225  8702 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:53.231735  8427 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:53.232052  8652 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:53.233009  8427 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:53.233415  8652 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:53.233954  8652 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.234932  8652 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.235838  8610 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:53.236884  8652 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:53.233402  8427 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.240492  8427 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.241856  8427 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:53.247707  8670 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.248494  8670 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.248620  8702 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:53.251143  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.265852  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.272830  8623 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:53.317705  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86320.5us
I20260709 13:00:53.269850  8654 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:00:53.320977  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.339637  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.341903  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:53.342794  8627 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:53.343819  8627 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:53.345743  8627 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:53.346313  8627 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:53.360463  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.365229  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48818.8us
I20260709 13:00:53.332342  8623 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:53.375042  1748 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
W20260709 13:00:53.375234  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 326808us
W20260709 13:00:53.382423  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.321192  8640 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:00:53.386623  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.013s	sys 0.014s
I20260709 13:00:53.390707  1673 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:00:53.391898  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.014s	sys 0.014s
W20260709 13:00:53.404657  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.406548  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 103376us
W20260709 13:00:53.411072  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.405658  1750 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.004s	sys 0.027s
W20260709 13:00:53.413908  1750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.004s	sys 0.027s
I20260709 13:00:53.401705  8485 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.347529  8627 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.383307  8679 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:00:53.420655  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.420708  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.422484  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:53.423444  1748 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:00:53.426591  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.427977  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.428798  1672 raft_consensus.cc:2368] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:53.432160  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.433239  1677 raft_consensus.cc:2393] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 18: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:53.397388  8640 consensus_queue.cc:1243] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:00:53.396764  8541 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.426636  8726 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.416618  8670 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.384495  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69370730433544db93e2c777aba2b9b2"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:53.447402  1752 raft_consensus.cc:606] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.447888  1752 raft_consensus.cc:614] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.422760  8702 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.451937  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:53.453049  1748 raft_consensus.cc:2468] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:00:53.454397  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.454771  2279 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:53.421950  8485 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.468421  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.469673  1670 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:00:53.473683  8485 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.479069  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.479882  1670 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:00:53.461403  8427 raft_consensus.cc:2804] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:53.483386  8427 raft_consensus.cc:697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.484133  8541 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:53.484512  8427 consensus_queue.cc:237] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.460517  8670 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:53.488333  1677 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:00:53.478843  8490 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:53.443990  8623 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.448675  8726 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.491914  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:53.494299  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.495412  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
W20260709 13:00:53.495895  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44105.4us
I20260709 13:00:53.496132  1752 raft_consensus.cc:606] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.496683  1752 raft_consensus.cc:614] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.497705  2312 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:53.489732  8490 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:53.505002  8490 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.506640  8490 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:53.507954  1676 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:00:53.524209  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.532752  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.534554  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.535465  1671 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:53.530275  8702 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.544248  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.545300  8726 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.544299  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.550139  1670 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:53.561149  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:53.566111  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:53.571190  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.566383  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:53.571839  1752 raft_consensus.cc:606] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.572229  1752 raft_consensus.cc:614] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.573251  8670 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:53.566777  8702 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.576342  8702 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.577309  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.567178  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.578585  1672 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:53.568121  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.579766  1674 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
W20260709 13:00:53.569770  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.581822  8726 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:53.581944  8623 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.582283  8726 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:53.582731  8726 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:53.582530  8623 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.584980  8623 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.585629  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.585834  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.586807  1749 raft_consensus.cc:2410] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:53.577653  1678 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:53.569118  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.588234  1675 raft_consensus.cc:2393] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 26: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:53.588478  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.589103  1678 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:53.589017  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.589915  1675 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:53.590725  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.591995  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.592509  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:53.592840  1670 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:53.593981  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.592509  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.567660  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:53.596956  1674 raft_consensus.cc:2410] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:53.594802  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:53.601027  1670 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:53.601848  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.605801  1671 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:53.604955  8623 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:53.608713  1749 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:53.621357  1674 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:53.621711  8623 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:53.622227  8623 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:53.622850  1669 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:53.607893  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 16 to 18, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:00:53.610620  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:53.610663  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.611279  8485 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:53.611603  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
I20260709 13:00:53.612332  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:53.613101  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.627344  1752 raft_consensus.cc:606] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.630151  1752 raft_consensus.cc:614] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.623508  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.639876  2312 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:53.641012  1675 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:00:53.624866  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.652057  1677 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:53.661696  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.663904  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.667841  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:53.669611  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:53.669656  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.670460  8541 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:53.670843  8541 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.671159  8541 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.672195  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.674369  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:53.675990  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 113087us
I20260709 13:00:53.683413  8694 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:53.683895  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:53.684190  8694 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:53.685272  8694 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.687503  1669 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:00:53.687340  8610 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:53.688050  8475 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.688726  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.689390  1669 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:53.648277  8711 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:53.690891  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.693490  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.690145  1674 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:53.652156  8622 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.696964  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 20 to 21, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 21 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.699846  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.653362  8300 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:00:53.707948  1641 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:53.707338  2312 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:00:53.706959  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.709509  1501 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.714300  2316 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:00:53.716368  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.713495  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:53.719372  2314 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:00:53.720510  1678 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:53.720605  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:53.718743  1501 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 8 to 10, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.731107  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:53.735818  8622 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:53.735666  2317 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:00:53.736701  8622 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:53.737890  8622 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.742314  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:53.721285  8427 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:53.743877  8670 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:53.744431  1566 leader_election.cc:400] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:53.744602  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.749470  1752 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:00:53.750655  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.753584  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.756994  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.764211  2309 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
W20260709 13:00:53.769975  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45465.7us
I20260709 13:00:53.772066  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.724274  8627 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:53.723454  8726 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.776497  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.773671  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.724224  8486 raft_consensus.cc:2804] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:53.744318  8427 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:53.780581  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.781191  2317 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:53.775154  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.783414  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.777081  1675 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:53.776580  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:53.778998  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.785745  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.786515  2309 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:53.775179  1677 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:53.723778  8541 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.779742  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:53.787604  8536 raft_consensus.cc:2764] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:00:53.811816  1673 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:53.811816  1677 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:00:53.805513  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:53.815279  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.807126  2309 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:00:53.815002  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:53.817718  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:53.826241  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.826462  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.828646  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:53.827112  1752 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:53.833523  2316 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:53.808465  8726 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:53.816277  8486 raft_consensus.cc:697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:53.820168  8475 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:53.843214  2317 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:00:53.844211  8427 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.854866  8427 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:53.830541  8627 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:53.825093  8741 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:00:53.859310  8610 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:53.845055  1750 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:53.856743  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.859951  8610 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:53.857136  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.857609  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.861310  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.861011  8610 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:53.861967  1598 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:53.848500  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 194) took 9714 ms. Trace:
I20260709 13:00:53.864785  1599 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:53.865806  1594 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:00:53.866241  1594 pending_rounds.cc:85] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 12
I20260709 13:00:53.866569  1594 pending_rounds.cc:107] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:00:53.866923  1594 raft_consensus.cc:2889] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:53.870172  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.871713  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90369.8us
W20260709 13:00:53.880118  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.881767  8541 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:53.882087  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.884145  1595 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:53.885696  8623 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.887049  1670 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:53.889231  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.890808  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.892376  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.892191  8486 consensus_queue.cc:237] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:53.892510  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.893199  1599 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:00:53.894457  1599 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:00:53.894652  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.898106  1600 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:53.860102  8741 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:53.899245  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:53.902041  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.905570  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:53.904284  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.908726  1603 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:53.910931  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:53.912153  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:53.913285  1599 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:53.920079  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:53.916949  1594 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:00:53.921321  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:53.911453  8726 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:53.920591  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 102987us
I20260709 13:00:53.910981  8741 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:53.929759  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.930231  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.939438  1673 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:53.930716  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.935475  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.947970  1599 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:53.911248  8739 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:00:53.952255  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:53.955796  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:53.956720  1673 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.919461  8485 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:53.960345  1603 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:53.968811  1675 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:53.928196  8726 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.974234  1599 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:53.925196  8475 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:53.980779  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:53.981550  2316 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:53.985471  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.959159  8742 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:53.862743  1500 rpcz_store.cc:276] 0709 13:00:44.151588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.157910 (+  6322us) service_pool.cc:224] Handling call
0709 13:00:53.848204 (+9690294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:51.969025 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:52.013234 (+ 44209us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:52.013301 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:00:52.013331 (+    30us) tablet.cc:662] Decoding operations
0709 13:00:52.014722 (+  1391us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:52.014809 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:52.014851 (+    42us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:00:52.024517 (+  9666us) tablet.cc:701] Row locks acquired
0709 13:00:52.024551 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:00:52.024797 (+   246us) write_op.cc:270] Start()
0709 13:00:52.024970 (+   173us) write_op.cc:276] Timestamp: P: 1783602052024716 usec, L: 0
0709 13:00:52.024999 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:52.026015 (+  1016us) log.cc:844] Serialized 4034 byte log entry
0709 13:00:52.539052 (+513037us) op_driver.cc:464] REPLICATION: finished
0709 13:00:52.994294 (+455242us) write_op.cc:301] APPLY: starting
0709 13:00:53.019282 (+ 24988us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:53.142450 (+123168us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:53.142627 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:53.430547 (+287920us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:53.430936 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:00:53.430993 (+    57us) write_op.cc:312] APPLY: finished
0709 13:00:53.436026 (+  5033us) log.cc:844] Serialized 97 byte log entry
0709 13:00:53.448935 (+ 12909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.536332 (+ 87397us) write_op.cc:454] Released schema lock
0709 13:00:53.541262 (+  4930us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:53.568540 (+ 27278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.568586 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":378446,"apply.run_cpu_time_us":23110,"apply.run_wall_time_us":587512,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":149129,"prepare.run_cpu_time_us":6186,"prepare.run_wall_time_us":73437,"replication_time_us":512818,"thread_start_us":202057,"threads_started":2}]]}
I20260709 13:00:53.977267  8726 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.993921  8742 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.987921  8623 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:54.044916  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.016012  8739 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:54.046265  8735 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 13:00:54.047961  8734 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.220s	user 0.002s	sys 0.000s
I20260709 13:00:54.057679  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.013216  8654 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:00:53.972426  8627 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.059942  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.025285  8694 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:00:54.046663  8742 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:54.023576  8640 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:00:54.069265  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:54.072199  2279 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:54.058964  8605 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:54.060371  8750 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.068876  8541 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:54.075326  8694 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:54.065936  8485 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:54.064194  8745 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:54.076406  8670 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:54.086966  8541 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:54.114158  8541 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:54.114558  8670 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:54.083339  8711 raft_consensus.cc:2804] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:54.078325  8605 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:54.082868  8640 consensus_queue.cc:1243] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:54.031499  8744 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:00:54.070367  8721 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:00:54.136972  8721 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.137544  8721 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:54.138880  8541 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.143587  8541 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:54.146124  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 78491.6us
I20260709 13:00:54.088030  8694 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:54.065951  8475 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.103962  8745 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.057255  8741 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.183743  8740 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:54.188393  8747 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:00:54.088284  8750 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.144891  8541 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:54.156688  8711 raft_consensus.cc:697] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:00:54.192471  8743 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:00:54.193549  8745 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:54.234407  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 313348us
I20260709 13:00:54.229423  1675 raft_consensus.cc:3055] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:54.235065  1675 raft_consensus.cc:740] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:54.226539  8603 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.252089  1749 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:00:54.258208  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 150146us
I20260709 13:00:54.260107  1673 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:00:54.240399  1675 consensus_queue.cc:260] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.262423  1675 raft_consensus.cc:3060] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:54.272019  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.271667  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.248654  8536 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.289851  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.313510  2316 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
W20260709 13:00:54.320130  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.236244  8541 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.216454  8485 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.283730  8760 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:00:54.335156  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.335902  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 100658us
W20260709 13:00:54.335289  8757 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 13:00:54.234301  8721 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.342710  8751 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:54.270328  8603 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:54.348595  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 251333us
I20260709 13:00:54.350646  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.250106  8605 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.305265  8536 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.332193  8768 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:00:54.357015  8746 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.290s	user 0.000s	sys 0.002s
I20260709 13:00:54.311506  8694 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.364574  8711 consensus_queue.cc:237] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.376049  8603 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:54.376848  8761 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:54.362377  8740 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:00:54.382537  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.384675  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.390607  8740 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:54.391783  8622 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:54.392278  8622 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:54.393361  8622 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.393994  8740 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:54.394531  8622 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:54.375381  8750 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:54.358959  8770 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:00:54.412179  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 57949.9us
I20260709 13:00:54.413959  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.431905  1675 raft_consensus.cc:1275] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:00:54.432698  1675 pending_rounds.cc:85] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 15
I20260709 13:00:54.436088  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:54.436192  8777 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:54.436908  1675 pending_rounds.cc:107] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:00:54.437615  1675 raft_consensus.cc:2889] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:54.437852  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 121129us
W20260709 13:00:54.439944  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 89416.1us
I20260709 13:00:54.437153  8777 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.334935  8760 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.459479  8760 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:54.461285  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.441504  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 123885us
I20260709 13:00:54.437318  8751 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:54.445286  8775 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:54.442644  8770 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:54.447402  8777 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:54.422384  8768 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:54.453459  8541 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:54.467821  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.456400  8774 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:00:54.479293  1675 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:00:54.438655  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.441184  8750 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:54.479562  8763 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:54.485474  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.484928  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:54.489917  8773 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:54.486101  8740 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:00:54.522269  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 83756.6us
I20260709 13:00:54.487789  8751 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:54.523228  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:54.495894  8603 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:54.481544  8760 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:00:54.515776  8773 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:54.532680  8754 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:54.500330  8652 consensus_queue.cc:1048] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:00:54.505995  8541 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:00:54.526467  8603 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:54.546113  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60723.9us
W20260709 13:00:54.536074  8427 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.013s
I20260709 13:00:54.530851  8485 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:54.543596  8726 consensus_meta.cc:287] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.006s
W20260709 13:00:54.547816  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58754us
I20260709 13:00:54.533479  8773 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:54.566340  8603 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:54.589715  8760 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:00:54.592440  8742 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 13:00:54.592981  8742 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.565403  8780 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:54.569617  8485 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.530602  8740 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.575642  8427 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.599619  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.576031  8536 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:54.533269  8768 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.595474  8742 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:54.627962  8773 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.629539  8773 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:54.574508  8726 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.637602  8726 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:54.639531  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.611449  8776 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.571627  8770 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.645076  8490 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:54.645740  8490 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:54.587479  8654 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:54.601776  8485 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:54.649547  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:54.603477  8751 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.651760  8742 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:54.652215  8754 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:54.652716  8721 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.642951  8776 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.654079  8754 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:54.607018  8427 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:54.652248  8742 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.655391  8776 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:54.655452  8742 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:54.600183  8780 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.656288  8427 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:54.656383  8780 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:54.654503  8754 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:54.661203  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.662024  1675 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:54.660430  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.665252  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:54.646927  8490 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:54.685833  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 86425.6us
I20260709 13:00:54.692634  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:54.699494  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48007.1us
I20260709 13:00:54.677847  8541 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:54.706687  2317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
mode: GRACEFUL
new_leader_uuid: "1a40ab12c220464db732562e88c32c11"
 from {username='slave'} at 127.0.0.1:52868
I20260709 13:00:54.682410  8702 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:54.709250  2317 raft_consensus.cc:606] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1a40ab12c220464db732562e88c32c11
I20260709 13:00:54.731107  2317 raft_consensus.cc:614] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:54.731369  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 147758us
I20260709 13:00:54.706388  8490 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:54.722704  8740 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:54.682895  8783 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:54.733333  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.739470  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:54.741945  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.686079  8623 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:54.719123  8670 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:54.753436  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.731767  8300 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.730969  8702 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.727977  8754 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.736856  8767 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:00:54.750736  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:54.728075  8541 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.763039  8300 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:54.792371  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.785213   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:00:54.804335  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 111917us
I20260709 13:00:54.769344  8702 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.802672  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 13:00:54.801817  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51198.8us
I20260709 13:00:54.770031  8750 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:54.752173  8777 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.822072  8777 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:54.812019  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.823191  8777 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:54.824108  8782 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.185s	user 0.004s	sys 0.001s
I20260709 13:00:54.824749  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.825651  8777 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.826202  8784 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:54.815621   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:54.791674  8536 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:54.827494  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:54.833184  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.841100  8622 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:54.766402  8475 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:00:54.841806  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:54.796146  8742 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.883351  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.884177  2317 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:54.885303  2313 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:54.885569  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.885828  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.832947  8623 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:54.892618  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.839762  8754 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:54.894781  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.895807  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.844048  8784 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:54.899269  1673 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:00:54.899974  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.900920  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.901669  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.905972  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:54.905987  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:54.906555  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:54.906880  2317 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 8.
I20260709 13:00:54.907155  1678 raft_consensus.cc:3060] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:54.906193  1670 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:00:54.910753  2313 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:00:54.911862  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.913288  1677 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:00:54.915453  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.918107  1677 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 28.
I20260709 13:00:54.916648  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:54.920966  1743 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:54.908233  1670 pending_rounds.cc:85] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 9
I20260709 13:00:54.924693  1670 pending_rounds.cc:107] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:00:54.925046  1670 raft_consensus.cc:2889] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.928586  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:54.903781  8623 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:54.942799  8740 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.943579  8740 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:54.944906  8797 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:00:54.946400  8740 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:54.919314  8775 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.929579  8745 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.667s	user 0.017s	sys 0.000s
I20260709 13:00:54.950917  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:54.926304  8654 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:54.969286  1678 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:54.977716  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:54.978734  1598 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:00:54.979859  8796 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.003134  1672 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
W20260709 13:00:54.962261  8790 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:00:55.007709  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0409237799999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:00:55.008126  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0391237800000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:00:55.012609  1566 connection.cc:256] RPC call timeout handler was delayed by -1.004923779999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:00:55.018326  1566 leader_election.cc:400] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:00:55.002823  8783 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.988449  8654 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:54.968178  8745 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:54.969457  8775 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:55.023931  8541 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.025840  8794 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
W20260709 13:00:55.044724  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.052878  1748 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:55.137108  8654 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.137179  8679 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:55.027676  8603 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.141034  8679 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:55.150332  8773 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.520s	user 0.014s	sys 0.000s
I20260709 13:00:55.164637  8536 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.165323  8536 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:55.181725  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 263174us
I20260709 13:00:55.184926  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:55.185763  1671 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:55.024518  8485 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:55.192605  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 178985us
I20260709 13:00:55.193626  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:55.050608  8751 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:55.197515  8750 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.024318  8795 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.256s
I20260709 13:00:55.143501  8679 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.208365  8806 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:55.204056  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:55.212343  2313 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:55.035985  8623 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.205061  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2942) took 1317 ms. Trace:
I20260709 13:00:55.213153  8803 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.213754  8803 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:55.213449  1595 rpcz_store.cc:276] 0709 13:00:53.887869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.899289 (+ 11420us) service_pool.cc:224] Handling call
0709 13:00:53.910769 (+ 11480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.915414 (+  4645us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:54.019230 (+103816us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.593938 (+574708us) spinlock_profiling.cc:243] Waited 943 us on lock 0x7b180026a8e0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d23a 00007f9481497a2a
0709 13:00:54.729392 (+135454us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.730106 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.730282 (+   176us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:54.730624 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.732799 (+  2175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.732914 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.204772 (+471858us) raft_consensus.cc:1685] finished
0709 13:00:55.204801 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.204964 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4218,"prepare.queue_time_us":152742,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":5229,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":5528,"spinlock_wait_cycles":2168576,"thread_start_us":232181,"threads_started":2,"wal-append.queue_time_us":727588}
I20260709 13:00:55.007505  8784 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.216322  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:55.216327  1678 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 6. (term mismatch)
I20260709 13:00:55.191960  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:55.217332  1678 pending_rounds.cc:85] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 5
I20260709 13:00:55.216398  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.217654  1678 pending_rounds.cc:107] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 13:00:55.217983  1678 raft_consensus.cc:2889] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.218046  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.033705  8783 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:00:55.167009  8792 log.cc:927] Time spent T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:55.211947  8751 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:55.168606  8742 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.204967  8745 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.225445  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.143740  8603 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.220472  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:55.225773  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.227823  8640 raft_consensus.cc:1064] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:00:55.233173  8783 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.234560  8640 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.243481  8775 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.228638  8541 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.244724  8541 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.245117  8541 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.235591  8485 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.251247  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:55.252327  1674 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:55.236048  8802 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.198233  8750 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.236685  1675 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:55.237382  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.237797  8796 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:55.238163  8768 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:55.196206  8773 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:00:55.238874  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.548s (SENT) [suppressed 31 similar messages]
I20260709 13:00:55.262295  8773 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.263299  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.239918  8777 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:55.240104  2313 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:00:55.241209  8807 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:00:55.241820  8780 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
W20260709 13:00:55.242321  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48883.1us
I20260709 13:00:55.242724  8490 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:55.242779  8805 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.247419  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.212350  8721 consensus_meta.cc:287] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.005s
I20260709 13:00:55.149394  8670 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.256938  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.258620  1678 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:55.196563  8622 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:55.221553  8767 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.266691  8773 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.278106  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.294248  1670 raft_consensus.cc:2410] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:00:55.299979  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.301066  8490 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:55.301508  8490 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:55.301903  8490 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:55.302176  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.303131  8777 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:55.306078  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.307052  8777 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:55.307951  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.308486  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.308902  1678 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:55.309366  8777 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:55.309762  8777 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:55.309928  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:55.310170  8777 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:55.312469  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.314034  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.322252  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.296917  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.327698  1673 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:00:55.311288  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:55.330250  1674 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:00:55.331683  1671 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 20.
I20260709 13:00:55.295675  8670 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.334885  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.340862  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.342761  1671 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:55.295080  8767 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.308815  8803 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.287573  8805 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.265628  8802 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.354206  1671 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:55.296278  8536 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:55.349376  8741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.007s	sys 0.025s
I20260709 13:00:55.330950  8622 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:55.330878  8796 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:00:55.317456  8702 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.277530  8780 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:55.351845  8788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.011s	sys 0.013s
I20260709 13:00:55.350431  8783 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:55.372141  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.372902  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 134132us
I20260709 13:00:55.383492  1677 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:55.362988  8679 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:55.393008  1595 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:55.365789  8741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.007s	sys 0.026s
I20260709 13:00:55.391438  8751 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.393049  8670 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.395401  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.397349  8802 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.398747  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.416682  1597 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:55.400851  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:55.411399  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:55.415601  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 74867.1us
W20260709 13:00:55.386046  8788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.012s	sys 0.014s
I20260709 13:00:55.370051  8796 consensus_queue.cc:1243] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:00:55.422514  1600 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:55.422250  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.466632  1602 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:55.419355  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.463323  1672 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:55.464701  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 64032.7us
W20260709 13:00:55.403606  8798 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.562s	user 0.008s	sys 0.005s
I20260709 13:00:55.398124  8679 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.398034  8610 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:55.470161  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:55.476343  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 281877us
I20260709 13:00:55.481499  1603 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 13:00:55.404091  8795 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.421481  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.478330  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:55.393013  8780 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.489677  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.490464  1597 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:55.480482  8679 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:55.489511  8795 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:55.496778  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 77580.8us
I20260709 13:00:55.498018  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.498805  8795 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.498965  8783 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:55.500149  8766 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:55.500982  8766 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:55.501760  8777 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.502298  1677 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:00:55.502688  1677 pending_rounds.cc:85] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 9
I20260709 13:00:55.502928  1677 pending_rounds.cc:107] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:00:55.503167  1677 raft_consensus.cc:2889] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.471634  8775 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:55.505404  8786 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:55.506112  8786 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:55.487284  8804 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.508596  8804 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.490085  8774 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:55.521672  1599 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:55.511466  8777 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.529044  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:55.466140  8751 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:00:55.541240  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.541370  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:55.542351  1603 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:55.543432  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:55.544332  1597 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:55.560981  1751 raft_consensus.cc:1240] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:55.561859  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:55.566644  1677 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:55.570406  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:55.492871  8490 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.486766  8610 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:55.557443  8670 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:55.561589  8775 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:00:55.644856  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74595.8us
I20260709 13:00:55.562690  8640 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:55.659188  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83664us
I20260709 13:00:55.574291  8804 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.507371  8786 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.502406  8766 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.515118  8774 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:55.715984  1598 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 24: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:55.680830  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:00:55.677379  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 153727us
I20260709 13:00:55.641678  8745 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:00:55.732797  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 72547.5us
I20260709 13:00:55.737635  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:55.575495  8796 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:55.740088  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:55.744014  1597 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:55.644377  8721 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.579036  8750 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:55.663630  8781 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:55.574846  8768 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.168s
I20260709 13:00:55.757143  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:00:55.746657  8782 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:00:55.734036  8640 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:55.741709  8812 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.742735  8796 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.776394  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.752871  8795 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:55.764251  8702 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:55.972908  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:55.758814  8781 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:55.752214  8670 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:00:55.776162  8640 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:55.989723  8770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.032s	sys 0.096s
I20260709 13:00:55.771744  8745 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.008463  8745 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.012228  8745 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.013239  8745 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:55.776022  8796 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:56.019941  8823 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:00:56.021523  8826 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:56.021603  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.022749  1597 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:56.024497  1674 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:56.026371  1674 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:56.029001  8830 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260709 13:00:56.031293  8817 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.302s	user 0.000s	sys 0.000s
I20260709 13:00:56.032157  1603 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:55.759505  8721 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.072471  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:00:56.014211  8770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.368s	user 0.033s	sys 0.096s
I20260709 13:00:55.771214  8775 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.226s
I20260709 13:00:56.096009  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.097085  1597 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:56.097561  8541 consensus_meta.cc:287] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.852s	user 0.012s	sys 0.003s
I20260709 13:00:56.098268  8541 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:56.104689  8827 log.cc:927] Time spent T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:55.993543  8777 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.035074  8754 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 1.131s	user 0.008s	sys 0.007s
I20260709 13:00:56.086476  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:56.086766  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.115672  1603 raft_consensus.cc:2393] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:00:56.016940  8795 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:56.123477  1597 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:56.045256  8702 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.992565  8805 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:56.133632  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.792038  8812 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:56.134258  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.135514  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.045080  8788 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:56.169787  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.169945  1603 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
W20260709 13:00:56.184286  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.184500  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.185366  1597 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:56.186605  8770 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.186691  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:56.192390  8824 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.417s	user 0.000s	sys 0.001s
I20260709 13:00:56.187021  8840 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.212198  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.205163  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.214283  1603 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:56.222177  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3280) took 1303 ms. Trace:
I20260709 13:00:56.226037  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.226328  8490 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.226962  8610 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:56.227808  1597 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:00:56.187415  8770 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.229358  1597 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:56.229992  8770 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:56.236925  8828 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:56.237475  8652 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.238350  8652 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.195461  8805 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.244345  1594 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:56.243449  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 975) took 1316 ms. Trace:
I20260709 13:00:56.222926  1676 rpcz_store.cc:276] 0709 13:00:54.912872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.913026 (+   154us) service_pool.cc:224] Handling call
0709 13:00:54.928622 (+ 15596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:54.929945 (+  1323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.929972 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:54.955121 (+ 25149us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.421313 (+466192us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b18001f98a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:00:55.546978 (+125665us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:55.547042 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.547139 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.139531 (+592392us) raft_consensus.cc:1685] finished
0709 13:00:56.139580 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.216347 (+ 76767us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25505,"raft.queue_time_us":4191,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":15306,"spinlock_wait_cycles":8947712,"thread_start_us":125350,"threads_started":1,"wal-append.queue_time_us":805355}
I20260709 13:00:56.252868  1596 rpcz_store.cc:276] 0709 13:00:54.927047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.927183 (+   136us) service_pool.cc:224] Handling call
0709 13:00:56.240123 (+1312940us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54003b4554. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:56.243339 (+  3216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877573376}
W20260709 13:00:56.231382  8832 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:00:56.130442  8777 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.265774  8721 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.267457  8541 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.179224  8702 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.269948  8702 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.271680  8652 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.273389  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3285) took 1048 ms. Trace:
I20260709 13:00:56.272624  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3284) took 1048 ms. Trace:
W20260709 13:00:56.281669  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 601236us
I20260709 13:00:56.131942  8781 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.274019  1673 rpcz_store.cc:276] 0709 13:00:55.224760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.339556 (+114796us) service_pool.cc:224] Handling call
0709 13:00:55.340021 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.340357 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:55.389625 (+ 49268us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.521673 (+132048us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.020963 (+499290us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b1800337600. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:00:56.267068 (+246105us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b1800337600. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 13:00:56.267316 (+   248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.267394 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:56.267480 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.273137 (+  5657us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.273310 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":729671,"prepare.queue_time_us":166558,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":749182,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":7154,"spinlock_wait_cycles":23592192,"thread_start_us":156992,"threads_started":2,"wal-append.queue_time_us":353297}
I20260709 13:00:56.288899  8536 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:56.280798  8760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.011s	sys 0.027s
W20260709 13:00:56.289489  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.212340  8788 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.292620  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3111) took 1078 ms. Trace:
I20260709 13:00:56.293792  8802 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.310895  8802 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.222204  8840 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:56.306491  8760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.028s
I20260709 13:00:56.293864  8623 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.275702  1670 rpcz_store.cc:276] 0709 13:00:55.224297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.314859 (+ 90562us) service_pool.cc:224] Handling call
0709 13:00:55.315170 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.315400 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:55.389187 (+ 73787us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.272014 (+882827us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.272202 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.272275 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.272340 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.272422 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.272558 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":727207,"prepare.queue_time_us":154846,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":728099,"thread_start_us":204605,"threads_started":2,"wal-append.queue_time_us":191399}
I20260709 13:00:56.291923  8751 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.308168  1672 rpcz_store.cc:276] 0709 13:00:55.213965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.215632 (+  1667us) service_pool.cc:224] Handling call
0709 13:00:55.215992 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.467885 (+251893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.292308 (+824423us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003e62d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:56.292544 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568545280}
I20260709 13:00:56.257145  8805 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.318794  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3125) took 1013 ms. Trace:
I20260709 13:00:56.300801  8536 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:56.319927  1671 rpcz_store.cc:276] 0709 13:00:55.305758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.384178 (+ 78420us) service_pool.cc:224] Handling call
0709 13:00:55.384754 (+   576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.400417 (+ 15663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.400464 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.401180 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.648018 (+246838us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:55.663039 (+ 15021us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.318372 (+655333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.318477 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.318524 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:56.318538 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.318694 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668292,"prepare.queue_time_us":15216,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":15417,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":14029,"thread_start_us":160932,"threads_started":1,"wal-append.queue_time_us":310359}
I20260709 13:00:56.323879  8742 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:56.306696  8670 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.322219  8751 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.329839  8742 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:56.330979  8679 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.834s	user 0.014s	sys 0.001s
I20260709 13:00:56.317809  8623 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.315198  8802 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.328375  8536 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:56.351792  8751 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.335774  8670 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.353104  8774 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.353468  8300 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.355221  8742 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.328663  8485 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.372427  8485 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.363335  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:56.373894  1671 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.364851  8751 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.374506  8751 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.375130  8605 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:56.375936  8821 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.379947  8821 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.376891  8751 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.377596  8623 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.385653  1671 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:56.389278  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.392966  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3110) took 1179 ms. Trace:
I20260709 13:00:56.393353  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.340685  8679 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.368808  8670 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.393672  1675 rpcz_store.cc:276] 0709 13:00:55.213628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.219473 (+  5845us) service_pool.cc:224] Handling call
0709 13:00:55.219830 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.257963 (+ 38133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.392585 (+1134622us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54002fbf54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:56.392875 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38295424}
I20260709 13:00:56.409785  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:56.410763  8777 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:56.411417  8829 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.429s	user 0.007s	sys 0.000s
I20260709 13:00:56.412253  8805 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.409922  8840 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:56.413252  8819 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.843s	user 0.005s	sys 0.018s
I20260709 13:00:56.413805  8788 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.382491  8821 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.417814  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3349) took 1532 ms. Trace:
I20260709 13:00:56.418565  8679 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.418324  1751 rpcz_store.cc:276] 0709 13:00:54.885724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.892219 (+  6495us) service_pool.cc:224] Handling call
0709 13:00:55.560677 (+668458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.561720 (+  1043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.417518 (+855798us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54000d4b50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:56.417705 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537091840}
I20260709 13:00:56.408579  8742 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:55.993033   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:56.363135  8845 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.423659  1595 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:56.424594  8845 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.427692  8751 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:56.426426  8788 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.428427  8751 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.429055  8751 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:56.428665  8788 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.365801  8796 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:56.436481  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.438325  8776 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.394685  8623 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:00:56.439038  8776 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:56.440505  8837 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:00:56.442101  8776 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:56.445709  8783 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.446385  8783 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.448580  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3488) took 1054 ms. Trace:
I20260709 13:00:56.449038  1599 rpcz_store.cc:276] 0709 13:00:55.394383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.399438 (+  5055us) service_pool.cc:224] Handling call
0709 13:00:56.448320 (+1048882us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b5400038254. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:56.448495 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78131456}
I20260709 13:00:56.453244  8485 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.457347  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.459138  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.474498  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:56.472486  1715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.023s	sys 0.043s
W20260709 13:00:56.483085  1715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.024s	sys 0.043s
W20260709 13:00:56.484058  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 746843us
W20260709 13:00:56.490707  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86173.3us
I20260709 13:00:56.491755  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.465940  8796 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.497486  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.498170  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:00:56.463310  8845 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.502368  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:00:56.506392  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.011s	sys 0.008s
W20260709 13:00:56.506831  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.011s	sys 0.008s
W20260709 13:00:56.510190  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 753507us
I20260709 13:00:56.515074  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.518819  8796 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:56.520680  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.520824  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.521252  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.504554  8774 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:56.521761  1743 raft_consensus.cc:2393] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 9: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:56.522742  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.495302  8627 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:00:56.515765  8640 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.515864  8788 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.530444  1641 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.525810  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.504050  8776 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:00:56.539244  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.539580  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.544153  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.548342  1743 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
I20260709 13:00:56.539258  8803 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:56.548362  1748 raft_consensus.cc:1275] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:00:56.550602  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.531953  8623 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:56.548774  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.551388  1749 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.553462  8802 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.554150  8802 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.550766  8803 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:56.555949  8803 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:56.556397  8803 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:56.538887  8485 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:56.559981  8485 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:56.560061  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.560801  1747 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:56.560443  8536 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.561112  8485 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.563131  8536 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.547118  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.517424  8847 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:56.566520  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:56.568534  8814 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 1.097s	user 0.007s	sys 0.013s
I20260709 13:00:56.569900  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.570611  8767 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.555159  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.564779  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.575331  1748 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:56.577457  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.580806  1749 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:56.567399  1745 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:56.570618  1743 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:56.582530  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:56.586182  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47051.7us
I20260709 13:00:56.587838  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.590682  1747 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:56.526644  8821 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:56.592059  1747 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:56.593544  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.599087  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75589.7us
I20260709 13:00:56.589253  8852 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:56.532150  8774 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:56.603137  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.601922  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.605019  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.605777  1749 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:00:56.573027  8783 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.589418  8767 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:56.612947  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.620797  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.606906  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:56.589109  8812 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.617446  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.618295  1747 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:00:56.526475  8845 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:00:56.621990  8794 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:56.600185  8796 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.642156  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:56.642849  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.623670  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3490) took 1228 ms. Trace:
I20260709 13:00:56.607303  8847 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:56.626734  1748 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:00:56.622870  8623 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:56.629739  1747 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:00:56.631783  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.603276  8776 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:56.602807  8622 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:56.624589  8767 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.660763  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:56.635497  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.601342  8742 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:00:56.671578  1746 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:00:56.612157  8751 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.640740  8781 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:56.616242  8788 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:56.643447  1594 rpcz_store.cc:276] 0709 13:00:55.394937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.410856 (+ 15919us) service_pool.cc:224] Handling call
0709 13:00:56.240859 (+830003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.254694 (+ 13835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.623377 (+368683us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54003b4550. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:56.623596 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786472832}
I20260709 13:00:56.607390  8654 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.662468  1743 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:56.666591  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.628237  8821 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:56.632690  8852 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:56.643157  8794 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:56.690486  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.713461  8794 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:56.707036  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:56.715821  8654 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.717486  8845 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:56.717944  8845 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:56.718328  8845 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:56.723949  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:56.653149  8750 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:56.652454  8536 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:56.649890  8726 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.649669  8744 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:56.662074  8783 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:56.675062  8850 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:56.676012  8640 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.641404  8763 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:00:56.702734  8821 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:56.707719  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.707852  8840 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:56.708122  8627 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:56.710263  8751 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.661777  8796 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.805796  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.662551  8767 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:56.732205  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.719103  8654 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.765416  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.830502  1603 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:56.771245  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.832798  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.834169  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.775801  8536 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.840791  8536 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:56.847098  2313 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:00:56.840850  8486 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:56.729408  8774 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:56.848654  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.843251  8804 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:56.836097  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.850003  1603 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:56.850313  8804 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:56.850834  8804 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:56.850592  8847 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.661908  8679 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:00:56.775941  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.801816  1596 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.801836  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.775239  8744 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:56.859109  8744 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:56.835448  8788 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:56.801383  8605 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:56.864223  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.865027  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.866204  1598 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:56.868276  8768 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:56.796788  8783 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.870441  8783 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:56.870983  8627 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:56.871417  8627 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:56.790392  8541 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:56.807745  1744 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 13:00:56.809381  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3492) took 1409 ms. Trace:
I20260709 13:00:56.885942  1595 rpcz_store.cc:276] 0709 13:00:55.411877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.421900 (+ 10023us) service_pool.cc:224] Handling call
0709 13:00:56.809145 (+1387245us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54000249d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:56.809310 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201822976}
I20260709 13:00:56.814234  2317 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:56.815028  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:56.819478  2314 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEARNER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:56.818650  8845 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:56.821137  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:56.821837  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:56.824872  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.848333  8486 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:00:56.904160  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.905254  2310 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:56.905761  1596 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:56.795223  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:56.916159  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.920384  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.921454  1603 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:00:56.913781  8622 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:56.923009  1596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51592
I20260709 13:00:56.923511  8622 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.924106  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.924675  1599 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.925894  8622 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.926481  8490 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.926993  8490 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.927857  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.929028  8796 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.929278  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.929646  8796 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.929910  8679 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.930223  8796 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:56.931005  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.891098  8750 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:56.931831  1603 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:56.932785  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.933236  1678 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:00:56.933386  8845 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:56.929955  1597 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:00:56.934396  8849 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:56.934831  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.801523  8726 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.935031  8849 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:56.936712  8486 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.937356  8726 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.937851  8486 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.935379  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.933348  1603 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:00:56.930739  8679 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:56.942893  8679 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.943392  1599 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:56.943859  8490 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:56.947762  1597 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
W20260709 13:00:56.952610  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 292091us
I20260709 13:00:56.954633  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.956270  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.957352  1599 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:00:56.966137  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.968086  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.968124  2312 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:00:56.969321  1598 raft_consensus.cc:1275] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:56.973047  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.974225  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:56.975203  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:56.976066  1744 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:56.980177  2279 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:56.961823  8845 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:56.981503  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:56.982697  1600 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:56.982831  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:56.983140  1600 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:56.984171  1750 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:56.937376  8849 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.986864  1603 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:56.988112  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:56.988835  1599 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:56.994153  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:56.997123  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:56.997692  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:56.997515  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:56.998495  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:56.998689  1675 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:56.981328  8803 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.001912  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:57.002929  1602 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:56.988224  8766 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.003850  8766 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.004264  8766 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.004371  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:57.006153  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:57.006892  1602 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:57.007697  8860 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:57.008416  8860 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.009251  8804 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.011657  8796 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:56.982199  8771 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:56.998641  1671 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:00:57.013622  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.015309  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.016978  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.019508  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.022106  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:57.024267  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:56.964227  8769 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:00:57.026118  1603 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:56.996240  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:57.028741  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.029322  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.030014  1599 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:57.032752  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.032881  1670 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 13:00:57.033021  1599 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:57.033414  1671 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:57.033628  1599 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:57.034408  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:56.991835  8845 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:57.035936  1671 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:57.036322  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 63350us
I20260709 13:00:57.040014  1672 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:00:57.043507  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47353.3us
I20260709 13:00:57.015412  8812 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:57.043416  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:56.951829  8627 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.047308  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:57.048250  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:57.049671  8786 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:57.050563  8536 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.028240  8849 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:57.067180  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.061911  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:57.064808  1750 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:00:57.065761  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.070027  1670 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:57.043352  8754 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:57.072741  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.091794  1671 raft_consensus.cc:2410] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:00:57.045576  8812 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.092041  2312 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:57.052058  8771 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.093222  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.048271  8844 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:57.051509  8622 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:57.074998  8763 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:00:57.117482  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.119050  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.161582  1747 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:00:57.162209  1669 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 24.
I20260709 13:00:57.162835  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.116714  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.164234  1744 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:57.097808  8845 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.074527  8627 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.056442  8767 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:57.091246  8485 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:57.051892  8796 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:00:57.058949  8769 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:57.109756  8803 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.122553  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.105028  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.118149  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.104597  8804 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 29 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:57.202741  2314 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:00:57.095963  8654 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:57.132058  8605 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:57.203428  8654 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.120590  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.111666  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.120060  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.103119  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.204229  1752 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:00:57.205063  1750 raft_consensus.cc:2410] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:57.205212  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.205549  1752 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:57.122473  8867 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:00:57.205920  1746 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:00:57.191370  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:00:57.195283  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 119179us
I20260709 13:00:57.207053  1748 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:57.159672  8812 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:57.159111  8771 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.194236  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.202769  8622 consensus_queue.cc:1243] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:57.051970  8490 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:00:57.203998  8654 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:57.166592  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.165120  1751 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:00:57.217626  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.217948  8766 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.220893  8711 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:57.213683  1744 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:57.222263  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.223378  8766 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.202275  8769 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.224085  8769 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:57.225203  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.191146  8536 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.228045  8767 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.201778  8485 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.230746  8485 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.232892  1677 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:00:57.235745  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.210750  8771 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.190775  8852 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:57.240880  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.242731  1748 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:57.251844  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.252842  1748 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:57.243952  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.226150  8843 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.255249  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.258102  1675 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
W20260709 13:00:57.258266  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 51195us
I20260709 13:00:57.259317  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:57.211532  8763 consensus_queue.cc:1243] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:57.260665  1752 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:57.260653  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.264093  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.266448  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.268188  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.268412  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.269428  1752 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:57.269508  1748 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:57.271222  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:57.272995  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.275735  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.277448  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:57.265129  1743 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:00:57.264660  8622 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:00:57.280979  1749 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:57.281356  8852 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.282265  8490 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:57.282881  8490 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:57.293030  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.284029  8852 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.297873  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:57.284098  8490 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:56.958858  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 165155us
I20260709 13:00:57.310043  1670 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:00:57.315807  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:57.316109  8490 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:57.306406  8622 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:00:57.299764  8763 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:57.329916  8794 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.616s	user 0.016s	sys 0.001s
I20260709 13:00:57.311692  8852 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.319280  8860 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:57.356639  8781 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:00:57.382035  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.328096  8805 consensus_queue.cc:1048] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:00:57.376257  8796 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:57.360937  8622 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:57.369700  8770 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:57.374058  8679 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:00:57.409662  8679 consensus_queue.cc:1243] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 570958eb733a4af7ae16ae020998c8b4 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:00:57.377491  8794 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:57.399466  8744 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.540s	user 0.015s	sys 0.000s
I20260709 13:00:57.406548  1602 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
W20260709 13:00:57.419767  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.426628  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 120854us
W20260709 13:00:57.439082  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.426862  8874 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:57.468118  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.423902  8744 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.492020  1601 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:00:57.505848  1596 raft_consensus.cc:606] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:57.506502  1596 raft_consensus.cc:614] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:57.508080  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 124799us
W20260709 13:00:57.518934  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50983.7us
W20260709 13:00:57.496353  8879 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:00:57.449913  8781 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:57.521324  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.481974  8875 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:57.483079  8794 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.507159  8640 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.533432  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.541249  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:57.520102  8622 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:57.545306  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:57.550791  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0833279880000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:00:57.551420  1715 connection.cc:256] RPC call timeout handler was delayed by -1.0635279880000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:00:57.552073  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.555037  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.469498  8881 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:00:57.559068  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:57.499969  8763 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:00:57.564770  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.469998  8874 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.531167  8875 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:57.685779  8877 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:00:57.548077  8490 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:00:57.688568  8883 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:00:57.694581  8812 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:57.696125  8783 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.009s
I20260709 13:00:57.548147  8640 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.701021  8773 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Committing config change with OpId 16.15: config changed from index 13 to 15, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:57.709045  8754 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.005s
I20260709 13:00:57.715790  8843 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.716195  8744 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:57.716324  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.570180  8884 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:57.727299  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.742497  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.754704  1673 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:57.737964  1600 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.753197  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.744257  8783 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.768663  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.769520  1669 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:57.769809  8874 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:57.770699  8783 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.772224  1594 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:57.772903  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.774523  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.775743  8781 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.775390  1676 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:57.749804  8881 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:57.752858  8679 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:57.752223  8754 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:57.778309  8875 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.783267  8881 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:00:57.802274  8654 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:00:57.804567  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.831456  1676 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:00:57.804934  8812 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.807591  8881 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.810928  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 131) took 5145 ms. Trace:
I20260709 13:00:57.812371  1678 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:57.845659  8881 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:57.787279  8679 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.813077  1669 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
W20260709 13:00:57.813530  8627 consensus_meta.cc:287] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.009s
W20260709 13:00:57.815479  8771 consensus_meta.cc:287] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.005s
W20260709 13:00:57.816458  8769 consensus_meta.cc:287] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.592s	user 0.015s	sys 0.000s
I20260709 13:00:57.822703  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:57.824288  8859 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.863s	user 0.005s	sys 0.022s
W20260709 13:00:57.827054  8882 log.cc:927] Time spent T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
W20260709 13:00:57.828960  8844 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.668s	user 0.014s	sys 0.000s
I20260709 13:00:57.862098  8844 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:57.839182  1673 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 29.
W20260709 13:00:57.812422  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.863019  2314 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:00:57.850796  1669 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:57.844767  1501 rpcz_store.cc:276] 0709 13:00:52.665942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.673745 (+  7803us) service_pool.cc:224] Handling call
0709 13:00:53.090571 (+416826us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 13:00:57.810782 (+4720211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:54.284332 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:54.377678 (+ 93346us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:54.377743 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:00:54.377764 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:54.378593 (+   829us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:54.378705 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:54.378742 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:54.379518 (+   776us) tablet.cc:701] Row locks acquired
0709 13:00:54.407829 (+ 28311us) write_op.cc:260] PREPARE: finished
0709 13:00:54.440087 (+ 32258us) write_op.cc:270] Start()
0709 13:00:54.477630 (+ 37543us) write_op.cc:276] Timestamp: P: 1783602054434265 usec, L: 0
0709 13:00:54.480482 (+  2852us) op_driver.cc:348] REPLICATION: starting
0709 13:00:54.489530 (+  9048us) log.cc:844] Serialized 2132 byte log entry
0709 13:00:54.811028 (+321498us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:55.049582 (+238554us) op_driver.cc:464] REPLICATION: finished
0709 13:00:55.297739 (+248157us) write_op.cc:301] APPLY: starting
0709 13:00:55.297897 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:55.304767 (+  6870us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:55.304795 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:55.480751 (+175956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:55.528201 (+ 47450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:00:55.533728 (+  5527us) write_op.cc:312] APPLY: finished
0709 13:00:55.575428 (+ 41700us) log.cc:844] Serialized 57 byte log entry
0709 13:00:55.644393 (+ 68965us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:55.662485 (+ 18092us) write_op.cc:454] Released schema lock
0709 13:00:55.729817 (+ 67332us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:55.765346 (+ 35529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:55.772279 (+  6933us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71560,"reported_tablets":9,"spinlock_wait_cycles":5565696,"child_traces":[["op",{"apply.queue_time_us":227265,"apply.run_cpu_time_us":13875,"apply.run_wall_time_us":451560,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":383006,"prepare.run_cpu_time_us":21591,"prepare.run_wall_time_us":314788,"raft.queue_time_us":189335,"raft.run_cpu_time_us":7477,"raft.run_wall_time_us":211076,"replication_time_us":549389,"spinlock_wait_cycles":58455296,"thread_start_us":464273,"threads_started":4,"wal-append.queue_time_us":117890,"wal-append.run_cpu_time_us":49405,"wal-append.run_wall_time_us":2188132}]]}
I20260709 13:00:57.866345  1669 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:00:57.856474  2312 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:57.846369  8679 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:57.861236  8812 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:57.869243  8812 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.871512  8812 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.872394  2310 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:00:57.867717  1669 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:57.873843  1669 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:57.867901  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 2961) took 1103 ms. Trace:
I20260709 13:00:57.874274  1674 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:57.874629  1594 rpcz_store.cc:276] 0709 13:00:56.764295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.767744 (+  3449us) service_pool.cc:224] Handling call
0709 13:00:56.802608 (+ 34864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.772730 (+970122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.867662 (+ 94932us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54003b3b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:57.867837 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229235456}
I20260709 13:00:57.875463  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.877022  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:57.879709  8769 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.882375  8769 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:57.886394  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 334222us
I20260709 13:00:57.886881  1676 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:00:57.894380  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.895215  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:00:57.899834  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 341293us
I20260709 13:00:57.900674  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:57.844449  8654 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:57.903854  2317 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:57.909430  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:57.913185  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 232543us
I20260709 13:00:57.857406  8771 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:57.912786  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.915578  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:57.896921  8627 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:00:57.917519  1595 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.911859  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:57.917613  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:57.921816  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.922345  1602 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:57.925724  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.927718  2316 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 9.
I20260709 13:00:57.928378  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.929224  2312 raft_consensus.cc:2368] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:57.930723  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:57.931488  1598 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:00:57.933236  2309 raft_consensus.cc:2368] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:00:57.914559  8783 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.935609  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.939131  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:57.942550  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:57.913676  8878 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:00:57.944036  1598 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:00:57.920714  8894 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:57.947707  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.949191  1602 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:00:57.950075  1673 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:57.951257  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:57.945150  8640 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:57.948328  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:57.935904  8783 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.957885  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:00:57.941264  8845 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:57.959054  2310 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:57.965961  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.955005  8892 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:57.961406  8654 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.971907  1673 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:57.945529  8895 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:57.962039  8802 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:57.951929  8804 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:57.985114  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:57.987730  2314 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:00:57.965813  8783 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.990342  8802 consensus_queue.cc:1048] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 13:00:57.995815  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 58410.9us
W20260709 13:00:58.003257  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.006340  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:58.011992  1598 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:00:58.002068  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:57.959359  8776 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:00:58.014744  8804 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:58.015413  8804 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.016521  8804 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:58.020684  8771 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.025045  8694 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:58.026145  8865 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:58.026643  8865 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:58.026765  1595 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:58.027112  8865 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:57.977006  8893 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:00:58.036041  8784 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:58.036975  8784 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:58.037380  8784 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.038362  8784 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.029620  8776 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:57.984517  8895 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.031590  8845 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:58.032761  8887 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:58.033176  8875 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:58.033923  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:58.034144  1599 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.034955  8679 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.054237  8784 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:58.080439  8895 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:58.081442  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 47669.5us
I20260709 13:00:58.079157  8627 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:00:58.083452  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 77271.5us
I20260709 13:00:58.085616  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:58.089650  2314 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:00:58.089496  2313 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:58.082450  8804 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:58.092175  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:58.084080  8892 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:00:58.099504  8886 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.100785  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:00:58.083753  8627 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.105715  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:58.094203  8754 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:58.099968  8894 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:00:58.084432  8893 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:00:58.098440  8804 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.108013  8788 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:58.094709  8887 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:00:58.094594  8845 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:00:58.122840  8788 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.092813  8781 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:00:58.123363  8894 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.133603  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:58.137607  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3132) took 1132 ms. Trace:
I20260709 13:00:58.138101  1677 rpcz_store.cc:276] 0709 13:00:56.996697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.996838 (+   141us) service_pool.cc:224] Handling call
0709 13:00:58.128993 (+1132155us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540036e2d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:58.129149 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497216256}
I20260709 13:00:58.140817  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:58.141738  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:58.148053  1603 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:58.135064  8895 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.151487  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:58.158344  8679 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.159744  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:58.160260  8893 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:58.160502  1603 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:58.160835  8893 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:58.165266  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3510) took 2495 ms (client timeout 1546 ms). Trace:
W20260709 13:00:58.165864  1601 rpcz_store.cc:269] 0709 13:00:55.670220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.774099 (+103879us) service_pool.cc:224] Handling call
0709 13:00:58.164886 (+2390787us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54004092d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:58.165102 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3492477824}
I20260709 13:00:58.162004  8893 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.181273  1674 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:58.167450  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:58.180416  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3144) took 1163 ms. Trace:
I20260709 13:00:58.170506  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51592 (request call id 4) took 1261 ms. Trace:
I20260709 13:00:58.172533  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55880 (request call id 989) took 1251 ms. Trace:
I20260709 13:00:58.194520  1596 rpcz_store.cc:276] 0709 13:00:56.913902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.914045 (+   143us) service_pool.cc:224] Handling call
0709 13:00:58.170218 (+1256173us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54004092d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481487853 00007f948645560a 00007f947f9db7d4 00007f947f9db762 00007f947f9db691 00007f947f9db60c 00007f947f9da8c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:58.170395 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339201920}
I20260709 13:00:58.213124  1601 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:58.194698  1597 rpcz_store.cc:276] 0709 13:00:56.921459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.934580 (+ 13121us) service_pool.cc:224] Handling call
0709 13:00:58.172307 (+1237727us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54001b3d54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:58.172458 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28040448}
I20260709 13:00:58.193570  1678 rpcz_store.cc:276] 0709 13:00:57.017139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.080171 (+ 63032us) service_pool.cc:224] Handling call
0709 13:00:58.180144 (+1099973us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003223d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:58.180344 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398409600}
W20260709 13:00:58.215282  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.220216  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 63614.9us
I20260709 13:00:58.220214  1603 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:00:58.166728  8627 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.227583  8627 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:58.157374  8887 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.229245  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:00:58.229614  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.231297  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:58.252604  1596 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:00:58.214365  8679 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.261919  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.250291  1597 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:00:58.264184  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.269043  1744 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:58.155577  8895 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.277053  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.279320  1747 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.281424  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:58.281484  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:58.256139  8654 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.285104  8654 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.255863  8881 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.287959  8881 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.288949  8783 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.290365  8881 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.295012  2317 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:58.296715  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.228552  8776 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:00:58.320029  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.314019  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:58.316340  1752 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:58.318234  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:58.179962  8788 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.280198  8893 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:58.341854  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.279979  8754 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:58.344735  8754 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.348261  1744 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:00:58.255841  8845 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:00:58.155805  8804 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.352319  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:58.362759  1752 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
W20260709 13:00:58.354936  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.358281  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:58.334192  1747 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:00:58.365481  1746 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:58.272109  8679 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.311220  8892 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.355610  8427 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:58.388964  8427 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.355862  8911 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:00:58.384810  8894 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.396432  8894 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.364434  8878 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:58.368584  8654 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.399293  8894 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:58.382339  8541 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:00:58.422195  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.441745  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 354896us
I20260709 13:00:58.423096  8783 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:58.419952  8541 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.439224  8804 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:58.411558  8878 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:58.484191  8912 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:00:58.477311  8919 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.508610  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3136) took 1494 ms. Trace:
I20260709 13:00:58.509318  1675 rpcz_store.cc:276] 0709 13:00:57.013845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.014936 (+  1091us) service_pool.cc:224] Handling call
0709 13:00:58.508283 (+1493347us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540036e7d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:58.508486 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429151616}
I20260709 13:00:58.510653  1670 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:58.484153  8427 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.518829  1675 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:58.534972  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 163234us
I20260709 13:00:58.540364  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:58.541200  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:00:58.543689  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.535050  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 92170.3us
I20260709 13:00:58.545717  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:00:58.549260  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:00:58.553514  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.429381  8892 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.565001  1675 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:58.572647  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:58.573709  1669 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:00:58.575939  8923 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:58.576364  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:58.577315  1752 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:58.577929  8923 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:58.578390  8923 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:00:58.575951  8911 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:58.578855  8923 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:58.579607  8911 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:00:58.580156  8918 log.cc:927] Time spent T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:00:58.580261  8911 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.583137  2316 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEARNER]: Advancing to term 20
W20260709 13:00:58.583334  8897 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.620s	user 0.002s	sys 0.000s
I20260709 13:00:58.585037  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:58.586688  8886 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.587169  8886 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:58.588037  8886 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.589354  8886 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.593422  2316 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:00:58.608636  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.611016  8912 log.cc:927] Time spent T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:58.612480  8935 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:58.613920  8935 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:58.616910  8937 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:58.617652  1673 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:58.593214  8905 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:58.620223  8754 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:58.620810  8754 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:58.624531  8679 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.529549  8919 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.628273  8919 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:58.633867  8921 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:58.634740  8921 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.635218  8921 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:58.565549  8844 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:58.648360  8844 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:00:58.554080  8694 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.528s	user 0.014s	sys 0.002s
I20260709 13:00:58.650038  1672 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:00:58.653908  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.659008  8915 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.554374  8427 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:58.676530  8760 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.678869  8760 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.680439  1745 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:58.558060  8541 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.693207  8796 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:58.693440  8874 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:58.693840  8874 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:58.693899  8796 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.696444  8796 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.698894  8768 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.691533  8694 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.694880  8874 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.699671  8427 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:58.782872  1746 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:00:58.771282  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 48376.3us
I20260709 13:00:58.789213  8878 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:58.791997  8427 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:58.767069  8694 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:58.796188  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 207562us
I20260709 13:00:58.800181  1743 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:00:58.802294  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:58.791185  1600 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:58.768846  8865 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.006s
I20260709 13:00:58.686933  8915 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.726564  8768 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:58.704384  8844 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:00:58.905148  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 313750us
I20260709 13:00:58.828197   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:58.825748  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:00:58.845537  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.728367  8911 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:58.924084  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.818961  8770 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.814657  8929 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:58.905560  8794 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.012s	sys 0.006s
W20260709 13:00:58.870327  8927 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:58.825829  8874 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:58.849982  8781 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:58.853214  8895 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:58.838165  8804 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.871388  8880 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.470s	user 0.005s	sys 0.002s
W20260709 13:00:58.981805  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.983466  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 157905us
I20260709 13:00:59.002065  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:59.003943  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.948141  8490 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.827163  8920 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:00:58.951962  8770 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:59.008049  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.008864  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3148) took 1990 ms. Trace:
I20260709 13:00:59.009434  8914 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:59.010154  8804 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:00:59.012467  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:59.016475  8760 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:59.016834  1603 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:59.020104  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:59.020524  1602 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:59.021266  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.095520  1597 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:00:59.022492  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.024235  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3316) took 1066 ms. Trace:
W20260709 13:00:59.026367  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.097153  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74809.3us
W20260709 13:00:59.098095  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.038534  1599 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:59.002167  8905 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.043789  1497 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 17, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:59.099006  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:00:59.101322  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 17, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:59.047911  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3367) took 2489 ms. Trace:
I20260709 13:00:59.096824  1674 rpcz_store.cc:276] 0709 13:00:57.957394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.960303 (+  2909us) service_pool.cc:224] Handling call
0709 13:00:58.180999 (+220696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.213720 (+ 32721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.024007 (+810287us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003223d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:59.024163 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506967936}
I20260709 13:00:58.821597  8865 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.062734  1671 rpcz_store.cc:276] 0709 13:00:57.017998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.181239 (+163241us) service_pool.cc:224] Handling call
0709 13:00:57.181847 (+   608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.182424 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.182469 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.183209 (+   740us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.297675 (+114466us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:57.297721 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.297797 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.870673 (+1572876us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:00:59.008505 (+137832us) raft_consensus.cc:1685] finished
0709 13:00:59.008535 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.008797 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1194,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6610,"spinlock_wait_cycles":4948352,"thread_start_us":76176,"threads_started":1,"wal-append.queue_time_us":181873}
I20260709 13:00:59.068732  1594 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:00:59.068907  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.107036  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:58.960891  8794 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.012s	sys 0.007s
I20260709 13:00:59.083041  1600 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:00:58.985743  8915 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:58.978899  8781 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:00:59.067445  8627 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.818s	user 0.014s	sys 0.005s
I20260709 13:00:59.061887  8679 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.102843  1745 rpcz_store.cc:276] 0709 13:00:56.558044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.590471 (+ 32427us) service_pool.cc:224] Handling call
0709 13:00:56.590847 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.680832 (+2089985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.047562 (+366730us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54004218d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:00:59.047791 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4807108480}
I20260709 13:00:59.057720  8900 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.128193  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.130743  1600 pending_rounds.cc:85] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 9
I20260709 13:00:59.198256  1600 pending_rounds.cc:107] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:00:59.198787  1600 raft_consensus.cc:2889] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.067698  8881 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.104941  1497 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 22, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.067993  8914 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:59.127722  8760 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.200541  2309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36870 (request call id 736) took 1317 ms (client timeout 1706 ms). Trace:
I20260709 13:00:59.207450  1751 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:00:59.210803  1497 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 21, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.106456  8917 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:59.228919  1497 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 20, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.214522  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3515) took 2242 ms. Trace:
I20260709 13:00:59.062681  8490 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.093376  8744 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:00:59.130349  8895 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.105847  8892 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:59.226125  2309 rpcz_store.cc:269] 0709 13:00:57.855437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.875187 (+ 19750us) service_pool.cc:224] Handling call
0709 13:00:59.172432 (+1297245us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b54001e8554. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:00:59.172693 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131201408}
I20260709 13:00:59.176855  8905 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:59.232082  1600 rpcz_store.cc:276] 0709 13:00:56.957220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.957339 (+   119us) service_pool.cc:224] Handling call
0709 13:00:56.967023 (+  9684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.737376 (+770353us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b4c000b8f40. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f730644 00007f947f757f2d 00007f947f757b93 00007f948148818b 00007f9481488cb5 00007f9481483f30 00007f94814857de 00007f948148fb49 00007f9481490416
0709 13:00:57.869737 (+132361us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54001322a0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481402a1d 00007f94813e91a4 00007f948146b447 00007f9481483fe7 00007f94814857de 00007f948148fb49 00007f9481490416 00007f948148cd8f 00007f948148c83e 00007f9486451419
0709 13:00:58.790618 (+920881us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b58005c3cd0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94813e90aa 00007f948146b447 00007f9481483fe7 00007f94814857de 00007f948148fb49 00007f9481490416 00007f948148cd8f 00007f948148c83e 00007f9486451419 00007f947f9c8bd4
0709 13:00:59.199580 (+408962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.199930 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161883264}
I20260709 13:00:59.153225  8919 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.234539  1497 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:59.250244  1599 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:00:59.250787  1599 pending_rounds.cc:85] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 15
I20260709 13:00:59.251091  1599 pending_rounds.cc:107] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:00:59.267520  1599 raft_consensus.cc:2889] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.251365  1497 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 18, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.126811  8938 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:00:59.271727  8938 consensus_queue.cc:1243] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:00:59.227139  8914 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:59.307961  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 994) took 2348 ms. Trace:
I20260709 13:00:59.310120  1599 rpcz_store.cc:276] 0709 13:00:56.959440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.032651 (+ 73211us) service_pool.cc:224] Handling call
0709 13:00:57.032912 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.033778 (+1000866us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400135ea0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948140b06f 00007f9481483f60 00007f94814857de 00007f948148fb49 00007f9481490416 00007f948148cd8f 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62
0709 13:00:59.037996 (+1004218us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b58000c74d0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94813e90aa 00007f948146b447 00007f9481483fe7 00007f94814857de 00007f948148fb49 00007f9481490416 00007f948148cd8f 00007f948148c83e 00007f9486451419 00007f947f9c8bd4
0709 13:00:59.307661 (+269665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.307895 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716984960}
W20260709 13:00:59.249404  8788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.033s	sys 0.029s
W20260709 13:00:59.247150  8876 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:00:59.302402  1497 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 18, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.268033  8942 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:59.324589  1497 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 19, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:59.314081  8893 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.955s	user 0.016s	sys 0.000s
I20260709 13:00:59.215838  8679 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:59.317531  8788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.034s	sys 0.030s
I20260709 13:00:59.333069  2317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
mode: GRACEFUL
new_leader_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:52868
I20260709 13:00:59.244592  8760 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.261082  8895 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.340308  1497 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 14 to 15, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.308465  8878 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.312901  8802 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.226783  8881 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:59.359791  8945 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260709 13:00:59.361383  8881 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.361995  8881 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.362475  8881 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.338222  2317 raft_consensus.cc:606] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Received request to transfer leadership to TS fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.247716  8900 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:59.334744  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 205425us
W20260709 13:00:59.364822  1715 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.548s (SENT)
I20260709 13:00:59.365669  8900 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.347757  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:59.366720  1746 raft_consensus.cc:2376] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16. Re-sending same reply.
I20260709 13:00:59.347956  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:59.355170  8541 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:59.350672  8944 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:00:59.351051  8679 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:59.351399  8939 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:00:59.354511  8895 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.404507  2310 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:00:59.358378  8878 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.368348  1743 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:00:59.348055  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:59.373034  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:59.415329  1747 raft_consensus.cc:2376] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18. Re-sending same reply.
I20260709 13:00:59.374017  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:59.347214  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:00:59.416530  1749 raft_consensus.cc:2376] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18. Re-sending same reply.
I20260709 13:00:59.376008  1744 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:00:59.417060  1744 pending_rounds.cc:85] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 8
I20260709 13:00:59.375855  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:00:59.417315  1744 pending_rounds.cc:107] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:00:59.417495  1746 raft_consensus.cc:2376] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19. Re-sending same reply.
I20260709 13:00:59.381699  1748 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:59.376657  8893 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:00:59.402181  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3525) took 1269 ms. Trace:
I20260709 13:00:59.356532  8802 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.425951  1595 rpcz_store.cc:276] 0709 13:00:58.132748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.132887 (+   139us) service_pool.cc:224] Handling call
0709 13:00:58.133307 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.135188 (+  1881us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:00:58.342461 (+207273us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.813870 (+471409us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.814065 (+   195us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.814611 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.814758 (+   147us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:58.814799 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.814876 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.401862 (+586986us) raft_consensus.cc:1685] finished
0709 13:00:59.401896 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.402099 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1413,"prepare.queue_time_us":92921,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":76,"raft.queue_time_us":2284,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":11963,"spinlock_wait_cycles":86255360,"thread_start_us":651003,"threads_started":2,"wal-append.queue_time_us":551014}
I20260709 13:00:59.371791  8929 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.435361  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49867.3us
W20260709 13:00:59.405217  8940 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.482s	user 0.001s	sys 0.001s
I20260709 13:00:59.416641  1745 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:00:59.417615  1744 raft_consensus.cc:2889] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.382867  8776 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:00:59.440539  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.442618  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.303123  8892 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.426014  8744 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:00:59.444909  8760 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:00:59.368156  8941 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.441s	user 0.001s	sys 0.001s
I20260709 13:00:59.445369  8895 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.445693  8760 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:59.446776  8892 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:59.447309  1566 leader_election.cc:400] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:59.447531  8892 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:59.372074  8768 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:59.437301  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:00:59.448251  8802 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:00:59.376791  8886 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.002s
W20260709 13:00:59.440114  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.444481  8876 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.440120  8679 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.450392  8876 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.372831  1497 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 17 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:00:59.453368  8876 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.449884  8892 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:00:59.441080  8929 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.457849  8892 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.460713  8881 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.461724  8770 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:59.338002  8942 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:59.463917  8804 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:59.464354  8942 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.465039  8865 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.466614  8490 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.441144  8845 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.472766  8845 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.414335  8788 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:00:59.474633  8892 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:59.475780  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3318) took 1229 ms. Trace:
I20260709 13:00:59.475893  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.476614  2313 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:00:59.476270  1677 rpcz_store.cc:276] 0709 13:00:58.247004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.247211 (+   207us) service_pool.cc:224] Handling call
0709 13:00:58.247856 (+   645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.432605 (+184749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.432672 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.452535 (+ 19863us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.673923 (+221388us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:58.673967 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.674045 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.475486 (+801441us) raft_consensus.cc:1685] finished
0709 13:00:59.475517 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.475708 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226709,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":163,"thread_start_us":361757,"threads_started":2,"wal-append.queue_time_us":341764}
I20260709 13:00:59.409379  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.447697  1566 leader_election.cc:403] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:59.481058  1549 auto_rebalancer.cc:893] Removing replace marker failed: Replica 693257b3078444e0bd26d3e82159d452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:00:59.481777  1549 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:59.482187  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:00:59.456719  8921 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.001s
I20260709 13:00:59.484831  8921 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.486591  8754 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.488040  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.488657  8754 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:59.490613  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81421.9us
I20260709 13:00:59.487293  8921 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.490082  8794 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:59.498281  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:59.489130  8923 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.005s
I20260709 13:00:59.494920  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:59.505931  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 378002us
I20260709 13:00:59.507031  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:00:59.508257  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.509532  8935 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:59.489859  8490 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23.
I20260709 13:00:59.489488  8865 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:59.515421  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.518958  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.520996  8921 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.521689  8921 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.512598  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.523018  8935 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:59.523623  8935 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:59.524411  8921 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.524850  8935 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.530925  8769 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.531898  8769 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.529929  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:00:59.535486  8769 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.535830  8874 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:59.535043  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.498901  8774 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:59.493414  8881 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:59.542819  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.450495  8679 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.548131  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.502481  8929 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:00:59.543922  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.510713  8876 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:59.513010  8841 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:59.552157  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:00:59.562448  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.541862  8802 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:59.568933  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 131597us
I20260709 13:00:59.542156  8774 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:00:59.576679  1641 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:59.513137  8427 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:00:59.549125  8490 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:00:59.645582  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.651167  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74601.9us
I20260709 13:00:59.652011  8935 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:59.511152  8923 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:00:59.661070  8956 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:00:59.703961  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 101830us
I20260709 13:00:59.567045  8876 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.705020  8876 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:59.640725  8841 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:00:59.547940  8881 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.707383  8841 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.566951  8874 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:59.543097  8865 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.644239  8774 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:59.512638  8794 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.668256  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:59.701597  8935 raft_consensus.cc:697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:00:59.702777  8923 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.568982  8958 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:59.725907  8802 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:00:59.734767  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 66680.3us
I20260709 13:00:59.718830  8788 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:59.732795  8967 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.830982  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:00:59.835919  8968 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:00:59.741025  8963 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:59.837174  8963 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.837877  8963 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:59.839706  8919 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:59.844060  8679 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.844873  8679 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:59.845366  8679 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:59.821403  8788 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.850114  8788 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:59.849758  8935 consensus_queue.cc:237] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:00:59.845410  8694 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:00:59.900527  1674 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260709 13:00:59.901292  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 70630.8us
I20260709 13:00:59.846747  8679 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.790211  8881 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:00:59.904369  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 352456us
I20260709 13:00:59.908970  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.910140  1669 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:00:59.912495  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.913304  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.912591  2313 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:59.915705  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.916570  1674 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:00:59.919868  1671 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:59.922370  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.929593  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.930445  1674 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:00:59.933010  1595 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: [20.11-22.12]
I20260709 13:00:59.896998  8874 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:00:59.811125  8802 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.898128  8490 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:00:59.836971  8968 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.938531  2312 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:59.942830  1599 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:00:59.967757  1599 pending_rounds.cc:85] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 14
I20260709 13:00:59.968091  1599 pending_rounds.cc:107] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:00:59.968364  1599 raft_consensus.cc:2889] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.943289  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.943924  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:59.944645  2316 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:59.945245  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.946566  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:00:59.900238  8958 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:00:59.950160  8915 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:59.939747  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:59.959760  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:59.959584  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:00:59.961191  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:59.961311  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:00:59.980046  2311 raft_consensus.cc:2410] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:00:59.980058  1602 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:59.917192  1676 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:00:59.943116  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:00:59.913518  8860 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:59.963874  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:00:59.824277  8967 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.947959  1598 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:59.925716  8842 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:00:59.977352  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53649.9us
I20260709 13:00:59.983280  8776 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:59.983516  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.983834  8776 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.984236  8776 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:59.984902  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:00:59.983034  8842 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:00:59.986905  8788 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:59.979631  1594 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:59.929737  8919 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:59.983052  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:00.000784  1602 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:00:59.988945  8860 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.971714  8490 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:00:59.999092  8961 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:01:00.002312  8914 consensus_meta.cc:287] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.682s	user 0.017s	sys 0.000s
I20260709 13:01:00.038265  8865 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.028957  8929 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.055950  8975 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:00.056044  8976 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:00.051596  8774 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.057116  8975 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.056226  8895 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:01:00.059561  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.010169  8860 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:00.056259  8929 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.062824  8773 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.063634  8773 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.063979  8842 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:00:59.988593  8974 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:01:00.077575  8895 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:01:00.078249  8794 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.078245  8895 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:00.080184  8967 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:00.079996  8895 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.081869  8895 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:01:00.037969  8874 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.110777  2313 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:00.112190  8802 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.018684  8966 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.133759  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 160216us
I20260709 13:01:00.030920  8961 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.145016  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.149513  1678 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:00.147053  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:00.141538  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.151932  1675 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 11.
I20260709 13:01:00.155160  1675 raft_consensus.cc:1275] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:01:00.155709  1675 pending_rounds.cc:85] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 10
I20260709 13:01:00.155512  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.156059  1675 pending_rounds.cc:107] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:00.156328  1670 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:01:00.157407  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.158661  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:00.159955  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:00.160802  1673 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.156358  1675 raft_consensus.cc:2889] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.163779  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:00.148252  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 163493us
W20260709 13:01:00.114938  8973 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
I20260709 13:01:00.166901  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:01:00.183737  1750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3389) took 1840 ms (client timeout 1540 ms). Trace:
I20260709 13:01:00.165616  1670 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:00.139626  8967 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.189319  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.191148  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:00.186308  1750 rpcz_store.cc:269] 0709 13:00:58.313387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.313573 (+   186us) service_pool.cc:224] Handling call
0709 13:01:00.149593 (+1836020us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54002e6154. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:00.153671 (+  4078us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780084480}
I20260709 13:01:00.195227  1602 raft_consensus.cc:2393] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.195437  1603 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 22 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:01:00.200752  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.202097  1603 raft_consensus.cc:2393] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.202536  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.203895  1602 raft_consensus.cc:2368] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:01:00.206506  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.212075  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.213199  1599 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.151877  8961 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:00.215799  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:00.217694  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.213156  1602 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:01:00.220817  1678 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.224941  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.225827  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.226848  1594 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:00.224639  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.228585  1603 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:00.235356  1603 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: [16.15-18.16]
I20260709 13:01:00.131760  8914 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.243306  1602 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:00.214918  8794 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:00.249966  1599 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:01:00.252843  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.259004  1603 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:01:00.260633  1596 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:00.149242  8966 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.262758  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:00.268872  1678 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.263994  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.261559  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.271131  1601 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 23: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.277088  1674 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:00.280220  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.284947  1599 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:00.245566  8929 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.252426  8490 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.291302  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.218734  8967 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.299872  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.300642  1601 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:00.301702  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.295481  1596 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:00.252821  8968 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.305037  8968 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:00.305294  1599 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:00.306089  8968 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.307240  1599 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:01:00.313319  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.315419  1596 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:00.314395  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.318485  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.319985  1596 raft_consensus.cc:2410] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 13:01:00.323108  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.324240  1670 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:00.335525  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.337641  1596 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:01:00.342710  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.311122  8541 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.926s	user 0.018s	sys 0.021s
I20260709 13:01:00.352169  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.357824  1595 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:01:00.358563  1595 pending_rounds.cc:85] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 14
I20260709 13:01:00.358889  1595 pending_rounds.cc:107] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 19.15
I20260709 13:01:00.356003  1599 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:01:00.359205  1595 raft_consensus.cc:2917] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Aborting config change with OpId 19.15: Aborted: Op aborted by new leader
I20260709 13:01:00.360472  1596 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:01:00.360365  1595 raft_consensus.cc:2889] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:00.374883  8988 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:01:00.386096  1598 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 29.
I20260709 13:01:00.363842  8788 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.388743  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.393515  1596 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:00.393620  1678 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:01:00.392607  1670 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
W20260709 13:01:00.385113  8892 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.910s	user 0.016s	sys 0.016s
I20260709 13:01:00.402782  1596 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:01:00.403890  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.405925  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.406831  1678 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:00.388379  8773 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:00.387758  8794 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:00.409934  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.411794  1596 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:01:00.405545  8987 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:01:00.418758  8960 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.599s	user 0.004s	sys 0.000s
I20260709 13:01:00.416513  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.420795  1596 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:01:00.422976  1601 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:00.409009  8929 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.430449  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.431521  1596 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:00.432771  8968 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:00.434083  8754 consensus_meta.cc:287] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.934s	user 0.012s	sys 0.012s
I20260709 13:01:00.435034  1671 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:00.435377  1671 pending_rounds.cc:85] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 7
I20260709 13:01:00.435624  1671 pending_rounds.cc:107] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:00.435885  1671 raft_consensus.cc:2889] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.403589  8788 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.444693  8914 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.438232  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.442112  8776 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:00.443728  8984 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:00.447461  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.453369  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.453934  1596 raft_consensus.cc:2376] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 29. Re-sending same reply.
I20260709 13:01:00.454829  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:00.446183  8991 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:00.455582  1678 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 10.
W20260709 13:01:00.461377  8876 consensus_meta.cc:287] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.756s	user 0.027s	sys 0.003s
I20260709 13:01:00.461377  8781 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.466271  8794 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.468034  8967 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:00.471060  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.472083  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.473915  1602 raft_consensus.cc:2393] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 23: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.437480  8929 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.477036  1596 raft_consensus.cc:2368] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
W20260709 13:01:00.478055  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.476388  8878 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.481464  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.483879  1596 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:00.481477  8781 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:00.487053  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.475292  8876 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:00.495349  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.963s (SENT) [suppressed 24 similar messages]
I20260709 13:01:00.497242  1597 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:00.497354  1596 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:00.499913  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:01:00.497304  8971 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.682s	user 0.000s	sys 0.003s
I20260709 13:01:00.504017  1602 raft_consensus.cc:2376] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23. Re-sending same reply.
I20260709 13:01:00.506250  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.506999  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.507218  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.507994  1601 raft_consensus.cc:2393] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.507962  1596 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:00.508471  8929 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.509752  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.510090  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.511005  1601 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.506513  8876 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:00.516613  1751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3387) took 2220 ms (client timeout 1783 ms). Trace:
I20260709 13:01:00.517421  8845 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:00.517226  1751 rpcz_store.cc:269] 0709 13:00:58.295923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.296257 (+   334us) service_pool.cc:224] Handling call
0709 13:01:00.516287 (+2220030us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540013ae54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:00.516481 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091603200}
W20260709 13:01:00.507090  8980 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.275s	user 0.000s	sys 0.004s
I20260709 13:01:00.519848  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:00.531900  8963 consensus_meta.cc:287] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.009s
I20260709 13:01:00.532464  8963 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.534894  8760 raft_consensus.cc:1064] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:00.535013  8963 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.507134  1602 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:00.502300  8860 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.536247  8770 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:00.539206  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:00.537235  8760 raft_consensus.cc:1068] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Unable to promote non-voter 570958eb733a4af7ae16ae020998c8b4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:00.531102  8788 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.544952  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.547240  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:00.550076  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.540947  8770 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:00.553022  1594 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:00.553158  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.562969  1675 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:00.566660  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.567778  1675 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 13:01:00.569279  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.572606  8894 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:00.573587  8894 consensus_queue.cc:1243] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:00.575480  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.576599  8603 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:00.577028  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:00.577648  2310 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:00.577965  8842 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:00.578378  8842 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:01:00.579291  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.579921  1566 connection.cc:256] RPC call timeout handler was delayed by -1.8344056149999801s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:01:00.579311  8842 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:00.580305  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5743056150000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 13:01:00.580652  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5464056149999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:01:00.580972  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1417926020000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:01:00.581437  8842 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:00.581292  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1417926020000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:01:00.585294  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0868926020000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:01:00.585774  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0868926020000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:01:00.552345  8788 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:00.541119  8961 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:00.586710  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:01:00.586107  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0310926020000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:01:00.588590  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.563237  8760 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:00.592048  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0310926020000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:01:00.592586  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0229926020000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:01:00.592967  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0229926020000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:01:00.593674  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:00.594722  8771 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:00.594362  8770 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.595191  8771 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.594898  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:00.595700  8771 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.596151  8876 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:00.596997  8876 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:01:00.596175  8969 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.761s	user 0.004s	sys 0.000s
I20260709 13:01:00.598250  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:00.599172  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3400) took 1219 ms. Trace:
I20260709 13:01:00.600438  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.591863  8967 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:01:00.601267  8967 consensus_queue.cc:1243] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:00.601399  1594 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.601838  8911 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:00.596053  8770 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:00.603233  1601 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:00.603927  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.605167  1601 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:00.605484  8955 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:00.606002  8955 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:00.608502  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.609179  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.610067  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.610675  1595 raft_consensus.cc:2376] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23. Re-sending same reply.
I20260709 13:01:00.609238  1598 raft_consensus.cc:2376] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14. Re-sending same reply.
I20260709 13:01:00.610102  1600 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 14: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:00.599589  1743 rpcz_store.cc:276] 0709 13:00:59.379777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.470032 (+ 90255us) service_pool.cc:224] Handling call
0709 13:00:59.470424 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:59.470830 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.470858 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:59.471582 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:00:59.637852 (+166270us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:59.637933 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.638051 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.595395 (+957344us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:00.598822 (+  3427us) raft_consensus.cc:1685] finished
0709 13:01:00.598852 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.599111 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3775,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":40589184,"thread_start_us":97078,"threads_started":1,"wal-append.queue_time_us":363222}
I20260709 13:01:00.613631  8966 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:00.577045  8860 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.616711  2310 raft_consensus.cc:2410] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:01:00.619896  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.621594  8961 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:00.622359  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.606979  8955 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.624725  8955 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:00.625639  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.627983  1749 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.630748  1747 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 28. Current term is 29. Ops: []
I20260709 13:01:00.632975  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.633689  1751 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.633890  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1582) took 1250 ms. Trace:
I20260709 13:01:00.634312  1745 rpcz_store.cc:276] 0709 13:00:59.383870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.928363 (+544493us) service_pool.cc:224] Handling call
0709 13:00:59.973467 (+ 45104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.991603 (+ 18136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.991640 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.991687 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.991721 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.633628 (+641907us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540017c5d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:00.633685 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.633828 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41017216}
I20260709 13:01:00.636229  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.614123  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:00.637583  1602 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
W20260709 13:01:00.638207  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49708.8us
I20260709 13:01:00.640476  1597 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:00.636269  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.641597  1747 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:00.642575  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.644044  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.644369  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.644901  1746 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:00.645191  1745 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:01:00.649271  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.650128  1747 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:00.646896  8627 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:00.651407  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.647977  8974 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.652532  1748 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:00.652325  8974 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.653967  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.654978  8974 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.655326  1743 raft_consensus.cc:2410] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:00.657961  1751 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:01:00.659111  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:00.665980  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:00.671787  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.667254  8788 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.673072  8788 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.676168  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.677225  1751 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:01:00.680613  8788 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:00.683737  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.648741  8794 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:01:00.704810  8964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.005s	sys 0.009s
W20260709 13:01:00.705811  8964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.005s	sys 0.009s
I20260709 13:01:00.707387  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:00.714956  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.713891  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.717267  1751 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:00.718753  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.722707  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:00.688490  8794 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:00.752570  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.747860  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.753304  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.714089  8770 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:01:00.752043  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.753808  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.754690  1747 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:00.752295  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.755963  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.699870  8788 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:00.753356  1750 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:00.752775  8694 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:01:00.688686  8771 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.769763  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.773592  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.779637  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.780578  1715 leader_election.cc:400] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:01:00.781306  1715 leader_election.cc:403] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:00.781337  1748 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:00.782625  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:00.785118  1751 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 24.
I20260709 13:01:00.747635  8885 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:00.760861  8794 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:00.754554  8961 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:00.785830  1750 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:00.785656  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:00.760602  8966 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:00.775472  8760 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:00.718890  8781 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:01:00.810738  1744 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:00.810837  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.795158  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.787667  8894 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:00.815465  8894 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.815975  8894 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:00.818238  8876 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:00.818885  8876 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.789791  8885 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:00.819762  8885 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:00.820070  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.807248  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 132455us
W20260709 13:01:00.807430  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 220961us
I20260709 13:01:00.788393  8771 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.786765  8937 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14.
I20260709 13:01:00.811771  1748 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:00.812425  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.787098  8694 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:00.825232  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:00.804440  8966 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.834848  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.823598  8975 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.831238  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:00.809237  8788 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:00.842845  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.848083  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.857373  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.857373  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:00.857899  8770 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:00.858376  1672 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.858961  8876 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.858644  8770 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.860248  8774 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:00.835460  8966 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:00.862147  8931 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.862800  8931 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:00.865262  8931 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:00.867426  8893 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:00.868294  8893 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.870503  8893 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:00.834187  8955 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:00.871832  8955 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.872208  8955 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:00.873555  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.830267  8744 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:00.875452  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.876668  8776 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:00.877825  1749 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:00.878453  8937 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:00.879029  8937 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:00.879519  8937 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:00.883996  1745 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:00.884599  8788 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:00.885705  8788 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:00.860267  9005 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:00.888046  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.890095  1748 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
W20260709 13:01:00.892239  9008 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:00.892318  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:00.894407  9003 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:00.897830  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.898820  1751 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:00.902529  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.904101  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.904871  1746 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:00.861337  8770 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:00.912253  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62805.7us
I20260709 13:01:00.914525  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:00.916317  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:00.917068  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.920137  1746 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:00.921968  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.923817  1672 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:01:00.926013  2311 raft_consensus.cc:2410] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:01:00.926937  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 13:01:00.928232  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75789.7us
I20260709 13:01:00.928800  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.931075  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.932441  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.932824  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:00.933884  1751 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 14: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:00.936719  2309 raft_consensus.cc:1240] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:00.944442  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.945415  1677 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.945297  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.947140  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:00.948662  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.936414  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.949433  1676 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:00.949623  1751 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:00.951327  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:00.911801  8962 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:00.953730  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.913661  8935 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:00.954262  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.925424  8942 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:00.955439  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:00.961391  2310 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:01:00.954507  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.957626  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:00.962663  1674 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 23: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:00.958895  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:00.959529  2311 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:00.965132  1746 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:00.964576  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:00.970171  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:00.943909  8802 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:00.994267  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:00.954859  8914 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:00.953244  8917 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:01:00.950968  8770 consensus_queue.cc:1059] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:01:00.998025  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:01.012833  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.018697  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.062515  1672 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 12.
I20260709 13:01:01.060628  8771 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.063721  8771 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:01.065068  8771 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:01.061522  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48837.3us
I20260709 13:01:01.012883  8841 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:01.071066  8744 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:01.071585  8744 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.071954  8744 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.063025  8885 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.081148  8894 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:00.964160  8776 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.093197  2311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:52868
I20260709 13:01:01.101764  1751 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:00.966077  8962 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:00.993518  8490 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.084512  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 86673.1us
I20260709 13:01:00.968884  8929 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:01.093302  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.137530  1743 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:01.122401  2311 raft_consensus.cc:606] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:01.089213  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:00.974315  8781 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:01.143167  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.128827  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:00.958514  8860 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
W20260709 13:01:01.139178  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50075us
I20260709 13:01:01.131249  8990 raft_consensus.cc:3055] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:00.969086  8967 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.168s
I20260709 13:01:01.083916  8885 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.009676  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:01.159879  1669 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:01.124991  8914 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:01.156833  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:01.153244  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.127475  8694 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:00.996153  8938 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.152s
I20260709 13:01:01.163843  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.090526  8963 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:01.170328  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.113979  8966 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.178701  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:01.014842  8844 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.137s
I20260709 13:01:01.151336  8796 raft_consensus.cc:2764] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:01:01.154930  8603 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:01.155498  8893 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.143639  8781 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:01.156926  8990 raft_consensus.cc:740] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:01.126814  8776 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.138103  8490 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:01.182113  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.159938  8887 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:01:01.083740  8744 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:01.231887  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49901.4us
I20260709 13:01:01.248962  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:01.216954  8911 consensus_meta.cc:287] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.610s	user 0.016s	sys 0.000s
I20260709 13:01:01.165854  8976 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:01.264061  1745 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:01.230873  1669 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:01.239753  1748 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:01:01.177215  8975 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:01:01.173697  8885 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:01.181277  8931 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:01.160282  8804 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:01:01.212693  8770 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.218385  8781 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.213318  8893 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:01.235095  8796 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:01.181486  8963 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.238288  8694 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:01.213431  8842 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 13:01:01.279989  8931 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:01.267115  8993 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.264837  8976 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:01.267591  8955 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.236835  8794 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.329129  8963 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:01.322535  8976 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:01.330385  8794 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:01.249429  8760 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:01:01.250648  8603 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:01:01.315750  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.294298  8921 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:01.279381  8876 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:01.289898  8770 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:01.294265  8796 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:01.326959  8744 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.298127  8967 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:01.294094  8893 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.333035  8490 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:01.341023  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 374067us
W20260709 13:01:01.341372  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 169678us
I20260709 13:01:01.362989  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.346704  1744 raft_consensus.cc:2368] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20.
I20260709 13:01:01.313815  8931 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.264169  8962 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.349582  8876 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.356026  8796 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.333026  8975 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.340718  8935 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:01.322788  8993 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.356803  8967 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:01.382792  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.348001  8942 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:01.366122  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.334508  8937 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:01.389040  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 210550us
I20260709 13:01:01.385851  8935 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:01.359681  8894 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.325214  8914 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.381973  8876 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:01.299232  8990 consensus_queue.cc:260] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:01.353070  8921 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:01.411248  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 162449us
I20260709 13:01:01.452880  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.398241  8975 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:01.421795  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 55775.1us
I20260709 13:01:01.425631  8860 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:01.455844  8955 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.456266  8860 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:01.426213  8627 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:01:01.457227  9015 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:01.395180  8966 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.462826  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.438335  8937 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.439463  1749 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:01.440703  8942 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.443622  8935 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.445066  8770 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:01.453547  8921 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:01.384907  8844 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:01.456662  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.483907  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.484426  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.478583  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.485018  1602 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:01.485234  1601 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:01:01.485523  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.486343  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.487011  1602 pending_rounds.cc:85] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 10
I20260709 13:01:01.487416  1602 pending_rounds.cc:107] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:01:01.488057  1602 raft_consensus.cc:2889] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.488632  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.487012  1601 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:01.458020  9015 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:01.460664  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.461427  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.496560  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.471169  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.497247  1745 raft_consensus.cc:2376] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17. Re-sending same reply.
I20260709 13:01:01.472146  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.498278  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.498574  1751 raft_consensus.cc:2393] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:01.471875  8794 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:01.475190  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:01.500197  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.500855  2311 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:01.465651  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.476332  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.477113  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:01.502321  1747 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:01.502354  1748 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:01.502898  2309 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:01.482429  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.504472  1594 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:01.504700  1595 pending_rounds.cc:85] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 8
I20260709 13:01:01.505092  1595 pending_rounds.cc:107] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:01:01.505394  1595 raft_consensus.cc:2889] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.505270  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.505626  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.482735  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:01.506309  1751 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:01.504112  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.506712  1596 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:01.506949  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:01.507889  1745 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:01.491864  1743 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:01:01.492113  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.484395  8490 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.521399  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.457944  8627 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:01.510039  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:01.511257  1601 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:01:01.525009  1599 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.499117  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.434901  1669 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:01.525013  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.526060  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:01.527690  1747 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 15.
I20260709 13:01:01.528046  1601 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:01.528679  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.531672  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:01.493137  8917 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:01.494964  8935 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:01.537537  1752 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:01.537914  1743 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:01:01.534245  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.534760  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:01.556464  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 146843us
I20260709 13:01:01.508185  8966 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:01.564002  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.500447  8794 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.565932  1748 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:01.503926  8776 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:01.531706  8490 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:01.588335  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.589053  1752 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:01.590803  8963 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.591456  8963 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.593755  8963 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:01.594282  8802 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 13:01:01.594696  1594 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:01:01.519338  9018 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:01.524580  8627 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:01.605047  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.539992  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:01.581100  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 46481.9us
I20260709 13:01:01.583367  1599 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:01:01.607271  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:01.608223  1599 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:01.493119  9017 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:01:01.578485  1596 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:01.538800  1747 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:01:01.617699  1747 pending_rounds.cc:85] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 11
I20260709 13:01:01.618090  1747 pending_rounds.cc:107] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:01:01.560972  8917 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.572268  8966 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.602697  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:01.538775  8955 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:01.618672  1747 raft_consensus.cc:2889] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.623446  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.609282  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.524451  9019 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:01:01.627753  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.594791  8802 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:01.595109  8794 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:01.648630  9020 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.200s	user 0.000s	sys 0.002s
I20260709 13:01:01.650291  8627 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:01.583141  8975 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:01.642673  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:01.596436  8490 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:01.598624  9018 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.644158  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:01.595108  9031 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:01.642046  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.668988  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:01.653239  1749 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:01.608409  8776 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.518200  8860 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.658665  1752 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:01.647434  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.660959  1599 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:01.651943  8627 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:01.663319  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 58390.6us
I20260709 13:01:01.665602  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:01.627151  8917 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.648205  1673 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.564438  9015 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:01.669936  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:01.670413  2279 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.670959  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:01.692183  2314 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.692360  9014 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:01.692404  2310 raft_consensus.cc:2410] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:01.692883  9014 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:01.693367  9014 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:01.637501  8966 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.642923  8955 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.676596  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.683069  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:01.683984  1752 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:01.660461  8770 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:01.672425  9018 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.636910  9032 consensus_queue.cc:1048] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:01.611439  8921 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:01:01.669814  1747 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:01.690117  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:01.688457  9017 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:01.655864  9029 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:01.705756  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.709038  8955 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.677974  8961 raft_consensus.cc:2764] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
W20260709 13:01:01.469117  8694 consensus_queue.cc:1175] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "570958eb733a4af7ae16ae020998c8b4" responder_term: 23 status { last_received { term: 22 index: 16 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:01.681495  8490 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:01.725766  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:01.707398  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:01.688474  9028 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:01.747112  9028 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.749130  9028 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:01.750715  8929 raft_consensus.cc:2764] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:01:01.728204  9017 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:01.714494  8894 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:01.729022  8914 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:01.736867  1752 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:01.737898  1603 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:01:01.721921  9031 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:01.682407  8776 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.739137  1747 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:01.740046  1673 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:01.727555  8921 consensus_queue.cc:1243] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:01.741483  2314 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:01:01.725378  8770 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:01.758754  8894 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.768999  8894 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.708289  9019 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:01:01.755859  8885 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:01.674371  8963 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:01.711015  8796 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.737342  8975 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:01:01.747316  9034 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:01:01.748045  9026 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:01:01.761912  9031 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.743328  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:01.787313  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 92254.4us
I20260709 13:01:01.738263  8964 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:01:01.752351  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45055us
I20260709 13:01:01.804401  8490 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:01.766379  8770 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.828883  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:01:01.832150  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 88908.5us
I20260709 13:01:01.835575  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:01.837119  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.812255  8885 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:01.840193  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.840703  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.840349  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.843403  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.845669  2314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "979e85778d254fc7a74198c589e12967"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:52868
I20260709 13:01:01.846354  2314 raft_consensus.cc:606] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:01.846697  2314 raft_consensus.cc:614] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:01.847690  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.856344  1674 raft_consensus.cc:2410] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:01:01.856706  1671 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:01.856858  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:01.833815  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 101528us
I20260709 13:01:01.817659  8975 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.857438  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.860219  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.860515  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.858112  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:01.856292  8885 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:01.863267  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:01.871340  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.871665  1671 raft_consensus.cc:2393] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:01.864192  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.875605  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.876104  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.876955  1670 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:01.879058  9047 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:01.857438  9027 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:01.840778  8962 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:01.882213  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:01.831059  9031 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:01.880434  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.855906  8937 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:01.865619  8975 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:01.903450  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.904456  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.905900  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.910481  1672 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:01.890184  9036 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:01:01.908812  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:01.915812  1602 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:01.923660  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:01.892203  9047 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.820657  9017 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.926512  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:01.929395  1674 raft_consensus.cc:2376] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17. Re-sending same reply.
I20260709 13:01:01.901147  8937 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:01.928478  9046 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:01:01.932155  9050 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:01:01.966240  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:02.026536  8776 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:02.037048  1674 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:01:02.038448  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:01.991632  9034 log.cc:927] Time spent T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:01:01.925274  8490 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.022734  8937 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.061967  8964 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:02.062726  8964 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:01.988368  8917 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:01.931831  9047 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.082341  1675 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:02.082382  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:02.085213  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:02.085997  1600 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:02.063876  8964 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.092640  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.094148  1599 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:02.058597  9017 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:02.101101  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 75473.4us
I20260709 13:01:01.990264  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:02.128556  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:02.134428  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.149669  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:02.164762  8885 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.154744  8917 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.166178  8967 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.167615  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:02.168917  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:02.170469  8990 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:02.171674  9056 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.172521  9056 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:02.168917  8760 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:02.180320  8760 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.180500  8993 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:02.180797  8760 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:02.150540  8771 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:01:02.187026  8771 raft_consensus.cc:993] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
W20260709 13:01:02.144336  8781 consensus_meta.cc:287] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.009s
W20260709 13:01:02.189239  8893 consensus_meta.cc:287] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.812s	user 0.015s	sys 0.004s
I20260709 13:01:02.188683  8781 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.190117  8893 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.193758  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3405) took 1311 ms. Trace:
I20260709 13:01:02.196798  9021 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:02.197166  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:02.152114  9022 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.725s	user 0.000s	sys 0.005s
I20260709 13:01:02.200246  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.148432  8911 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:01:02.157646  8794 consensus_meta.cc:287] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.505s	user 0.017s	sys 0.002s
I20260709 13:01:02.153110  8964 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:02.252892  1750 rpcz_store.cc:276] 0709 13:01:00.882801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.903687 (+ 20886us) service_pool.cc:224] Handling call
0709 13:01:00.904097 (+   410us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:00.904983 (+   886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.905019 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:00.905969 (+   950us) log.cc:844] Serialized 78 byte log entry
0709 13:01:01.174490 (+268521us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:01.213444 (+ 38954us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.477898 (+264454us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.480650 (+  2752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.480756 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.826244 (+345488us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18001372c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:02.172256 (+346012us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b18001372c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:02.193417 (+ 21161us) raft_consensus.cc:1685] finished
0709 13:01:02.193451 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.193673 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22475,"prepare.queue_time_us":42890,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":7678,"raft.queue_time_us":56335,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":16366,"spinlock_wait_cycles":20491392,"thread_start_us":511599,"threads_started":2,"wal-append.queue_time_us":369703}
I20260709 13:01:02.167357  8967 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:02.183452  8876 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.011s
W20260709 13:01:02.215610  9054 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:01:02.293885  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 148802us
W20260709 13:01:02.215996  9048 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:01:02.221719  9014 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.012s
I20260709 13:01:02.225365  8781 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:02.229733  8931 consensus_meta.cc:287] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.842s	user 0.016s	sys 0.003s
I20260709 13:01:02.232142  8760 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.232717  8885 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:02.243418  1744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 3168) took 1313 ms (client timeout 1612 ms). Trace:
I20260709 13:01:02.243772  9046 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.248327  9044 raft_consensus.cc:1081] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:01:02.256143  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:02.179029  8894 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.255839  9021 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:02.259579  9033 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.263155  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:02.270757  9056 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.285574  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:02.273593  8794 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:02.337791  9018 consensus_meta.cc:287] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.005s
W20260709 13:01:02.338233  9028 consensus_meta.cc:287] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.008s
I20260709 13:01:02.342645  9047 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.284224  8911 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:02.315529  8876 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.350010  8931 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:02.398852  8935 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.008s
I20260709 13:01:02.344983  9014 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.411249  8894 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:02.413035  9061 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:01:02.384428  9028 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.406944  9021 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.419310  9021 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:02.411351  8893 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:02.424880  9047 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:02.425683  9060 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:01:02.426313  8911 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:02.429620  8955 consensus_meta.cc:287] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.689s	user 0.006s	sys 0.007s
I20260709 13:01:02.430608  8955 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:02.435243  8975 consensus_meta.cc:287] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.004s
I20260709 13:01:02.436269  8975 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.355669  9046 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:02.401544  8966 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.688s	user 0.014s	sys 0.002s
I20260709 13:01:02.381593  9018 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:02.404642  8976 consensus_meta.cc:287] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 1.074s	user 0.019s	sys 0.001s
I20260709 13:01:02.376560  9033 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.445079  8975 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.471486  9028 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:02.485234  9018 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.488338  9046 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.451742  8966 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.496608  8966 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:02.507647  9033 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:02.454370  8976 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.543139  8976 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:02.533411  9031 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.618s	user 0.014s	sys 0.003s
W20260709 13:01:02.534757  9027 consensus_meta.cc:287] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.634s	user 0.014s	sys 0.000s
I20260709 13:01:02.547251  9027 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:02.515390  9014 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:02.269917  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.320957  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.338801  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.329291  1600 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
W20260709 13:01:02.317651  1603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.033s	sys 0.031s
I20260709 13:01:02.258605  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:02.344136  1744 rpcz_store.cc:269] 0709 13:01:00.930457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.930750 (+   293us) service_pool.cc:224] Handling call
0709 13:01:02.243086 (+1312336us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540013ae54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:02.243322 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954077952}
I20260709 13:01:02.313627  2311 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:02.642877  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:01:02.549890  9031 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:02.583369  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 427294us
I20260709 13:01:02.603089  1670 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:01:02.644021  8937 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:02.586628  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.589634  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3362) took 1059 ms. Trace:
W20260709 13:01:02.652817  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.621016  8760 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:02.618206  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 293605us
I20260709 13:01:02.652617  1676 rpcz_store.cc:276] 0709 13:01:01.530360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.530505 (+   145us) service_pool.cc:224] Handling call
0709 13:01:01.530944 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.531382 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.531421 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.531986 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.064571 (+532585us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b1800286420. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:01:02.351063 (+286492us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:02.351129 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.351217 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.588302 (+237085us) raft_consensus.cc:1685] finished
0709 13:01:02.588420 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.589217 (+   797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16009,"raft.queue_time_us":7143,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3251,"spinlock_wait_cycles":3729792,"thread_start_us":286220,"threads_started":1,"wal-append.queue_time_us":847727}
W20260709 13:01:02.590993  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 441701us
I20260709 13:01:02.599439  1602 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:02.608894  1752 raft_consensus.cc:1240] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:02.595700  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3428) took 1023 ms. Trace:
I20260709 13:01:02.590705  1678 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:02.593638  1598 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:02.590860  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:02.659250  8921 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:02.598220  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.595973  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:02.642150  8955 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:02.600025  1603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.033s	sys 0.032s
I20260709 13:01:02.596589  1599 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:02.606658  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:02.626359  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3355) took 1679 ms. Trace:
I20260709 13:01:02.603745  1671 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
W20260709 13:01:02.683260  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.637125  8876 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.639039  8931 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:02.685034  1673 rpcz_store.cc:276] 0709 13:01:00.946790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.946901 (+   111us) service_pool.cc:224] Handling call
0709 13:01:02.625668 (+1678767us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400183dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:02.626025 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611363072}
I20260709 13:01:02.628752  8794 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.663412  8937 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:02.642418  8770 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.697224  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.702972  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.702952  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 3038) took 1207 ms. Trace:
W20260709 13:01:02.705474  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 115830us
I20260709 13:01:02.706094  1595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3032) took 1194 ms. Trace:
I20260709 13:01:02.704728  1676 raft_consensus.cc:2368] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:01:02.708062  9017 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:02.708940  9017 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:02.708361  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:02.712170  8490 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.713241  8490 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:02.692566  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54658 (request call id 3034) took 1197 ms. Trace:
I20260709 13:01:02.707090  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:02.720865  9021 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.721045  8770 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.721866  9021 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.722954  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3041) took 1192 ms. Trace:
I20260709 13:01:02.723363  1674 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:02.723505  1603 rpcz_store.cc:276] 0709 13:01:01.530231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.761478 (+231247us) service_pool.cc:224] Handling call
0709 13:01:01.762026 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.762310 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:01.772997 (+ 10687us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.722231 (+949234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.722348 (+   117us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:02.722475 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.722659 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.722886 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12438,"prepare.queue_time_us":11261,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3337,"thread_start_us":911399,"threads_started":1,"wal-append.queue_time_us":512391}
I20260709 13:01:02.725422  9021 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:02.718219  1598 rpcz_store.cc:276] 0709 13:01:01.492814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.313160 (+820346us) service_pool.cc:224] Handling call
0709 13:01:02.688681 (+375521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.721464  8935 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:02.705157  1594 rpcz_store.cc:276] 0709 13:01:01.495578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.505339 (+  9761us) service_pool.cc:224] Handling call
0709 13:01:02.702271 (+1196932us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b540023dcd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:02.702667 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203113216}
I20260709 13:01:02.665680  1749 rpcz_store.cc:276] 0709 13:01:01.587342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.682514 (+ 95172us) service_pool.cc:224] Handling call
0709 13:01:01.682835 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.685218 (+  2383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.685257 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.685831 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.823502 (+137671us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:01.823578 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.823692 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.594881 (+771189us) raft_consensus.cc:1685] finished
0709 13:01:02.594938 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.595326 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1915,"raft.queue_time_us":6055,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9900,"thread_start_us":137284,"threads_started":1,"wal-append.queue_time_us":218459}
I20260709 13:01:02.710924  9017 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.754828  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.752471  2279 leader_election.cc:400] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:01:02.763428  2279 leader_election.cc:403] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.768283  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.764480  8935 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:01:02.776957  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 70222.3us
I20260709 13:01:02.778141  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:02.778368  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:02.777248  2313 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:02.782819  8603 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:02.784152  8603 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.787983  8490 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.788550  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:02.789921  1673 raft_consensus.cc:2410] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:01:02.788784  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.706799  1595 rpcz_store.cc:276] 0709 13:01:01.492020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.492178 (+   158us) service_pool.cc:224] Handling call
0709 13:01:01.504444 (+ 12266us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:01.523237 (+ 18793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.523269 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:01.524001 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 13:01:01.653634 (+129633us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:01.737362 (+ 83728us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.741962 (+  4600us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.060582 (+318620us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b180030cb20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:02.080986 (+ 20404us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b180030cb20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:02.646002 (+565016us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b180030cb20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287
0709 13:01:02.646415 (+   413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.646584 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.646652 (+    68us) raft_consensus.cc:1685] finished
0709 13:01:02.646668 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.686005 (+ 39337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40470,"prepare.queue_time_us":179371,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4552,"raft.queue_time_us":174783,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":32740,"spinlock_wait_cycles":33234048,"thread_start_us":189078,"threads_started":3,"wal-append.queue_time_us":161749}
I20260709 13:01:02.794138  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:02.797171  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.755273  8921 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:02.799360  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:02.765071  9021 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:02.802822  1675 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:02.779304  8935 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:02.819818  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67919.1us
I20260709 13:01:02.820461  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.823498  1597 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:01:02.825237  8842 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:02.826120  8796 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:02.828002  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 49920.9us
I20260709 13:01:02.829905  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:02.832532  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.833514  8921 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:02.834431  1597 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:02.837353  8935 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.840684  1672 raft_consensus.cc:606] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:02.848699  1678 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:01:02.853212  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.867161  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:02.922314  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:02.923702  1676 raft_consensus.cc:2393] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:02.928830  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:02.930176  2310 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:02.931638  1602 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:02.931883  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 78869.6us
I20260709 13:01:02.936304  1595 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.938131  8844 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.938867  8844 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:02.941124  8964 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.657s	user 0.016s	sys 0.010s
W20260709 13:01:02.947923  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 118227us
I20260709 13:01:02.959571  2310 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
W20260709 13:01:02.958633  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 95267.7us
I20260709 13:01:02.947427  8844 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:02.964368  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:02.987387  8921 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:02.988303  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:02.989882  8921 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:02.990466  8921 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:02.991506  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:02.992252  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:03.006088  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.009282  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.014423  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:03.021706  9080 log.cc:927] Time spent T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 13:01:03.023765  1678 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:03.024106  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3037) took 1529 ms. Trace:
I20260709 13:01:03.025352  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.024531  1596 rpcz_store.cc:276] 0709 13:01:01.494213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.628655 (+134442us) service_pool.cc:224] Handling call
0709 13:01:01.629193 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.629681 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.629729 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.630428 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.809476 (+1179048us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b180040e460. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:01:02.842503 (+ 33027us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:02.842575 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.842743 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.023403 (+180660us) raft_consensus.cc:1685] finished
0709 13:01:03.023434 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.023891 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8739,"spinlock_wait_cycles":17660288,"thread_start_us":32494,"threads_started":1,"wal-append.queue_time_us":1210437}
I20260709 13:01:03.026952  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:03.028060  1596 raft_consensus.cc:2368] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:01:03.028919  8935 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:03.030148  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:03.005625  9021 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:01:03.032953  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.034121  1669 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.032440  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:02.985942  8603 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.032655  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:03.003604  8937 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:03.041975  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.042835  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.059674  1743 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:01:03.031450  8911 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.060019  8921 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.060976  8911 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.062191  8921 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:03.062996  8770 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:03.064007  9067 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.063844  8937 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.064980  9067 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.055398  1678 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:03.070827  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.073271  8964 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:03.074210  8964 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.074429  1595 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:01:03.076002  1595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:55880
I20260709 13:01:03.077562  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:03.089937  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.077010  1595 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:03.109869  1595 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.105886  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.066635  8937 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:03.118218  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.063475  8911 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:03.118952  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1591) took 1518 ms. Trace:
W20260709 13:01:03.128351  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59674us
I20260709 13:01:03.131302  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.140528  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:03.140919  1743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3421) took 1575 ms (client timeout 2066 ms). Trace:
I20260709 13:01:03.141629  1745 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:03.142555  8842 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:01:03.136677  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.128682  1752 rpcz_store.cc:276] 0709 13:01:01.590376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.800776 (+210400us) service_pool.cc:224] Handling call
0709 13:01:01.820549 (+ 19773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.680828 (+860279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.103981 (+423153us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54000d4654. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:03.108867 (+  4886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812374400}
W20260709 13:01:03.143936  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.141426  1743 rpcz_store.cc:269] 0709 13:01:01.565683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.565845 (+   162us) service_pool.cc:224] Handling call
0709 13:01:03.140652 (+1574807us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540013a954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:03.140819 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611275520}
I20260709 13:01:03.147749  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.148118  1597 raft_consensus.cc:1275] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:03.150794  1744 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:03.142551  1746 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:01:03.151381  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.157505  1599 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:03.136162  8844 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.171134  1594 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:03.175870  1745 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:03.176499  1594 raft_consensus.cc:1240] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: [20.14-22.15]
I20260709 13:01:03.177564  1674 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:01:03.179263  1674 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:03.179517  1673 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:03.142725  8961 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.192152  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:03.140393  9018 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:01:03.205471  1597 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:01:03.175956  9067 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.216787  1602 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:03.216466  1749 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:03.227460  1599 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:03.152539  9021 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:03.229305  1751 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:03.249528  1746 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:03.211880  8935 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:03.249706  1745 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:03.215626  8844 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.259984  1600 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:03.229878  8964 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.266268  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.272681  1671 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:03.274438  1602 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:01:03.276535  9084 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:01:03.278896  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46996 (request call id 3202) took 1066 ms. Trace:
I20260709 13:01:03.279704  8967 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:03.280558  8967 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.280450  8935 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.283641  8771 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
W20260709 13:01:03.289160  9081 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:01:03.292678  1750 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:03.262904  8961 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.298547  8844 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.298959  8961 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.302878  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:03.304939  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.258484  9067 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.307406  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.308496  1747 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:03.308106  9067 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.309691  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.306690  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.312672  9031 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.314725  8770 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:03.315492  8770 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.279421  1677 rpcz_store.cc:276] 0709 13:01:02.212631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.714875 (+502244us) service_pool.cc:224] Handling call
0709 13:01:02.718437 (+  3562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.739101 (+ 20664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.739138 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.773145 (+ 34007us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.951027 (+177882us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:03.212626 (+261599us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.212967 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.213115 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.278375 (+ 65260us) raft_consensus.cc:1685] finished
0709 13:01:03.278404 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.278637 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17,"prepare.queue_time_us":232682,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":5362,"raft.queue_time_us":322,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":12866,"thread_start_us":329341,"threads_started":2,"wal-append.queue_time_us":232370}
I20260709 13:01:03.318207  8770 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.322281  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.323318  1745 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:01:03.323668  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:03.311797  1751 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:03.280566  1743 raft_consensus.cc:1240] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:03.327587  1751 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:03.329185  8967 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.328858  1751 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.330492  1751 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:03.318166  9076 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
I20260709 13:01:03.332508  1501 catalog_manager.cc:5697] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.333585  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3036) took 1839 ms. Trace:
I20260709 13:01:03.306838  1596 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:03.306264  9089 log.cc:927] Time spent T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.052s	user 0.001s	sys 0.004s
I20260709 13:01:03.340274  1673 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:03.346743  1678 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:03.270787  1597 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:03.351889  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:03.354007  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:03.333499  8937 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:03.360559  8937 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:03.361943  8937 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:03.364077  9075 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:03.363250  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 17 to 20, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:03.364822  9075 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.365656  8770 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:01:03.365756  1501 catalog_manager.cc:5697] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 15 to 17, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.366863  8770 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:03.371330  1669 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:01:03.375774  1674 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:03.375053  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.381513  1750 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:01:03.342756  9031 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.336573  9067 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.394237  9075 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.398777  8961 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.334163  1601 rpcz_store.cc:276] 0709 13:01:01.493910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.539165 (+ 45255us) service_pool.cc:224] Handling call
0709 13:01:01.539698 (+   533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.562108 (+ 22410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.562142 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.564953 (+  2811us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.271085 (+706132us) spinlock_profiling.cc:243] Waited 894 us on lock 0x7b1800081820. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:01:02.775347 (+504262us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:01:02.800644 (+ 25297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.821550 (+ 20906us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.992314 (+170764us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800081820. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:03.317165 (+324851us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:03.333066 (+ 15901us) raft_consensus.cc:1685] finished
0709 13:01:03.333102 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.333341 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21956,"raft.queue_time_us":22722,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":31485,"spinlock_wait_cycles":28098944,"thread_start_us":459353,"threads_started":1,"wal-append.queue_time_us":1168881}
W20260709 13:01:03.400486  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 97868.9us
I20260709 13:01:03.400051  8964 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:03.374275  1501 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.423177  1751 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:01:03.421689  8961 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.427177  8961 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.428542  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.428943  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.429541  1750 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:03.429401  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.430235  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:03.431272  1746 raft_consensus.cc:2410] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:01:03.430244  1749 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:03.432458  9075 consensus_queue.cc:1059] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:03.433566  9075 consensus_queue.cc:1243] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:03.433724  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.434240  9075 raft_consensus.cc:3055] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:03.434592  1749 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.434708  9075 raft_consensus.cc:740] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:03.436775  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.436635  9075 consensus_queue.cc:260] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.438016  1746 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:03.438309  9075 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:03.430370  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.439656  1750 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:03.441274  9031 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.444334  9031 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.444582  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.453734  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:03.423840  1751 pending_rounds.cc:85] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 7
I20260709 13:01:03.485306  1501 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 18 to 20, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.490476  8603 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:03.490919  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:03.504033  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:03.503933  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:03.466670  1751 pending_rounds.cc:107] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:01:03.525343  1751 raft_consensus.cc:2889] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:03.491464  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.468251  1595 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:03.526993  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 60979.4us
I20260709 13:01:03.511121  1750 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:03.538805  1594 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:03.542438  8961 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:03.543432  8961 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.543577  8841 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:03.543964  1595 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:03.545343  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:03.546128  8961 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.535718  1749 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:01:03.491936  8603 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:03.546813  8961 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:03.493502  8771 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:03.473912  9031 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:03.537621  1501 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 13 to 15, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:03.492494  8770 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:01:03.550485  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.047s	sys 0.063s
W20260709 13:01:03.570123  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.048s	sys 0.064s
W20260709 13:01:03.570544  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 540300us
I20260709 13:01:03.501228  9077 consensus_queue.cc:1059] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:03.491950  9025 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:01:03.548004  8842 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:03.565785  8961 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:03.591483  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.553738  8603 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:03.566262  8771 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:03.604226  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.611053  8961 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:03.618708  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.566216  8964 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:03.622934  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.623651  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.623708  8603 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.625620  8603 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.627739  8771 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.597980  8770 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.623764  8961 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.630419  8770 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.490051  9075 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
W20260709 13:01:03.631800  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 85026.1us
I20260709 13:01:03.632526  9025 consensus_queue.cc:1243] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:03.633064  9025 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:03.633586  9025 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:03.634549  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:03.631963  9075 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:03.596017  8842 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.634824  9025 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:03.640491  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45225.8us
I20260709 13:01:03.640544  8967 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:03.646032  8842 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:03.636940  8844 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 13:01:03.652053  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 148291us
I20260709 13:01:03.652558  8961 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.637434  9075 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:01:03.655388  8921 consensus_meta.cc:287] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.003s
I20260709 13:01:03.673547  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:03.675680  8964 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:03.675774  9091 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:03.676437  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:03.693650  8935 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.689169  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:03.678424  9025 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.678880  8964 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:03.719630  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.724583  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:03.738101  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:03.719221  9031 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:03.744027  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 173369us
W20260709 13:01:03.748070  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.707973  9075 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.722107  8935 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.736088  8964 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:03.776962  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.781474  1677 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:03.784668  9097 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:03.783936  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.790144  8964 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:03.790624  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 69021.5us
I20260709 13:01:03.791733  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:03.793010  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.796555  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.796576  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.796499  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.804961  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:03.805773  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.806736  1676 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:03.806896  9092 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.808004  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:03.807890  9092 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.808708  1676 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:03.799611  8937 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:03.812454  8937 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.816080  1671 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:03.823529  1671 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:03.816612  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:03.817653  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.822960  1677 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:03.828722  9021 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.828989  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.829432  9021 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.785369  9097 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.751009  9031 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.811182  9092 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.821417  8964 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:03.850240  9021 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.840934  8796 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:03.851804  1671 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.815531  8937 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.822517  8771 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.856498  8771 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.856653  8842 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.859138  8842 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.859663  9100 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:03.859930  2309 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 24: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:03.853421  1671 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:03.865458  1676 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:03.876188  8841 raft_consensus.cc:3055] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:03.876766  8841 raft_consensus.cc:740] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:01:03.872215  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 72446.1us
I20260709 13:01:03.845263  9097 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:03.892359  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 100882us
I20260709 13:01:03.881001  9075 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.897765  1501 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 16 to 17, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:03.888139  8937 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.904886  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.907492  1747 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.913718  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.913878  9103 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:03.914928  1744 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:03.904808  8961 raft_consensus.cc:1064] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:03.920615  8841 consensus_queue.cc:260] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:03.925194  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 133702us
I20260709 13:01:03.924536  1501 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.933349  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:03.932883  9113 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.935118  9104 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
I20260709 13:01:03.926146  8921 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:03.935503  9113 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:03.936035  9021 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:03.936474  9021 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:03.938081  8935 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.937546  9021 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:03.938719  8937 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:01:03.939330  9021 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:03.941157  8937 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:03.943347  9113 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:03.943733  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.949160  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:03.950145  1673 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:03.907316  8490 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:03.950842  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.951367  8490 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:03.954661  8490 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:03.959959  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:03.960675  9109 log.cc:927] Time spent T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:03.963963  9017 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:03.964367  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:03.965186  9017 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:03.961988  9021 raft_consensus.cc:2764] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:01:03.886739  9100 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:03.965565  9017 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:03.970350  9031 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.045758  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:03.970736  8841 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:03.976928  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.047463  9100 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:04.037900  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 111587us
I20260709 13:01:03.979846  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 11 to 14, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:04.001825  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.052172  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.053846  1747 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:03.936681  8967 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:03.967667  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:03.920744  8961 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.040812  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:04.042757  1671 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:04.043267  1744 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 24.
W20260709 13:01:04.057488  9018 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:01:04.059090  9067 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.060859  9067 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:04.059237  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:04.062068  9017 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.063453  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.063750  9017 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:04.064366  1749 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:04.066397  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:04.072573  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 105092us
I20260709 13:01:04.076053  9100 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:01:04.075904  8967 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:04.077704  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.078251  8967 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.086694  1598 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:04.087595  1594 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:01:04.087524  1749 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:04.090384  1594 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:04.092142  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:04.094296  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.094404  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.095188  1594 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:04.031952  8490 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 13:01:04.100137  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.118677  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 65614.5us
W20260709 13:01:04.131681  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 73154.3us
I20260709 13:01:04.133443  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.136400  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 215) took 11104 ms. Trace:
W20260709 13:01:04.140625  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63134.4us
I20260709 13:01:04.141268  1598 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:04.141444  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.142724  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.124589  9100 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:04.145387  1747 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:04.092164  9097 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.147962  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.148494  9097 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.148692  1750 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
W20260709 13:01:04.149519  2281 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.149394  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.152782  1594 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:04.153092  1747 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:04.153203   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:04.143442  1603 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
W20260709 13:01:04.161202  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.164197  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.159687  8796 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:01:04.203912  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.183401   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:04.169325  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.188143  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.205957  1750 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:04.206780  9092 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.136945  1497 rpcz_store.cc:276] 0709 13:00:53.037286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.087923 (+ 50637us) service_pool.cc:224] Handling call
0709 13:01:04.136105 (+11048182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:59.842686 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:59.933939 (+ 91253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:59.937856 (+  3917us) write_op.cc:435] Acquired schema lock
0709 13:00:59.940791 (+  2935us) tablet.cc:662] Decoding operations
0709 13:01:00.053935 (+113144us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:00.054032 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:00.054064 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:00.055436 (+  1372us) tablet.cc:701] Row locks acquired
0709 13:01:00.055458 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:00.075756 (+ 20298us) write_op.cc:270] Start()
0709 13:01:00.075980 (+   224us) write_op.cc:276] Timestamp: P: 1783602060075649 usec, L: 0
0709 13:01:00.076016 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:01:00.077147 (+  1131us) log.cc:844] Serialized 4418 byte log entry
0709 13:01:00.527868 (+450721us) op_driver.cc:464] REPLICATION: finished
0709 13:01:00.660438 (+132570us) write_op.cc:301] APPLY: starting
0709 13:01:00.660580 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:01.064929 (+404349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:01.065072 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:02.089632 (+1024560us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:02.191425 (+101793us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:01:02.191475 (+    50us) write_op.cc:312] APPLY: finished
0709 13:01:02.191868 (+   393us) log.cc:844] Serialized 105 byte log entry
0709 13:01:02.334207 (+142339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.361492 (+ 27285us) write_op.cc:454] Released schema lock
0709 13:01:02.375022 (+ 13530us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:02.405960 (+ 30938us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.441744 (+ 35784us) write_op.cc:454] Released schema lock
0709 13:01:02.479466 (+ 37722us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180022ca80. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
Metrics: {"mutex_wait_us":7343,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":132143,"apply.run_cpu_time_us":47283,"apply.run_wall_time_us":1730564,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":291076,"prepare.run_cpu_time_us":33153,"prepare.run_wall_time_us":342084,"raft.queue_time_us":76466,"raft.run_cpu_time_us":23080,"raft.run_wall_time_us":96756,"replication_time_us":429275,"spinlock_wait_cycles":4080896,"thread_start_us":611179,"threads_started":5,"wal-append.queue_time_us":353712,"wal-append.run_cpu_time_us":57779,"wal-append.run_wall_time_us":2287533}]]}
I20260709 13:01:04.196733  9031 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:04.169044  1749 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 13: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:04.205891  1747 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:01:04.210417  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:04.193280  1745 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:01:04.208082  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.211328  1673 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:04.213402  1752 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:04.209398  9031 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:04.214318  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:04.215320  1672 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:04.207427  9092 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.215268  9031 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.217665  9031 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.218479  9092 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.219930  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:04.220327  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.220752  1671 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:04.223202  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:04.224349  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.227968  1675 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:01:04.234256  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.235699  8796 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:04.236223  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.242125  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:04.242946  2309 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:01:04.244138  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:04.247018  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.252103  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.252240  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:04.252969  9067 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:04.240671  9092 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:04.253742  9067 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:04.253882  9092 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.255064  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:04.255249  8961 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:04.255519  2309 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:04.253216  9121 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:04.256878  9121 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:04.255064  9067 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.258210  9121 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.249971  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:04.252375  1671 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:04.263006  2279 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:04.256445  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:04.256008  8937 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:04.271148  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.271121  8961 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:04.272099  8961 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.272627  8961 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:04.267974  9075 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:04.287411  8796 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:04.288293  8796 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.288645  9120 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.289211  9075 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:04.289573  9120 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.290390  9075 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.290783  8796 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:04.288622  9106 raft_consensus.cc:2804] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:04.292418  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:04.292896  9120 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:04.294724  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:04.295574  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.295719  8490 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:04.296689  8490 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:04.299600  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:04.251186  9100 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:04.297788  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:04.256918  9092 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:04.293015  9106 raft_consensus.cc:697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:04.303777  8603 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:04.305540  8937 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:01:04.308344  8603 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.308786  8603 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.310937  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:04.303350  9120 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:04.312168  9120 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:04.317169  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.318051  1675 raft_consensus.cc:2376] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20. Re-sending same reply.
I20260709 13:01:04.317351  2309 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:01:04.318630  2309 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 11
I20260709 13:01:04.318926  2309 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.12
I20260709 13:01:04.319267  2309 raft_consensus.cc:2917] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Aborting config change with OpId 18.12: Aborted: Op aborted by new leader
I20260709 13:01:04.320413  2313 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:04.315239  9120 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.321743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:04.323590  2309 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:04.328939  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.332321  1672 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:04.366277  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.371855  9100 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:04.372305  8770 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:04.372424  9106 consensus_queue.cc:237] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.373152  9100 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:04.373628  9100 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:04.374780  9100 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.376434  8796 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.377409  9100 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.377141  8796 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.377933  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.379516  9021 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:04.382227  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.375120  9119 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:04.387220  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:04.393785  8490 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:04.394870  8967 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:04.398518  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:04.399721  9092 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:04.412860  8490 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.414379  8490 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:04.414935  8490 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:04.379448  8796 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:04.410943  9092 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:04.429237  9092 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:04.431159  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.431772  9119 consensus_queue.cc:1048] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:04.441566  9017 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:04.443179  9017 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:04.430694  9092 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:04.454924  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.402520  9121 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:01:04.458184  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71100.8us
W20260709 13:01:04.458591  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.459945  9132 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:01:04.460493  9091 consensus_queue.cc:1059] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:04.416198  8490 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.460757  8603 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.469467  9018 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:04.476627  9018 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:01:04.474159  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 78720.7us
W20260709 13:01:04.476677  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45630us
I20260709 13:01:04.478241  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.482297  8603 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.474838  9017 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:01:04.485109  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.486421  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:04.487118  1744 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.478241  9091 consensus_queue.cc:1243] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:04.494074  9103 consensus_queue.cc:1059] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:04.494414  9119 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:04.495929  9017 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:04.495762  9103 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:04.496371  9017 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:04.497206  9103 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:04.497641  9103 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:04.497428  9017 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.498947  9017 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:04.498569  9103 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.500330  9103 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.501390  1744 raft_consensus.cc:2468] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:01:04.482111  9018 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.503036  1673 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:01:04.509809  2279 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:04.514187  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:04.518265  8490 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:04.536566  9136 raft_consensus.cc:2764] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
W20260709 13:01:04.555022  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.561170  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 83077.4us
I20260709 13:01:04.515411  8771 raft_consensus.cc:2804] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:04.552073  9018 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:04.510993  9091 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:01:04.588135  8961 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.590055  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.591799  8961 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:04.580816  8771 raft_consensus.cc:697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:01:04.596582  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.593539  8771 consensus_queue.cc:237] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:04.603292  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 89249us
I20260709 13:01:04.613242  9091 consensus_queue.cc:1243] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:04.613914  9031 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:04.621476  9151 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:04.622027  9119 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:04.627873  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:04.628698  1671 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:04.633621  9146 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:01:04.622371  9097 raft_consensus.cc:3055] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:04.647703  9021 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:04.648288  9021 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:04.649682  9100 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:04.650322  9100 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.649313  9021 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.640617  9097 raft_consensus.cc:740] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:04.657457  8931 raft_consensus.cc:1027] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: attempt to promote peer 570958eb733a4af7ae16ae020998c8b4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:01:04.657956  8961 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:04.666114  9148 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:04.682128  9148 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:04.682684  9148 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:04.683440  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.670790  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.639024  9151 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:04.674736  1671 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:04.676002  9021 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:04.691461  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.692749  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:04.694864  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90278.5us
I20260709 13:01:04.697151  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.702745  1744 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:04.703706  9017 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:04.704743  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:04.705444  2309 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:04.705744  2309 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:04.706194  9097 consensus_queue.cc:260] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.706686  2309 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.707769  9097 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:04.709539  9075 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:04.701062  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:04.712908  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:04.714134  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:04.715093  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.701565  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:04.715811  1743 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:04.718117  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.714815  1751 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 25.
I20260709 13:01:04.720806  2309 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.727190  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:04.723135  9017 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:04.732391  9017 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.732806  9017 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:04.732409  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.736027  9151 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.737550  9151 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:04.740396  1748 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:04.744424  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:04.745958  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:04.749820  9100 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:04.757014  9017 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:04.759509  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.766723  9017 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.784420  1743 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 25.
I20260709 13:01:04.790913  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:04.790536  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:04.792491  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.795123  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.795531  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:04.795933  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.796675  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.795920  1603 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:04.799032  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.800104  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.800320  1747 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:01:04.793897  1566 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Timed out: RequestConsensusVote RPC to 127.0.107.195:43001 timed out after 1.612s (SENT)
I20260709 13:01:04.801530  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.801789  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.803253  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:04.804261  2309 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 13:01:04.804471  1745 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:04.812039  1744 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:04.797782  9018 raft_consensus.cc:2764] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:04.778769  8961 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:01:04.835284  9100 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:04.837846  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:04.840344  1750 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:04.840471  8931 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:04.841346  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.794957  9075 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:01:04.826614  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:04.840236  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:04.851442  1599 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:01:04.852902  1596 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:04.854120  1675 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:01:04.849014  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.849851  1746 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:04.848660  1670 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:01:04.854624  2309 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:01:04.853235  2313 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:04.859792  8796 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.860245  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.860545  8796 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.841172  8931 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:04.862178  8931 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:04.863175  8796 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.863961  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.872588  1600 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:04.864748  1671 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:04.865114  9139 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:04.865254  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.861019  1603 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:04.890116  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.890956  1596 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:04.808425  9092 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:01:04.841498  8490 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:04.923413  8937 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 12 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:04.895670  9106 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.936383  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:04.947196  1670 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:04.906257  9018 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:01:04.954891  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 105999us
I20260709 13:01:04.956274  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:04.961378  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:04.920312  9121 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.964570  1599 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.968494  9152 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:04.970348  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:04.941937  9141 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:04.974685  9119 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:04.975193  9119 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.950539  8770 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:01:04.975696  9119 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.962852  9103 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:01:04.962495  9017 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:04.999881  9156 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.187s	user 0.002s	sys 0.000s
I20260709 13:01:04.979172  9148 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.910048  9139 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.942493  8490 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.962648  8603 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.017130  1671 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:05.027504  1600 raft_consensus.cc:2410] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:01:05.027995  1599 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:01:04.969233  9152 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.031788  1603 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:05.035406  1596 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:04.951232  9106 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:05.038146  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.038972  1599 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:01:04.966594  9151 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:05.043560  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.044689  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.052175  9148 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:05.052258  9018 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:05.029829  9139 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:05.036717  8603 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:05.056190  9031 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:05.058446  8603 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.036999  9077 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.060338  9077 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:04.981308  9141 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.063318  9077 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.065331  9106 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:04.981500  9121 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:05.045233  9157 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:05.068297  9121 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:05.070626  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.071570  1671 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 20.
I20260709 13:01:05.071794  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:05.072800  9139 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:05.073230  9141 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:05.074597  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.075362  1601 raft_consensus.cc:2376] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20. Re-sending same reply.
I20260709 13:01:05.076411  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.076547  9151 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:05.077075  1601 raft_consensus.cc:2376] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19. Re-sending same reply.
I20260709 13:01:05.077473  9018 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:05.078346  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.078692  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.038584  9152 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:05.079218  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.076078  9119 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.080345  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.081043  1601 raft_consensus.cc:2376] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15. Re-sending same reply.
I20260709 13:01:05.077813  9151 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:05.082221  9119 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.082093  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.082496  9151 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:05.083055  1601 raft_consensus.cc:2376] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15. Re-sending same reply.
I20260709 13:01:05.063190  8490 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:05.078568  9018 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:05.049763  1603 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:05.083359  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:05.093618  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.103413  1671 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:01:05.094966  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.094134  1675 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:05.095242  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:05.096026  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.097113  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.107465  2309 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:01:05.107924  2309 pending_rounds.cc:85] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 11
I20260709 13:01:05.096755  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.108187  2309 pending_rounds.cc:107] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:05.108464  2309 raft_consensus.cc:2889] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.104780  1673 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 25.
I20260709 13:01:05.099941  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.109753  2313 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:05.086279  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:05.105726  1676 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.113255  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.114187  1603 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:05.115869  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.116703  1596 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:05.084117  9018 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:05.118949  9018 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.084488  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.094640  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.120872  1671 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:01:05.120380  1601 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:05.086691  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.122241  1599 raft_consensus.cc:2376] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20. Re-sending same reply.
I20260709 13:01:05.099229  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.112380  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:05.125541  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 207116us
I20260709 13:01:05.115139  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.130515  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:05.132942  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:05.133961  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:05.138500  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:05.140229  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.120343  9018 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:05.159646  9092 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:05.164647  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.169489  1599 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:05.169822  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.170517  1600 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:01:05.165810  1676 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 11.
I20260709 13:01:05.112398  8490 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:05.174817  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:05.175711  1752 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:05.176437  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.177211  1603 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 16: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:05.167773  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.157804  9021 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:05.178166  1601 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:05.186290  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 132) took 4059 ms. Trace:
I20260709 13:01:05.179823  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.187884  1596 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:05.185593  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.185814  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:05.183724  2309 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 12 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:05.189517  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.189757  1748 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.189639  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.190232  1671 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:05.191956  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:05.194967  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82746.7us
I20260709 13:01:05.196180  1599 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 25: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:05.196604  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.157807  9148 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:05.197233  1594 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:05.198635  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.201157  1749 raft_consensus.cc:1240] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:05.158007  8967 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:01:05.203390  1601 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:01:05.199394  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.205184  1596 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:05.205617  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.169893  9119 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:05.157785  9141 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:05.083874  9151 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.168290  9121 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:01:05.198949  9031 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:05.112035  9152 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.204882  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.236985  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.235656  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.186699  9021 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.251473  1599 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:05.252874  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.247406  9151 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:05.257905  1678 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:01:05.258422  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 54025.7us
I20260709 13:01:05.233757  1600 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:05.254237  1595 raft_consensus.cc:2410] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:05.250725  1603 raft_consensus.cc:2410] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:01:05.261068  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.262300  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:01:05.271811  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 103763us
I20260709 13:01:05.186743  1501 rpcz_store.cc:276] 0709 13:01:01.116857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.117043 (+   186us) service_pool.cc:224] Handling call
0709 13:01:05.176217 (+4059174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.216949 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:04.217934 (+   985us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:04.217994 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:01:04.218018 (+    24us) tablet.cc:662] Decoding operations
0709 13:01:04.219288 (+  1270us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:04.219439 (+   151us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:04.219467 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:04.238299 (+ 18832us) tablet.cc:701] Row locks acquired
0709 13:01:04.238356 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:01:04.238568 (+   212us) write_op.cc:270] Start()
0709 13:01:04.238765 (+   197us) write_op.cc:276] Timestamp: P: 1783602064238491 usec, L: 0
0709 13:01:04.238803 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:01:04.239602 (+   799us) log.cc:844] Serialized 4043 byte log entry
0709 13:01:04.500173 (+260571us) op_driver.cc:464] REPLICATION: finished
0709 13:01:04.601025 (+100852us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f947e3830ac 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f9484ec3ef0
0709 13:01:04.687558 (+ 86533us) write_op.cc:301] APPLY: starting
0709 13:01:04.696943 (+  9385us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:05.046384 (+349441us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:05.046434 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:05.106840 (+ 60406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:05.107260 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:01:05.107347 (+    87us) write_op.cc:312] APPLY: finished
0709 13:01:05.107829 (+   482us) log.cc:844] Serialized 97 byte log entry
0709 13:01:05.109439 (+  1610us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:05.109611 (+   172us) write_op.cc:454] Released schema lock
0709 13:01:05.109694 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:05.110226 (+   532us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:05.118862 (+  8636us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":317538,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":154132,"apply.run_cpu_time_us":23831,"apply.run_wall_time_us":425026,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":142359,"prepare.run_cpu_time_us":14895,"prepare.run_wall_time_us":135150,"raft.queue_time_us":98827,"raft.run_cpu_time_us":8164,"raft.run_wall_time_us":116750,"replication_time_us":261161,"spinlock_wait_cycles":19851520,"thread_start_us":288676,"threads_started":4,"wal-append.queue_time_us":143150}]]}
I20260709 13:01:05.279652  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.280036  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.176354  8937 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:01:05.283464  1600 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.247996  1496 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 18, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:05.284015  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.284211   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:05.179154  9103 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:01:05.296773  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.297819  1743 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:01:05.281746  9157 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:01:05.300554  1603 raft_consensus.cc:2410] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:01:05.252921  9021 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:05.311493  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.231248  8961 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:01:05.277463  9119 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.301079  9127 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:05.327157  1601 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:05.324813  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.327883  1599 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:05.328152  1747 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:01:05.329022  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.329130  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:05.329874  1743 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:01:05.331194  1601 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:01:05.331763  1601 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 11
I20260709 13:01:05.332163  1601 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.12
I20260709 13:01:05.332790  1601 raft_consensus.cc:2917] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Aborting config change with OpId 18.12: Aborted: Op aborted by new leader
I20260709 13:01:05.333426  1601 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.340060  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:05.342926  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:05.344334  1600 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:05.285108  9067 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:01:05.347492  1599 raft_consensus.cc:1240] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:05.322747  9103 consensus_queue.cc:1243] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 570958eb733a4af7ae16ae020998c8b4 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:05.357270  1752 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:05.378968  1603 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:05.380436  1603 raft_consensus.cc:1275] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:05.327196  9092 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.381808  9092 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.384039  9092 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.350821  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:05.359318  1596 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:05.336222  9017 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:05.391470  1743 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:05.373792  1595 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:01:05.384043  9097 raft_consensus.cc:3055] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:05.362120  1600 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:05.398741  9097 raft_consensus.cc:740] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:05.400264  9097 consensus_queue.cc:260] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:05.404580  9075 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.405246  9075 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:05.355736  9164 raft_consensus.cc:3055] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:01:05.420269  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 69615.8us
I20260709 13:01:05.364342  9158 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:05.432557  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:05.331259  9119 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:05.375568  9141 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:01:05.443603  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 72230.9us
I20260709 13:01:05.416046  9174 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:01:05.437685  9133 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:05.416579  9164 raft_consensus.cc:740] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:05.248960  8967 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:05.434924  9139 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:05.476490  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.487774  1743 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:05.472308  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:05.430878  9176 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.489264  9176 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.461313  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.430547  9017 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:05.491082  1600 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:05.420441  9148 consensus_queue.cc:1059] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:01:05.493403  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60952.7us
W20260709 13:01:05.492981  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.496675  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:05.496809  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.442106  9158 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:05.449157  9077 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:05.501739  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:05.450371  9075 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.437491  8771 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
I20260709 13:01:05.507929  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:05.508553  1496 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:05.518904  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 59905.6us
I20260709 13:01:05.449795  9141 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.528575  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:05.500944  9077 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.499689  9139 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:05.543308  1496 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 21, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.517093  9100 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:05.544993  9106 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:01:05.529886  9148 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:05.521476  8841 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:05.546841  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.553535  1496 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 14 to 15, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:05.560171  1746 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
W20260709 13:01:05.559929  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 52124.7us
W20260709 13:01:05.557402  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.685s (SENT) [suppressed 55 similar messages]
I20260709 13:01:05.521240  9152 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.491611  9017 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.546033  9077 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.509588  9136 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:01:05.559922  8841 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.550616  9100 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.586243  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.590766  1603 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:01:05.577144  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.592657  1600 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
W20260709 13:01:05.568385  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60466.9us
I20260709 13:01:05.578475  1496 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 20, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.569430  1594 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:05.588965  1748 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:05.576388  9169 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:05.608855  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.609841  1594 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:05.632948  1496 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 18, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.582682  2311 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 13 to 15, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:05.590240  8841 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:05.597312  9152 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:05.600704  8603 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.639014  9168 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:01:05.607694  9169 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:05.638854  9163 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:01:05.680085  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.686817  1595 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.677291  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.599449  9100 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:01:05.640704  9172 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 13:01:05.640038  9171 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 13:01:05.638590  9170 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:01:05.684641  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.636459  9167 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:05.646544  1496 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:05.691632  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:05.742830  1596 raft_consensus.cc:3060] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:05.749473  1603 raft_consensus.cc:2368] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:01:05.680603  9119 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.546541  9164 consensus_queue.cc:260] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:05.737639  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 180359us
I20260709 13:01:05.693666  9169 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:05.685150  9176 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:05.754010  8931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.017s
I20260709 13:01:05.575795  9158 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.795228  1674 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:05.799043  1595 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:05.800529  1603 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:05.801484  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.690653  8603 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:05.803426  1595 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:05.685312  9152 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:05.805663  1715 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.643s (SENT)
W20260709 13:01:05.787649  8931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.018s
I20260709 13:01:05.828540  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.774341  1673 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 13 to 15, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:05.838172  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.838979  1748 raft_consensus.cc:2393] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:05.840847  1596 raft_consensus.cc:2468] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 24.
I20260709 13:01:05.844218  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.847658  1594 raft_consensus.cc:1275] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:01:05.847678  1677 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:05.830497  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.849025  1595 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:01:05.779891  9148 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:05.746788  9139 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.857146  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.750828  9167 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.833129  9119 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.858480  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:05.871253  1596 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 20.
W20260709 13:01:05.862303  9182 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:01:05.869145  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:05.855952  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:05.851826  9168 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:01:05.854496  9018 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.000s
I20260709 13:01:05.874886  1674 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
W20260709 13:01:05.884078  9187 log.cc:927] Time spent T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:01:05.885123  9165 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
W20260709 13:01:05.886482  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.886919  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3594) took 1093 ms. Trace:
I20260709 13:01:05.888412  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:05.888592  9194 consensus_queue.cc:1048] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:05.887478  1597 rpcz_store.cc:276] 0709 13:01:04.793157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.797266 (+  4109us) service_pool.cc:224] Handling call
0709 13:01:04.809178 (+ 11912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.902738 (+ 93560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.902792 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.943683 (+ 40891us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.144020 (+200337us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:05.144082 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.144197 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.886631 (+742434us) raft_consensus.cc:1685] finished
0709 13:01:05.886662 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.886839 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13485,"raft.queue_time_us":20468,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":223485,"threads_started":2,"wal-append.queue_time_us":379920}
I20260709 13:01:05.891077  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:05.894541  9152 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:05.900426  9195 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:05.900213  9148 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.894544  8841 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:05.904469  8841 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:05.905448  9184 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:01:05.876242  1595 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:05.911448  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3595) took 1118 ms. Trace:
I20260709 13:01:05.862493  8603 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.912078  1602 rpcz_store.cc:276] 0709 13:01:04.793497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.793745 (+   248us) service_pool.cc:224] Handling call
0709 13:01:04.802754 (+  9009us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:04.824961 (+ 22207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.825003 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:04.871817 (+ 46814us) log.cc:844] Serialized 52 byte log entry
0709 13:01:05.158263 (+286446us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:05.158318 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.158405 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.911187 (+752782us) raft_consensus.cc:1685] finished
0709 13:01:05.911210 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.911382 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10193,"raft.queue_time_us":32011,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":238,"thread_start_us":225772,"threads_started":1,"wal-append.queue_time_us":327673}
W20260709 13:01:05.909446  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0883069550000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23260000000000003s for a response
W20260709 13:01:05.941113  1566 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.524s (SENT)
I20260709 13:01:05.941970  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:05.943037  2314 raft_consensus.cc:2368] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:05.942837  9097 raft_consensus.cc:3060] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:05.947875  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:05.948911  1744 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
W20260709 13:01:05.950249  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 157156us
W20260709 13:01:05.954589  9021 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.630s	user 0.013s	sys 0.000s
I20260709 13:01:05.955163  9021 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:05.957469  9021 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.962044  9167 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:05.914120  9141 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:05.971812  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 321185us
I20260709 13:01:05.976688  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:05.879320  9119 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.009243  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:06.012316  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:06.032166  9119 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:05.998803  9018 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:06.033308  9018 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.033847  9018 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:06.036504  9151 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.004s
W20260709 13:01:06.039011  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 98001.5us
W20260709 13:01:06.047570  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 180185us
I20260709 13:01:06.053043  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:06.073104  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3591) took 1280 ms. Trace:
I20260709 13:01:06.080349  2279 leader_election.cc:400] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for earlier term 19. Current term is 20.
I20260709 13:01:06.022502  9121 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:01:06.088848  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:06.059095  8771 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:06.089680  2314 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:01:06.090479  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.073844  1598 rpcz_store.cc:276] 0709 13:01:04.792172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.794748 (+  2576us) service_pool.cc:224] Handling call
0709 13:01:04.804344 (+  9596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:04.828730 (+ 24386us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:04.962797 (+134067us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.169481 (+206684us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.169721 (+   240us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:05.172298 (+  2577us) log.cc:844] Serialized 52 byte log entry
0709 13:01:05.172479 (+   181us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:05.173496 (+  1017us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.175761 (+  2265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.175844 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.246393 (+ 70549us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18003256c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a03f3 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:05.395385 (+148992us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18003256c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:05.407948 (+ 12563us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b18003256c0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:06.072810 (+664862us) raft_consensus.cc:1685] finished
0709 13:01:06.072848 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.073035 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94327,"prepare.queue_time_us":426741,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":3336,"raft.queue_time_us":33727,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":12724,"spinlock_wait_cycles":27998080,"thread_start_us":274709,"threads_started":2,"wal-append.queue_time_us":307988}
W20260709 13:01:06.110212  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.098397  9188 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.100555  8771 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.129069  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:06.110594  9199 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:06.151098  9198 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:06.158527  9198 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.161372  9198 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:06.135883  8771 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:06.164245  9186 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.619s	user 0.004s	sys 0.000s
W20260709 13:01:06.171572  9202 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:01:06.137176  9188 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.154851  9199 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:06.190618  9203 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:01:06.186632  9199 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:06.205663  9188 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.208422  9077 consensus_meta.cc:287] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.001s
I20260709 13:01:06.209116  9077 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.213445  8967 raft_consensus.cc:1064] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:06.240690  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:01:06.246827  9100 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.003s
I20260709 13:01:06.274523  9100 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.250571  1671 raft_consensus.cc:1275] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:01:06.284884  1671 pending_rounds.cc:85] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 11
I20260709 13:01:06.285171  1671 pending_rounds.cc:107] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:06.285398  1671 raft_consensus.cc:2889] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.296918  9100 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.182665  9169 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.314419  9169 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:06.272823  9077 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.283947  9221 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.248865  8967 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.316409  9221 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.317273  9221 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.328404  8490 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:06.329198  8490 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:06.330385  8490 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.334355  9190 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.334997  9190 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.230449  9018 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.335932  9199 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.344787  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:06.346339  1603 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:06.347915  2311 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:06.351164  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:06.352105  1603 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:06.354866  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:06.356139  1600 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:06.357095  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:06.358985  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 319212us
I20260709 13:01:06.337172  9031 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:06.349299  9158 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:06.349812  9100 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.386644  1603 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
W20260709 13:01:06.370302  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.370220  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3099) took 1306 ms. Trace:
I20260709 13:01:06.392145  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:06.391273  1715 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.581s (SENT)
I20260709 13:01:06.393309  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.390450  1599 rpcz_store.cc:276] 0709 13:01:05.064129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.354060 (+289931us) service_pool.cc:224] Handling call
0709 13:01:05.372413 (+ 18353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.373033 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:01:05.447580 (+ 74547us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.369801 (+922221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.369869 (+    68us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:01:06.369934 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.370012 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.370150 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":837189,"prepare.queue_time_us":74969,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":784111,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":139421,"threads_started":2,"wal-append.queue_time_us":186688}
I20260709 13:01:06.405870  1600 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:06.410245  9199 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.392305  9100 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:06.416326  9204 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.356s	user 0.006s	sys 0.001s
I20260709 13:01:06.416971  9190 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.418052  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:06.418810  1748 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:06.396095  9158 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.419747  9227 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.420416  9227 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.421190  9158 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:06.422405  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1720) took 1031 ms. Trace:
I20260709 13:01:06.422976  9227 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.394433  9031 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.415311  9100 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.426168  9031 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.404533  9121 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:06.423424  1671 rpcz_store.cc:276] 0709 13:01:05.390937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.391107 (+   170us) service_pool.cc:224] Handling call
0709 13:01:05.391376 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.285873 (+894497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.422084 (+136211us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400432454. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:06.422309 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975806336}
W20260709 13:01:06.442493  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51289.6us
I20260709 13:01:06.445865  9176 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:06.447808  9176 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:06.447659  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:06.453699  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:06.449406  9018 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.454550  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 62532.1us
I20260709 13:01:06.464371  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.467475  1748 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:01:06.471971  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:06.472950  1749 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.457312  9031 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:06.476758  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:06.470765  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:06.478564  1748 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:06.478645  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:06.479753  1743 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:06.452343  9176 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:06.508453  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:06.509567  1743 raft_consensus.cc:2393] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 11: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:06.477023  9067 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:06.501729  9139 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:01:06.514827  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50633.7us
W20260709 13:01:06.517635  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.516036  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 387287us
I20260709 13:01:06.522444  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:06.523494  1600 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:06.497165  8796 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:06.536998  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.541477  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:06.502761  9121 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:06.536466  9198 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.549866  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:06.542337  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:06.551026  9198 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:06.551450  1751 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:06.551611  9198 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.551654  1743 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:06.542286  1747 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:06.556280  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:06.561817  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:06.563071  1746 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 25.
I20260709 13:01:06.516228  9139 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:06.569496  1600 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:06.570645  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:06.579816  1748 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:06.580447  9183 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.584578  9183 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.585783  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:06.586836  9183 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.587000  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:06.589272  8771 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.589875  9091 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:06.590229  9018 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.590965  9018 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.593804  9018 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.594432  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:06.536487  9067 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:06.595160  1672 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.575322  9021 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:06.597453  8771 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.599839  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 63036.3us
I20260709 13:01:06.601022  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.602332  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:06.590306  9091 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.596225  9067 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.604058  9181 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.603220  8796 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:06.604624  9181 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.605429  8796 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.603333  9091 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:06.606961  9181 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.607766  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92710.5us
I20260709 13:01:06.608592  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.609417  8770 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:06.609982  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.611852  9176 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.560129  9121 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:06.613691  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:06.614960  9209 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:06.615787  9209 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:06.617139  9193 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.617220  9209 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.618105  9193 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.619912  9103 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:01:06.620486  9225 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 13:01:06.620755  9103 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:06.625310  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.596190  9021 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:06.637938  1672 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:01:06.638906  1751 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:06.656610  1743 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
W20260709 13:01:06.631028  9186 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:06.662981  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3098) took 1612 ms. Trace:
I20260709 13:01:06.572283  9136 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:06.638800  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:06.641235  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.667212  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.613749  9176 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:06.663512  1601 rpcz_store.cc:276] 0709 13:01:05.050228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.351176 (+300948us) service_pool.cc:224] Handling call
0709 13:01:05.351587 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.362965 (+ 11378us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:01:05.423896 (+ 60931us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.510177 (+ 86281us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.163646 (+653469us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:06.328003 (+164357us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b18003e5420. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287 00007f94814a8208
0709 13:01:06.429600 (+101597us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18003e5420. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
0709 13:01:06.515494 (+ 85894us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.516447 (+   953us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.516670 (+   223us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:06.516958 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.536572 (+ 19614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.536684 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.662684 (+126000us) raft_consensus.cc:1685] finished
0709 13:01:06.662707 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.662899 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":843549,"prepare.queue_time_us":76393,"prepare.run_cpu_time_us":206,"prepare.run_wall_time_us":6337,"raft.queue_time_us":843540,"raft.run_cpu_time_us":683,"raft.run_wall_time_us":38489,"spinlock_wait_cycles":25320192,"thread_start_us":228459,"threads_started":2,"wal-append.queue_time_us":104436}
I20260709 13:01:06.672122  9201 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:06.673101  9201 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:06.675845  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.677954  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:06.678745  1672 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:06.640206  8796 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:06.688285  1749 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:01:06.709677  1602 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:01:06.710141  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:06.710871  1601 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:01:06.712558  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:06.713210  1602 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:06.716995  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:06.717694  1672 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
W20260709 13:01:06.719211  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 43534.3us
I20260709 13:01:06.720444  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.599370  9221 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.615007  9121 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.725193  9221 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.728255  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:06.731599  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 106401us
I20260709 13:01:06.733016  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.615674  9139 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.683873  8770 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:06.622030  9103 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.708917  8967 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:06.716463  9174 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.778626  8490 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:01:06.781059  9174 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.707580  8771 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:06.779201  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.786989  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:06.793871   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:06.794889  1672 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:06.783560  8931 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:06.776121  9245 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:06.813970  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:06.817256  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.818344  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 97971.3us
I20260709 13:01:06.818554  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:06.805260  9233 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:06.831266  9237 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:06.832047  9237 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.834646  9237 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.836447  9238 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:06.796057  9158 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:01:06.814652  8796 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:06.819877  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.822880  9227 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:06.795406  8771 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.858814  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.830093  9191 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.863657  8931 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:06.876982  9174 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.879969  9021 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.881198  9231 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:01:06.879401  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 1045) took 1110 ms. Trace:
I20260709 13:01:06.908967  1594 rpcz_store.cc:276] 0709 13:01:05.768980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.784180 (+ 15200us) service_pool.cc:224] Handling call
0709 13:01:05.841380 (+ 57200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.848149 (+  6769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.879119 (+1030970us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b54001b3d50. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:06.879313 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90105216}
I20260709 13:01:06.883066  9244 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.843573  9193 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.875515  9198 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:06.889359  9176 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:06.890024  9228 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:06.890715  9100 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:06.890806  8796 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:01:06.894091  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 67653.9us
I20260709 13:01:06.887828  9237 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.895568  9191 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.894161  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.906584  1672 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:06.916304  9244 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:06.912402  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 226850us
I20260709 13:01:06.919849  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.983251  9198 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:06.983225  9244 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:06.991920  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99647.1us
I20260709 13:01:06.979157  9227 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.992661  9176 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:07.000689  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:07.001055  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:06.999784  9227 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.004978  9201 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:07.005470  9227 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.006268  9100 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:07.005899  9091 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:07.006381  9191 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:06.979781  8796 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:06.996620  9193 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.989194  9245 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:07.020375  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:07.026150  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 106415us
I20260709 13:01:07.027655  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:06.987322  9228 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.016789  9201 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:07.038416  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:07.041074  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:07.026355  8770 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:07.042361  9253 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:07.034061  9209 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:07.022708  9176 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:07.010954  9237 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.045001  9136 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:07.033674  8967 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:07.037256  9121 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:01:07.060860  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:07.038509  9091 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.040683  9191 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.044153  9227 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:01:07.032423  9100 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:01:07.026216  8931 consensus_queue.cc:1059] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:01:07.069344  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:07.071986  8796 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.090099  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:07.062371  9075 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:07.056470  9198 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.018453  9193 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.061056  9209 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.068918  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:07.044520  9067 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:07.062103  9031 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:07.062127  9106 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.119484  9106 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.120074  9092 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.119529  8771 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.120703  9092 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.122193  9106 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.093087  9100 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:07.094760  8490 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:07.099716  9209 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:07.099879  9091 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:01:07.125154  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90964.1us
I20260709 13:01:07.088424  9151 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:07.067143  9103 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:07.111599  8796 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:07.088581  9021 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.140242  2311 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:07.115633  9227 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:07.154173  9227 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.126885  8490 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:07.107909  9198 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.106397  9075 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.087862  9191 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:07.156265  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.138576  9091 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.176599  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:07.155442  9236 log.cc:927] Time spent T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
W20260709 13:01:07.161202  9261 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:01:07.198870  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.137509  9151 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.199795  9151 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:07.201967  9197 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.202566  9197 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:07.205035  9260 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:07.206943  9100 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.157886  9031 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:07.065593  9245 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.185969  9018 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.186923  9191 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:07.188022  9251 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:07.189731  9075 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:07.190292  9164 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:07.192420  1745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1632) took 1313 ms. Trace:
I20260709 13:01:07.194319  9198 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.194341  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:07.195895  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:07.242730  1676 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.183322  8490 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.208775  9193 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.212136  9232 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.213056  9227 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:07.214525  9197 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.226668  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:07.140137  9228 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.196529  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:07.244817  1669 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:01:07.247908  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71438.7us
I20260709 13:01:07.167654  9136 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:07.215116  9151 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.218632  9091 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:01:07.249145  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 159204us
I20260709 13:01:07.171742  9021 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.242192  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:07.232766  9220 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.239861  1745 rpcz_store.cc:276] 0709 13:01:05.879417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.879737 (+   320us) service_pool.cc:224] Handling call
0709 13:01:05.915641 (+ 35904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.929349 (+ 13708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.929394 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.930011 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.905819 (+975808us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b1800303700. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:01:07.011442 (+105623us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:07.011487 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.013706 (+  2219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.192066 (+178360us) raft_consensus.cc:1685] finished
0709 13:01:07.192091 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.192347 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2179,"raft.queue_time_us":24177,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":2108,"spinlock_wait_cycles":21657344,"thread_start_us":105390,"threads_started":1,"wal-append.queue_time_us":1143069}
I20260709 13:01:07.262580  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:07.266047  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:01:07.270066  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:07.251842  8770 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:07.237480  8603 consensus_queue.cc:1048] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:07.277235  1676 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:01:07.284423  1566 leader_election.cc:400] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:07.284950  1566 leader_election.cc:403] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:07.286355  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:07.272466  9257 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
W20260709 13:01:07.308043  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45590us
I20260709 13:01:07.317013  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.290032  1678 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:07.313642  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:07.240644  9031 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.318101  1595 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:07.268487  9197 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.239950  9100 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:07.329317  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.332124  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.337527  1594 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:07.339108  1595 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:01:07.340868  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.268111  9191 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.252787  9018 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:07.348553  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 64324.3us
I20260709 13:01:07.279963  9161 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:07.350530  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.359354  1595 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:07.360769  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:07.351580  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.288151  8490 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:07.256670  9232 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:07.362074  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 90250.5us
I20260709 13:01:07.380885  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.288160  9228 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:07.281137  8770 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:01:07.372686  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 54703.2us
I20260709 13:01:07.383761  1600 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:07.385099  1595 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 23: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:07.366752  9158 raft_consensus.cc:3060] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:07.405797  9017 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:07.406353  9017 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.406795  9017 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:07.407887  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.408208  9018 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.388064  1602 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:01:07.410378  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.410777  9232 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.411115  1602 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:07.389313  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.391237  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.412688  1599 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:07.392840  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:07.413919  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.414193  1752 raft_consensus.cc:3060] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.415191  1599 raft_consensus.cc:2410] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:01:07.391469  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.394064  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.417892  1749 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 16.
I20260709 13:01:07.394752  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:07.395170  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.419968  1594 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:07.361476  9263 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:07.397677  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.400875  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.403959  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:07.284427  9220 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.433295  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:07.434005  1597 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:07.435932  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.436250  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.393558  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.436827  1599 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
I20260709 13:01:07.424672  1595 raft_consensus.cc:2368] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:01:07.437839  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.438133  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.438444  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.427575  9228 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:07.440012  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.429157  9031 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:07.429617  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.445586  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.430909  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.445935  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:07.386854  9161 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:07.420028  1747 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:07.438525  1599 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:07.459069  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:07.459957  1599 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:07.463589  1594 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:07.389921  9266 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:07.389634  8770 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:07.447120  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 48806.7us
I20260709 13:01:07.480672  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.482983  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.431075  9092 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:07.445436  9228 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.450311  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:07.453481  9220 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:07.457201  1601 raft_consensus.cc:2368] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:01:07.395431  9237 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:07.518476  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.471691  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.471825  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:07.367887  9191 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.467119  9248 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:07.360973  9197 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.411432  9100 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.487659  1747 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:01:07.523732  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.444046  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:07.539677  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:07.541167  1750 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:07.525269  1752 raft_consensus.cc:2468] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:01:07.541450  1600 raft_consensus.cc:2376] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23. Re-sending same reply.
I20260709 13:01:07.522840  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.542820  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.523327  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.480818  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:07.543668  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:07.439605  9225 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:07.519460  1594 raft_consensus.cc:2393] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 24: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:07.440948  9263 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:07.389438  9209 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:07.521377  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 50815.1us
I20260709 13:01:07.548749  1601 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:01:07.551008  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 70356.4us
I20260709 13:01:07.551352  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:07.544809  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 212497us
I20260709 13:01:07.545881  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.546034  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:07.622462  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.618819  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.520264  1599 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:01:07.571743  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.553954  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.599889  1746 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:07.599053  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.623530  1743 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:01:07.624342  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.469015  9136 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.511601  9266 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:07.694555  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.650872  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.701727  1601 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:07.542114  9031 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:07.603767  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:07.554035  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 165383us
I20260709 13:01:07.663045  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.628793  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.664430  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:07.709432  1602 raft_consensus.cc:2376] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 24. Re-sending same reply.
I20260709 13:01:07.624130  1600 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
W20260709 13:01:07.712241  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 120975us
I20260709 13:01:07.522399  9274 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:07.726318  1747 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:07.726235  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.563696  9263 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:07.727850  1744 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:07.725678  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.740059  1752 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:01:07.727897  1751 raft_consensus.cc:2410] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:01:07.744107  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.603291  9232 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:07.754350  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.728603  1750 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:07.729168  2279 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:07.730675  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:07.756664  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.561363  9067 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:07.755318  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:07.562219  9237 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:07.741608  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.730460  1597 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:07.707937  9021 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.765992  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.768592  2279 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:07.772488  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.783751  1751 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:07.780890  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.544971  9248 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.785815  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.790467  1747 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 26.
I20260709 13:01:07.791798  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.796728  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:07.804391  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.806015  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.806752  2309 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:07.809330  1743 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:07.813246  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.767258  9220 raft_consensus.cc:2804] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:07.814648  1602 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:07.816556  1744 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:01:07.820726  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:07.829159  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:07.830473  1745 raft_consensus.cc:2410] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:07.821576  2316 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 11.
I20260709 13:01:07.757843  9091 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.771329  9265 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:07.798043  9075 raft_consensus.cc:2804] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:07.844012  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:07.842864  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 86378.8us
I20260709 13:01:07.627933  9161 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.845896  1602 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:07.831023  1670 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:01:07.852679  1750 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:07.847728  9075 raft_consensus.cc:697] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:07.857256  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:07.859323  9075 consensus_queue.cc:237] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.863754  1744 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:01:07.790652  9237 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.861121  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:07.838121  9265 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.734710  9274 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:07.868299  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:07.871733  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:07.842116  9158 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:07.879979  1751 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:07.894515  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:07.869550  9031 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:07.901188  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:07.964002  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.972623  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 71554.6us
I20260709 13:01:07.875717  9232 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:07.973604  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:07.882748  9139 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:07.877226  9191 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:07.883389  9270 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:07.876408  9265 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:07.985719  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:07.870180  9017 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.900753  9209 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:08.002804  9284 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 13:01:08.004050  9283 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:01:07.978530  9232 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.008291  9197 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:07.980641  9158 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:07.960088  9067 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:07.957031  9228 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:08.015420  9274 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:08.095372  9266 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:08.079487  9201 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:08.096153  9201 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:08.096606  9201 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.096937  9294 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:08.098929  9237 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:08.079100  9232 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:08.039716  9270 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 26 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:08.106050  9270 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.109040  9017 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:08.113409  9164 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.866s	user 0.016s	sys 0.000s
I20260709 13:01:08.114138  1748 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:01:08.116748  8967 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.020160  9091 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:08.033146  1595 raft_consensus.cc:2468] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
W20260709 13:01:08.063424  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 77839us
I20260709 13:01:08.140316  1715 leader_election.cc:400] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:01:08.140743  1715 leader_election.cc:403] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.141968  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.142944  9179 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17.
I20260709 13:01:08.144119  9179 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:08.088899  9277 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:08.094235  9248 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:08.094484  9067 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.117355  8967 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:08.150147  9265 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:07.956377  9279 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:01:08.151619  1594 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: [17.7-17.7]
I20260709 13:01:08.143373  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.139438  1595 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:08.156838  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.160593  1715 leader_election.cc:400] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:01:08.160981  1715 leader_election.cc:403] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.162927  1715 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.157784  9248 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.164880  9248 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:08.167781  9277 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:08.157068  9279 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:08.155723  8967 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:08.171725  9179 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 17. Current term is 18.
I20260709 13:01:08.183223  9277 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:08.201601  8490 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.001s
I20260709 13:01:08.240725  1603 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:08.235075  9220 raft_consensus.cc:697] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:08.193039  9178 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:01:08.241605  9248 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:08.218372  9263 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:08.290043  9252 log.cc:927] Time spent T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.219s	user 0.020s	sys 0.052s
I20260709 13:01:08.275977  9294 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:01:08.303468  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 422619us
W20260709 13:01:08.322610  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 592273us
I20260709 13:01:08.322805  9194 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:08.323375  9194 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.324074  9194 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:08.303912  9220 consensus_queue.cc:237] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:08.327030  9228 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:08.328778  9228 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:08.329378  9228 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:01:08.309461  9292 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.456s	user 0.003s	sys 0.005s
I20260709 13:01:08.331434  9136 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:08.332111  9136 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.332896  1595 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:08.334159  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:08.334766  9136 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:08.334875  1595 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:08.335927  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:08.336150  1670 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:08.336614  1594 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:08.339701  1672 raft_consensus.cc:606] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.312866  1598 raft_consensus.cc:2410] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:08.314815  1749 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:08.316219  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3447) took 1584 ms. Trace:
I20260709 13:01:08.323334  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:08.318127  1603 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:01:08.345299  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:08.342962  1674 rpcz_store.cc:276] 0709 13:01:06.732587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.734063 (+  1476us) service_pool.cc:224] Handling call
0709 13:01:06.734382 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.794047 (+ 59665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.794103 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.805288 (+ 11185us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.921982 (+116694us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:06.922066 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.215908 (+293842us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b5400433354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:07.215981 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.282738 (+1066757us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:08.315974 (+ 33236us) raft_consensus.cc:1685] finished
0709 13:01:08.315998 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.316154 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1235,"raft.queue_time_us":69019,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6325,"spinlock_wait_cycles":157006848,"thread_start_us":93639,"threads_started":1,"wal-append.queue_time_us":219459}
I20260709 13:01:08.356066  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.360495  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:08.361361  1743 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:08.370496  1745 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:01:08.373885  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.376279  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:08.377028  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:08.377908  1601 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
W20260709 13:01:08.348261  9295 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:01:08.384469  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.383495  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:08.387969  1595 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:08.310549  8770 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.788s	user 0.007s	sys 0.007s
I20260709 13:01:08.388854  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:08.383466  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:08.387566  1675 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:08.390352  1748 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:08.384513  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:08.391294  9265 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:08.405670  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 3619) took 1115 ms. Trace:
I20260709 13:01:08.406379  1598 rpcz_store.cc:276] 0709 13:01:07.290319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.310094 (+ 19775us) service_pool.cc:224] Handling call
0709 13:01:08.405291 (+1095197us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400025dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:08.405558 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233670528}
I20260709 13:01:08.314630  9263 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:08.408533  1596 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:01:08.409036  1596 pending_rounds.cc:85] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 10
I20260709 13:01:08.409317  1596 pending_rounds.cc:107] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:01:08.409601  1596 raft_consensus.cc:2889] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:08.413576  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 90377.7us
I20260709 13:01:08.416060  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:08.417214  1674 raft_consensus.cc:2368] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24.
I20260709 13:01:08.421247  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:08.422793  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:08.425420  9092 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:01:08.483830  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 214417us
I20260709 13:01:08.412238  9179 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.427093  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:01:08.523622  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 101009us
W20260709 13:01:08.523823  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 96923.2us
W20260709 13:01:08.506165  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 116797us
I20260709 13:01:08.524488  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:01:08.524614  9275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.012s	sys 0.039s
I20260709 13:01:08.525434  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:01:08.525604  9275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.039s
I20260709 13:01:08.526420  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:08.527305  9244 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:08.527415  9091 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:08.527745  9279 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:08.447997  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:08.461947  9278 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:08.528606  9097 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:08.462484  8931 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.528062  9091 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.530731  1745 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:08.525655  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:08.514595  1595 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:08.423499  8770 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.552817  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:08.553722  1595 raft_consensus.cc:2393] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 23: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:08.529351  8931 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.520308  9174 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:08.528774  9279 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:08.538269  1597 raft_consensus.cc:2955] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 13 to 15, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:08.610702  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:08.610316  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:08.524475  9161 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.007s
I20260709 13:01:08.612293  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:08.561200  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:08.574069  9174 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.522905  9092 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:08.525847  9183 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:08.537477  9270 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:08.588771  8796 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.590947  9306 log.cc:927] Time spent T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:01:08.527782  9244 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:08.563473  8967 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:08.559991  9106 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:08.575033  9273 consensus_queue.cc:1048] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:01:08.602875  9237 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:08.599510  9232 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.573764  9139 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:08.605224  9188 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:08.634545  9092 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:08.562680  9136 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:08.606253  9197 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:08.612584  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3486) took 1192 ms. Trace:
I20260709 13:01:08.657763  1749 rpcz_store.cc:276] 0709 13:01:07.421118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.421452 (+   334us) service_pool.cc:224] Handling call
0709 13:01:08.612345 (+1190893us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54001c34d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:08.612506 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020002560}
I20260709 13:01:08.540194  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:08.611722  1675 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 13:01:08.659016  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 118992us
I20260709 13:01:08.618561  1674 raft_consensus.cc:2368] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:01:08.660202  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.536433  9091 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:08.673508  8931 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:08.674135  8490 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:08.674598  8490 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:08.674994  8490 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:08.679747  9300 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:01:08.621793  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60770us
I20260709 13:01:08.623725  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.681407  9188 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:08.681908  9188 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:08.682255  9100 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.682830  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.681934  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.683858  1670 raft_consensus.cc:2393] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:08.624114  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.628062  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.627437  1750 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:08.684921  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.630367  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:08.686223  2279 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:08.641652  9244 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:08.607818  9121 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:01:08.618460  9017 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.539669  9201 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.522738  9263 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:01:08.610191  9279 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:08.536818  9179 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.631819  9174 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:08.576628  9021 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:01:08.574167  9194 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.528998  9278 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.662040  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.633057  9183 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:08.637185  9270 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:08.577116  9097 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:08.629534  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:08.619884  9161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.011s	sys 0.007s
I20260709 13:01:08.695811  8490 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.697623  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.699350  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:08.734313  1678 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
W20260709 13:01:08.756835  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57860.3us
I20260709 13:01:08.642894  8967 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:08.705575  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:08.712970  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 68804us
I20260709 13:01:08.714907  1677 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:01:08.759516  1677 pending_rounds.cc:85] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 10
I20260709 13:01:08.759912  1677 pending_rounds.cc:107] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:01:08.760221  1677 raft_consensus.cc:2889] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.683956  9139 consensus_queue.cc:1243] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:08.696238  9300 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.728082  1673 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:08.686618  9275 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:08.641350  8796 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.682753  9100 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.704679  9299 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:08.763810  1670 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 25. Current term is 26. Ops: []
I20260709 13:01:08.763634  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.788893  1675 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:01:08.789522  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.764686  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.769290  1671 raft_consensus.cc:2368] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20.
I20260709 13:01:08.773388  1715 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:08.682885  9188 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.694100  9136 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:08.752756  9270 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:08.732913  9183 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:08.786396  1597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3123) took 1162 ms. Trace:
I20260709 13:01:08.714121  9017 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.765887  8967 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:08.811424  9267 log.cc:927] Time spent T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 1.266s	user 0.003s	sys 0.007s
W20260709 13:01:08.816517  9314 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:01:08.817238  9179 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:08.820111  8967 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:08.767340  9075 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:08.777659  8490 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:08.727748  9293 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:01:08.802981  1597 rpcz_store.cc:276] 0709 13:01:07.624271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.778299 (+154028us) service_pool.cc:224] Handling call
0709 13:01:07.779074 (+   775us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:07.797565 (+ 18491us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:01:08.195319 (+397754us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.523435 (+328116us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:08.537920 (+ 14485us) log.cc:844] Serialized 616 byte log entry
0709 13:01:08.538124 (+   204us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:01:08.668141 (+130017us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.708959 (+ 40818us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.785965 (+ 77006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.786105 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.786156 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:08.786169 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.786331 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55121,"prepare.queue_time_us":544787,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":65854,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":8340,"thread_start_us":745183,"threads_started":4,"wal-append.queue_time_us":378970}
I20260709 13:01:08.807093  1715 leader_election.cc:400] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24.
I20260709 13:01:09.205595  1715 leader_election.cc:403] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.809362  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:08.820884  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3457) took 1258 ms. Trace:
I20260709 13:01:08.794486  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:09.207867  1747 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:01:08.849704  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 91586.2us
I20260709 13:01:08.806821  9323 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:08.780090  9279 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:08.938014  9188 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:08.955582  9097 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:01:09.188550  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.196398  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:09.198652  1676 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:01:08.983670  9308 log.cc:927] Time spent T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:01:08.966248  9307 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 13:01:09.199074  1745 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.013s
I20260709 13:01:08.955829  8770 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:09.222349  9018 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.256760  9151 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.256913  9018 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.258515  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 3223) took 1587 ms. Trace:
I20260709 13:01:09.258977  1752 rpcz_store.cc:276] 0709 13:01:07.671451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.743729 (+ 72278us) service_pool.cc:224] Handling call
0709 13:01:09.258296 (+1514567us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b540017d4d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:09.258443 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823204224}
I20260709 13:01:09.259712  9325 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.260502  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:09.262331  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:09.262965  1677 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:09.264089  2313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36896 (request call id 525) took 1467 ms (client timeout 1853 ms). Trace:
W20260709 13:01:09.264585  2313 rpcz_store.cc:269] 0709 13:01:07.796269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.796425 (+   156us) service_pool.cc:224] Handling call
0709 13:01:09.263815 (+1467390us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54005e3b54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:09.263983 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313253120}
W20260709 13:01:09.206645  9091 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.008s
I20260709 13:01:09.240666  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:09.266002  9091 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.196892  9075 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:09.268215  9075 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.269609  9091 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.270131  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3106) took 1908 ms. Trace:
I20260709 13:01:09.270556  1596 rpcz_store.cc:276] 0709 13:01:07.361347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.363738 (+  2391us) service_pool.cc:224] Handling call
0709 13:01:08.408036 (+1044298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.410161 (+  2125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.269890 (+859729us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400025dd0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148c8ad 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:09.270059 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349104512}
I20260709 13:01:09.244328  8490 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:09.271911  8490 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.251410  1745 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:09.256171  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:09.276983  9299 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:09.260530  9325 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.280090  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:09.281919  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:09.216892  9323 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.257503  9151 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:01:09.217785  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 411067us
I20260709 13:01:09.285529  1745 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:09.284461  9151 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.206772  1669 rpcz_store.cc:276] 0709 13:01:07.562946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.563088 (+   142us) service_pool.cc:224] Handling call
0709 13:01:07.620666 (+ 57578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.902155 (+281489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.902206 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.902269 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:07.902329 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.820595 (+918266us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002fc954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:08.820650 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.820816 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646935936}
I20260709 13:01:09.275246  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50078 (request call id 56) took 2010 ms. Trace:
I20260709 13:01:09.292124  1672 rpcz_store.cc:276] 0709 13:01:07.264585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.265851 (+  1266us) service_pool.cc:224] Handling call
0709 13:01:09.275049 (+2009198us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400257bd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481487853 00007f948645560a 00007f947f9db7d4 00007f947f9db762 00007f947f9db691 00007f947f9db60c 00007f947f9da8c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:09.275138 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447329664}
I20260709 13:01:09.291531  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:09.295635  9018 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.296798  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:09.296931  9151 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.295962  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:09.283595  9323 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:09.282178  9287 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 1.267s	user 0.006s	sys 0.000s
I20260709 13:01:09.300004  2314 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:09.298688  2313 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:09.306284  1747 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 24.
I20260709 13:01:09.308096  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:09.330930  1743 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:09.309207  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:09.311297  1744 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:01:09.324558  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:09.326351  1669 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:09.327265  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:09.228365  9121 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.336885  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:09.366844  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.344820  1641 connection.cc:256] RPC call timeout handler was delayed by -1.1094091589999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:01:09.409400  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0487568669999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 13:01:09.411473  1677 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:09.413918  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:09.415023  1749 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:09.417953  1598 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:09.418988  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:09.243778  9237 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:09.431143  1641 connection.cc:256] RPC call timeout handler was delayed by -1.0041091589999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:01:09.304152  8931 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:09.424506  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:09.425570  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:09.432724  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:09.422713  1676 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 26.
I20260709 13:01:09.447212  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:09.448355  1747 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:09.475185  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:09.473730  9021 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.490801  9021 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:09.492605  1777 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:44561 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:44561 timed out after 15.000s (SENT)
I20260709 13:01:09.496166  9326 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.496894  9326 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.499918  9328 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.500583  9328 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.501960  9327 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.502599  9327 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.504920  9327 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:09.506458  9320 log.cc:927] Time spent T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:09.507970  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:09.507344  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:09.509464  1596 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:09.510597  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:09.511351  1596 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:09.512204  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:09.439489  9018 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.455636  9278 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.499316  9326 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.503192  9328 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:09.508551  9330 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.714s	user 0.001s	sys 0.001s
I20260709 13:01:09.521930  1669 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:09.479353  9287 log.cc:927] Time spent T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:09.432355  9121 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.452401  9237 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.485714  9100 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.559660  1749 raft_consensus.cc:2468] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:01:09.478406  9136 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.557302  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:09.483719  9091 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.514853  9232 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.520329  9201 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:09.575634  1747 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:09.577797  1596 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:09.638677  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:09.525817  9103 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:09.715299  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:09.529098  9148 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:09.517843  9198 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:09.550879  9194 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:09.663559  9092 consensus_meta.cc:287] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.962s	user 0.009s	sys 0.009s
W20260709 13:01:09.677843  9174 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.945s	user 0.010s	sys 0.007s
W20260709 13:01:09.666221  9270 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.828s	user 0.016s	sys 0.000s
W20260709 13:01:09.666674  9183 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.813s	user 0.017s	sys 0.000s
W20260709 13:01:09.742843  9298 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 1.736s	user 0.003s	sys 0.003s
I20260709 13:01:09.746858  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3132) took 1421 ms. Trace:
I20260709 13:01:09.726179  8796 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.783691  1603 rpcz_store.cc:276] 0709 13:01:08.325603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.384690 (+ 59087us) service_pool.cc:224] Handling call
0709 13:01:08.394025 (+  9335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:08.394521 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:08.394843 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.971684 (+576841us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.191681 (+219997us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.191906 (+   225us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:09.192183 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.745532 (+553349us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b18003c6ac0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f9481043d70 00007f9481037293 00007f948102ccea 00007f948102d23a 00007f9481497a2a 00007f94814a70bf 00007f94814a7038
0709 13:01:09.746228 (+   696us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.746442 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.746590 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.746631 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:09.746644 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.746788 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264400,"prepare.queue_time_us":20483,"prepare.run_cpu_time_us":3739,"prepare.run_wall_time_us":57664,"raft.queue_time_us":257609,"raft.run_cpu_time_us":11780,"raft.run_wall_time_us":253858,"spinlock_wait_cycles":13154688,"thread_start_us":576109,"threads_started":2,"wal-append.queue_time_us":316462}
I20260709 13:01:09.726257  9148 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.788934  9067 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.789721  9067 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:09.750679  9331 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:09.751068  9335 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.751654  9334 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.751919  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.753453  9321 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
W20260709 13:01:09.678117  9244 consensus_meta.cc:287] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.957s	user 0.015s	sys 0.002s
I20260709 13:01:09.657392  8967 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:09.551846  9018 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.726930  9103 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.671607  9021 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.789126  9148 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:09.750017  9237 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:09.827911  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 314670us
I20260709 13:01:09.759270  9092 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.728886  9091 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.838125  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:09.829167  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3124) took 2202 ms. Trace:
I20260709 13:01:09.764951  9174 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.772543  9270 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:09.783442  9183 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:09.838737  9097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.011s
I20260709 13:01:09.826048  9103 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.843892  9201 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.824563  9340 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.827555  9232 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.854823  1672 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:01:09.854759  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:09.856623  9179 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:01:09.852265  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.034s	sys 0.059s
I20260709 13:01:09.862542  1601 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
W20260709 13:01:09.873672  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.035s	sys 0.060s
I20260709 13:01:09.824939  9244 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:09.814019  9334 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.848206  9237 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:09.874841  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:09.862530  9097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.011s
I20260709 13:01:09.853127  9343 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:09.814977  9335 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.889777  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:09.867674  9121 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:09.910738  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 53984.4us
I20260709 13:01:09.915737  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:09.916379  1674 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:09.877655  9351 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:09.932921  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:09.882706  9237 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.881345  9067 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.880146  9179 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:01:09.942113  9345 log.cc:927] Time spent T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.124s	user 0.000s	sys 0.004s
I20260709 13:01:09.954581  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3235) took 1597 ms. Trace:
I20260709 13:01:09.949635  9282 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:09.957732  9091 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:09.958725  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.959784  9335 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.961045  9183 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.962044  9174 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.963163  9092 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.875003  9340 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.007124  9181 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:09.968467  9354 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:09.970129  9334 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:09.971894  9353 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:01:09.971982  9315 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 1.197s	user 0.003s	sys 0.000s
I20260709 13:01:09.943809  9237 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:09.928138  9332 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:09.972959  9358 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
W20260709 13:01:09.974730  9188 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.006s
I20260709 13:01:09.976082  9255 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:10.041926  9332 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.026412  9322 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.977478  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.021453  9228 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.046635  9332 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.875437  9232 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.910691  9075 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:09.983927  9018 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.886933  9349 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:09.984284  9270 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.984848  9328 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:10.060395  9328 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.062861  9328 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.985651  9244 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:09.936901  9121 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:09.873591  9201 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.066063  9201 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.985467  9097 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:10.066661  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3248) took 1278 ms. Trace:
I20260709 13:01:09.984894  9341 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:01:10.040555  9103 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.067272  1674 rpcz_store.cc:276] 0709 13:01:08.788482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.789195 (+   713us) service_pool.cc:224] Handling call
0709 13:01:10.066314 (+1277119us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400183dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:10.066567 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590592896}
I20260709 13:01:09.946010  9351 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:09.986840  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.069173  1671 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 13:01:10.069458  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82773.2us
I20260709 13:01:10.070390  9351 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.990069  9100 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:09.994743  9323 consensus_meta.cc:287] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.002s
W20260709 13:01:10.016014  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 95824.7us
W20260709 13:01:10.025040  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3228) took 1416 ms (client timeout 1590 ms). Trace:
I20260709 13:01:10.013410  9179 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.015930  1750 rpcz_store.cc:276] 0709 13:01:08.357087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.379240 (+ 22153us) service_pool.cc:224] Handling call
0709 13:01:08.395914 (+ 16674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.685158 (+289244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.954237 (+1269079us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540029e354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:09.954494 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532016512}
I20260709 13:01:10.025766  1673 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:01:10.031019  9181 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.071376  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:09.939582  9343 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.071653  9323 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.085475  9343 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.047152  1675 raft_consensus.cc:2410] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 13:01:09.995476  9325 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.028576  9340 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.982563  2311 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:10.014351  9148 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.051831  9228 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:10.046777  9358 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.049757  9322 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.058372  9232 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:09.841251  1602 rpcz_store.cc:276] 0709 13:01:07.626641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.877390 (+250749us) service_pool.cc:224] Handling call
0709 13:01:07.877803 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:07.881911 (+  4108us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:08.338579 (+456668us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b18003feec0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 13:01:08.645578 (+306999us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.285488 (+639910us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18003feec0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f94810354bc 00007f947e38348b 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9481485060 00007f9481497716 00007f94814a8287
0709 13:01:09.285700 (+   212us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.286466 (+   766us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.286650 (+   184us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:09.290533 (+  3883us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.492654 (+202121us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:09.810988 (+318334us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.828555 (+ 17567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.828688 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.828765 (+    77us) raft_consensus.cc:1685] finished
0709 13:01:09.828786 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.829052 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":483213,"prepare.queue_time_us":620997,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":143,"raft.queue_time_us":678687,"raft.run_cpu_time_us":1337,"raft.run_wall_time_us":37984,"spinlock_wait_cycles":38913920,"thread_start_us":740853,"threads_started":4,"wal-append.queue_time_us":93377}
I20260709 13:01:10.085726  1750 raft_consensus.cc:1240] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18. Ops: [14.7-17.8]
W20260709 13:01:10.023918  8931 consensus_meta.cc:287] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.004s
I20260709 13:01:10.134320  8490 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.071483  9100 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.133633  9017 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.086467  9323 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.073719  9097 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:10.074198  9341 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:01:10.164695  9148 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.165495  9341 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:10.095781  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.166616  1745 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:10.157574  9322 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.082705  9237 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.169742  9237 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.123792  9279 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.172184  9293 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:10.172838  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.173583  1747 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:10.173897  9293 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:10.174163  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.174924  9176 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:10.175312  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.175449  9176 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:10.175612  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.176072  1749 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 14.
I20260709 13:01:10.176239  1750 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:10.155617  9358 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.176533  9176 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.101854  1641 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:10.178138  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 76402.6us
I20260709 13:01:10.177778  1501 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 13 to 16, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:10.178895  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:10.179390  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 18 to 20, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:10.086884  9244 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:10.161392  8931 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24.
I20260709 13:01:10.119593  1744 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 13:01:10.157948  1676 rpcz_store.cc:269] 0709 13:01:08.608919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.609082 (+   163us) service_pool.cc:224] Handling call
0709 13:01:10.024813 (+1415731us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b540006de54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:10.024966 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615206784}
I20260709 13:01:10.166039  9341 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:10.159114  9228 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.192833  9323 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:01:10.201133  9323 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:10.201745  9323 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:10.202193  9228 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.188956  9237 raft_consensus.cc:2804] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:10.203442  9237 raft_consensus.cc:697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:10.204113  9332 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.204836  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.204774  9237 consensus_queue.cc:237] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.205736  2311 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 16.
I20260709 13:01:10.206523  9332 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.069455  9103 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.156131  9100 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.181617  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.182946  9097 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:10.182920  9017 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:10.183207  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.183734  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.158157  9181 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.184762  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.189121  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:10.189740  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1972685820000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:01:10.182675  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 225447us
I20260709 13:01:10.192986  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.194459  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.195879  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:10.195909  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:10.195919  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.207777  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.207865  2310 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:10.098032  9349 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:01:10.209578  1745 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:10.238417  1601 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:01:10.239331  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:10.209923  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46996 (request call id 3250) took 1252 ms (client timeout 1613 ms). Trace:
I20260709 13:01:10.210484  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54658 (request call id 3121) took 2816 ms. Trace:
I20260709 13:01:10.242419  1669 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:10.212148  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.213711  1602 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:01:10.214414  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.244443  1596 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
W20260709 13:01:10.240842  1675 rpcz_store.cc:269] 0709 13:01:08.957780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.196002 (+238222us) service_pool.cc:224] Handling call
0709 13:01:10.182249 (+986247us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400193a54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:10.209851 (+ 27602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858554752}
I20260709 13:01:10.181128  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 12 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:10.225304  1747 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:10.225253  1749 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:10.246627  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.248004  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.236415  1748 raft_consensus.cc:2410] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:10.239998  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.249663  1600 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.249732  1598 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.223832  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.250694  1603 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:01:10.252027  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.252789  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.254093  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.254791  1601 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.241377  1599 rpcz_store.cc:276] 0709 13:01:07.377791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.700989 (+323198us) service_pool.cc:224] Handling call
0709 13:01:07.710892 (+  9903us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:07.792137 (+ 81245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:09.290569 (+1498432us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b1800372d00. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 13:01:09.551456 (+260887us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.062023 (+510567us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800372d00. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f9484e853c7 00007f94814979a7 00007f94814a70bf 00007f94814a7038
0709 13:01:10.062499 (+   476us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.062757 (+   258us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:10.130205 (+ 67448us) log.cc:844] Serialized 52 byte log entry
0709 13:01:10.130998 (+   793us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:10.131805 (+   807us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.132387 (+   582us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.165824 (+ 33437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.193868 (+ 28044us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b54003b4054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:10.193922 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.193974 (+    52us) raft_consensus.cc:1685] finished
0709 13:01:10.193986 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.194135 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67620,"prepare.queue_time_us":802498,"prepare.run_cpu_time_us":174,"prepare.run_wall_time_us":178,"raft.queue_time_us":121235,"raft.run_cpu_time_us":693,"raft.run_wall_time_us":23958,"spinlock_wait_cycles":180573312,"thread_start_us":442326,"threads_started":2,"wal-append.queue_time_us":270139}
I20260709 13:01:10.258109  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.258946  1750 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 10.
I20260709 13:01:10.202733  9323 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.261291  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.269153  1749 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:10.262332  1752 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:10.209379  9176 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.264775  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.288141  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.271898  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:10.266119  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.289352  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.289611  1595 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 8.
I20260709 13:01:10.289882  1602 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:10.290783  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.252817  9097 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:10.303393  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:10.273092  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.304430  1676 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 12: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:10.270619  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.305526  1599 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:10.287951  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.294126  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.294708  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:10.246099  1501 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 13 to 15, term changed from 18 to 20, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:10.251761  8603 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:10.308174  9178 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:10.308657  9178 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.309331  9178 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:10.307775  1501 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.295230  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.317031  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.317607  9294 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.317991  1748 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:10.238417  9100 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:10.270998  9179 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.288224  9358 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:10.319916  9179 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.320322  9358 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.322491  9358 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.319918  9100 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.323837  9342 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:10.272329  9341 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.325670  9100 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.264261  8931 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:10.271118  9340 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.326603  8931 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:10.328330  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.329190  8931 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:10.329303  9323 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:10.333154  1746 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.319476  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.288815  1596 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:10.342432  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.271298  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:10.338789  1496 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 235) took 16674 ms (client timeout 15000 ms). Trace:
I20260709 13:01:10.343495  1501 catalog_manager.cc:5697] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 14 to 16, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.340008  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.346040  1603 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:10.347713  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.351284  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.348663  1594 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 29.
I20260709 13:01:10.355558  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:10.356609  2313 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:10.357913  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.355646  1747 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:10.360214  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.363016  1598 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:10.296330  1600 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:10.346067  1501 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:10.367628  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.369053  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.370216  1501 catalog_manager.cc:5697] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.380722  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.322520  9179 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:10.385097  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 149774us
I20260709 13:01:10.387331  1748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69370730433544db93e2c777aba2b9b2"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:56774
W20260709 13:01:10.386258  1566 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.615s (SENT)
I20260709 13:01:10.388458  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:10.390080  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.389880  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.388633  1748 raft_consensus.cc:606] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:10.391357  1748 raft_consensus.cc:614] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:10.380113  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 12 to 13, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:10.394791  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.397526  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.398648  2309 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 13.
I20260709 13:01:10.326702  9340 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.401850  9340 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.402848  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.406324  9178 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.408962  9178 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.412120  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.412899  1595 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:10.416486  2313 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
W20260709 13:01:10.343923  1496 rpcz_store.cc:269] 0709 13:00:53.664206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.664454 (+   248us) service_pool.cc:224] Handling call
0709 13:01:10.338665 (+16674211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:06.170853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:06.236621 (+ 65768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:06.236661 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:01:06.236679 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:06.237596 (+   917us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:06.237681 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:06.237721 (+    40us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:01:06.239113 (+  1392us) tablet.cc:701] Row locks acquired
0709 13:01:06.239140 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:01:06.239359 (+   219us) write_op.cc:270] Start()
0709 13:01:06.265278 (+ 25919us) write_op.cc:276] Timestamp: P: 1783602066239282 usec, L: 0
0709 13:01:06.265318 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:01:06.266443 (+  1125us) log.cc:844] Serialized 3179 byte log entry
0709 13:01:06.872253 (+605810us) op_driver.cc:464] REPLICATION: finished
0709 13:01:07.042108 (+169855us) write_op.cc:301] APPLY: starting
0709 13:01:07.042205 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:07.118613 (+ 76408us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:07.118746 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:07.179196 (+ 60450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:07.253594 (+ 74398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:01:07.260579 (+  6985us) write_op.cc:312] APPLY: finished
0709 13:01:07.335820 (+ 75241us) log.cc:844] Serialized 73 byte log entry
0709 13:01:07.367675 (+ 31855us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:07.384954 (+ 17279us) write_op.cc:454] Released schema lock
0709 13:01:07.389329 (+  4375us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:07.467790 (+ 78461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:07.479002 (+ 11212us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44763,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":169572,"apply.run_cpu_time_us":14852,"apply.run_wall_time_us":405760,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":285858,"prepare.run_cpu_time_us":34811,"prepare.run_wall_time_us":251550,"raft.queue_time_us":249928,"raft.run_cpu_time_us":31977,"raft.run_wall_time_us":144460,"replication_time_us":606733,"thread_start_us":712149,"threads_started":4,"wal-append.queue_time_us":228525,"wal-append.run_cpu_time_us":10561,"wal-append.run_wall_time_us":2110129}]]}
W20260709 13:01:10.418525  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 157096us
I20260709 13:01:10.425092  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.425347  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.426648  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.374560  1599 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:10.421664  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.421214  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.433436  1669 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:10.435249  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:10.436084  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.441557  1596 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
W20260709 13:01:10.442873  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56692.9us
I20260709 13:01:10.443562  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.449808  1669 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:10.451720  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.452428  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.453051  1600 raft_consensus.cc:2410] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:01:10.453506  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:10.454205  1599 raft_consensus.cc:2376] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19. Re-sending same reply.
I20260709 13:01:10.455087  1669 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:10.456310  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.453085  1598 raft_consensus.cc:2376] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 24. Re-sending same reply.
I20260709 13:01:10.465857  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.468685  1594 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:10.470257  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.469147  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:10.471805  2313 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:10.469473  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.466495  1595 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:10.482600  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.485739  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.493410  8490 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:10.500391  1566 leader_election.cc:400] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 17. Current term is 18.
I20260709 13:01:10.503756  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:10.431862  9248 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.443213  9100 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:10.481575  9228 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.527024  2313 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:10.525903  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:10.511401  8490 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.512638  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.500432  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.393241  9097 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.484686  9244 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:10.536075  1749 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:01:10.512566  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:10.591711  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:10.592710  2313 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:10.531673  9139 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.601135  9198 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:10.601382  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 101150us
I20260709 13:01:10.602664  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:10.602794  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 90357.5us
I20260709 13:01:10.604009  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.600443  9139 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.482038  9325 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:10.604445  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:10.562147  9365 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:01:10.627780  1641 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:10.608222  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:10.629889  2311 raft_consensus.cc:2393] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 12: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:10.620998  8490 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:10.630606  8490 consensus_queue.cc:1243] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:01:10.625115  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.641680  1669 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:10.554848  9103 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:10.530830  9335 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.587764  9278 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:10.589025  9244 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:10.669196  1752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48454 (request call id 3513) took 1361 ms. Trace:
I20260709 13:01:10.669951  1752 rpcz_store.cc:276] 0709 13:01:09.307663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.307828 (+   165us) service_pool.cc:224] Handling call
0709 13:01:10.668859 (+1361031us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54001c34d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:10.669072 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032298240}
I20260709 13:01:10.626976  9198 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:10.616775  9232 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:10.615871  9152 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:01:10.627982  9100 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:10.690141  9139 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:10.604465  9228 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.699220  1746 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:10.665891  9181 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:10.520750  9248 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:10.653640  9103 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:10.677968  9244 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:10.636695  9325 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.672560  9335 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.644678  9148 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:01:10.848219  2316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36870 (request call id 805) took 1550 ms. Trace:
W20260709 13:01:10.856321  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.846581  9176 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.555s	user 0.016s	sys 0.002s
I20260709 13:01:10.884336  2316 rpcz_store.cc:276] 0709 13:01:09.297698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.302612 (+  4914us) service_pool.cc:224] Handling call
0709 13:01:09.333577 (+ 30965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.337398 (+  3821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.337434 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.001504 (+664070us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b2c00012f58. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947fd86a11 00007f947fd96372 00007f94814c8a01 00007f948148d43a 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2
0709 13:01:10.002453 (+   949us) log.cc:844] Serialized 564 byte log entry
0709 13:01:10.185657 (+183204us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:10.185710 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.185887 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.847202 (+661315us) raft_consensus.cc:1685] finished
0709 13:01:10.847231 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.848011 (+   780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29392256,"thread_start_us":182769,"threads_started":1,"wal-append.queue_time_us":291510}
I20260709 13:01:10.919705  1744 raft_consensus.cc:2410] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:10.927779  1670 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:10.863628  9303 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:10.930256  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:10.921427  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:10.941123  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.943899  1745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.086s	sys 0.101s
I20260709 13:01:10.944494  1750 raft_consensus.cc:2410] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:01:10.944743  1745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.086s	sys 0.101s
W20260709 13:01:10.951571  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.888353  9181 raft_consensus.cc:697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:10.960580  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:10.961637  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 341684us
I20260709 13:01:10.961978  1670 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 13.
I20260709 13:01:10.962375  1676 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:10.962977  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:10.993116  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:11.004359  8490 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:10.990356  1746 raft_consensus.cc:1275] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:10.931912  9322 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.028023  9322 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.960187  9100 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.032182  9100 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.044864  9181 consensus_queue.cc:237] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.012668  9103 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:10.966562  9228 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:10.957409  9342 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:01:11.054093  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.043s	sys 0.054s
I20260709 13:01:11.054512  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:10.937559  9276 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:11.064661  1671 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:11.016058  9232 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:11.070580  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 128321us
W20260709 13:01:11.059689  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.043s	sys 0.054s
W20260709 13:01:11.077379  1601 consensus_meta.cc:287] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.822s	user 0.017s	sys 0.001s
I20260709 13:01:11.077487  1749 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:01:11.078292  1749 pending_rounds.cc:85] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 12
I20260709 13:01:11.078719  1749 pending_rounds.cc:107] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:01:11.079205  1749 raft_consensus.cc:2889] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.086046  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:10.959205  9303 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:11.081704  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.978919  9341 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.101101  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:10.989952  9248 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:11.109189  1743 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:11.106024  1750 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:11.109045  1747 raft_consensus.cc:1275] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:11.059602  9343 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:11.117336  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:11.112496  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:11.075476  9228 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:01:11.078094  1601 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:11.017489  9139 consensus_queue.cc:1059] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:01:11.089090  9322 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:11.113726  9342 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:11.119962  1752 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 26: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:11.127168  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.128903  1671 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:11.094501  9276 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.135960  9139 consensus_queue.cc:1243] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:11.117103  9343 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:11.123097  9228 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:11.148172  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.158537  9248 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.146238  9100 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:11.184118  1641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.019s	sys 0.043s
W20260709 13:01:11.185000  1641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.019s	sys 0.043s
W20260709 13:01:11.185446  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 558007us
W20260709 13:01:11.194818  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.155336  9343 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.221084  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.222664  1669 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:11.196405  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:11.210445  9380 log.cc:927] Time spent T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:11.226822  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.211870  9152 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:11.229550  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:01:11.235880  9237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.121s	sys 0.237s
W20260709 13:01:11.239993  9237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.121s	sys 0.237s
I20260709 13:01:11.245956  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.162036  9248 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.248011  9335 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:11.288012  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 295140us
I20260709 13:01:11.291083  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:11.256567  9198 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:01:11.299072  1715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.889s (SENT) [suppressed 22 similar messages]
W20260709 13:01:11.303011  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 330352us
I20260709 13:01:11.305132  1566 leader_election.cc:400] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20.
I20260709 13:01:11.305543  1566 leader_election.cc:403] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.229727  9342 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:11.279894  9325 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:11.308653  9335 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:11.318048  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:11.305378  9198 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:11.323943  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.325686  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:11.328395  2279 leader_election.cc:336] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.818s (SENT)
I20260709 13:01:11.259740  9228 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.357303  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.359087  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:11.362331  1602 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:11.364617  9303 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:11.365557  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:11.322626  9198 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:11.369856  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.348057  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.333684  8490 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:11.344609  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:11.328914  9139 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:11.331065  9325 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:11.374589  1594 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: [20.12-20.13]
I20260709 13:01:11.334667  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.373147  1596 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
W20260709 13:01:11.340770  9382 log.cc:927] Time spent T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:11.378829  1599 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:11.321043  9381 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20.
I20260709 13:01:11.382536  1601 raft_consensus.cc:2410] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:01:11.390559  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.392066  1601 raft_consensus.cc:2410] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 20 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:01:11.396426  1677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.049s	sys 0.086s
W20260709 13:01:11.396941  1677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.049s	sys 0.086s
I20260709 13:01:11.396498  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.406363  1601 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:01:11.395295  9325 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:11.416097  1601 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []
W20260709 13:01:11.417194  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.409689  9378 log.cc:927] Time spent T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:01:11.428722  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 199531us
W20260709 13:01:11.427124  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 128193us
I20260709 13:01:11.431855  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.432202  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.437311  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.437348  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.438576  1602 raft_consensus.cc:2410] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:01:11.439792  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:11.441358  1595 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:11.431383  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.442628  1601 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:11.436841  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.448643  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.450783  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:11.450614  8490 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:11.416517  9276 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:11.456175  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:11.456959  1603 raft_consensus.cc:2393] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:11.459806  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.464360  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.469470  1595 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:11.470953  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.465893  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.436897  9248 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:11.473109  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.474567  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.475841  1595 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:11.480006  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.480842  1598 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:01:11.481873  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.482897  1603 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:11.455271  9323 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.457779  9381 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:11.459308  9194 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:11.490772  9194 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:11.491355  9194 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:11.491978  9103 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:11.456611  9294 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.500365  9294 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.502832  9294 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:11.473526  9349 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:11.497406  9232 raft_consensus.cc:3055] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:11.473785  9325 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.470991  9237 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:11.496785  9381 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:11.473713  9097 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:11.448781  9148 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:11.482087  9017 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:01:11.473888  9176 consensus_queue.cc:1059] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:01:11.517287  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 1069) took 1063 ms. Trace:
I20260709 13:01:11.508432  9349 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:11.512234  9237 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:11.518730  9017 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:11.526014  9349 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:11.496425  9323 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.510229  9232 raft_consensus.cc:740] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:11.514753  9381 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.523700  9097 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:11.519035  1600 rpcz_store.cc:276] 0709 13:01:10.454236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.490659 (+ 36423us) service_pool.cc:224] Handling call
0709 13:01:10.491211 (+   552us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:10.492121 (+   910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.492166 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:10.493018 (+   852us) log.cc:844] Serialized 52 byte log entry
0709 13:01:11.074164 (+581146us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:01:11.400842 (+326678us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.401427 (+   585us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.407068 (+  5641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.407187 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.516950 (+109763us) raft_consensus.cc:1685] finished
0709 13:01:11.516975 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.517212 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5275,"prepare.queue_time_us":332116,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":90,"raft.queue_time_us":6561,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":9584,"spinlock_wait_cycles":5676032,"thread_start_us":833120,"threads_started":2,"wal-append.queue_time_us":745678}
I20260709 13:01:11.539865  9017 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:01:11.568627  9392 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:01:11.558364  9387 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
I20260709 13:01:11.558348  9383 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:11.574124  9383 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:11.558331  9386 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:11.576478  9323 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:11.558367  9379 log.cc:927] Time spent T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:01:11.558310  9388 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.588001  9232 consensus_queue.cc:260] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.588842  9388 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:11.589665  9388 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:11.602414  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 130745us
I20260709 13:01:11.608017  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:11.609699  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 136773us
I20260709 13:01:11.595381  9228 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:11.622612  1641 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.632413  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:11.635143  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1749) took 1041 ms. Trace:
I20260709 13:01:11.635876  9342 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.635637  9097 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:11.638413  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.640254  9294 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.638890  9342 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:11.640954  9294 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.641148  9342 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.604832  9237 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.643002  9237 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:11.643368  9341 consensus_meta.cc:287] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
W20260709 13:01:11.645787  9244 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.005s
I20260709 13:01:11.635710  1677 rpcz_store.cc:276] 0709 13:01:10.594331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.599604 (+  5273us) service_pool.cc:224] Handling call
0709 13:01:10.632933 (+ 33329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.397470 (+764537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.397512 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.404098 (+  6586us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.543238 (+139140us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:11.543290 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.543372 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.634915 (+ 91543us) raft_consensus.cc:1685] finished
0709 13:01:11.634939 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.635076 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2735,"raft.queue_time_us":46923,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":885011,"threads_started":2,"wal-append.queue_time_us":218012}
I20260709 13:01:11.648656  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.649101  9400 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.649760  1597 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:11.649770  9400 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:11.653573  1672 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
I20260709 13:01:11.654105  9400 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:11.643420  9294 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:11.643374  9342 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:11.670620  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.671078  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 60302.6us
I20260709 13:01:11.667971  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:11.672550  1641 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.659972  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.674073  1599 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:11.661870  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:11.691694  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3481) took 1497 ms. Trace:
I20260709 13:01:11.692411  1672 rpcz_store.cc:276] 0709 13:01:10.194449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.195335 (+   886us) service_pool.cc:224] Handling call
0709 13:01:11.691437 (+1496102us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400432954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:11.691614 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238654720}
I20260709 13:01:11.627422  9232 raft_consensus.cc:3060] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:11.629407  9323 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:11.597568  9383 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.690841  9342 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.705711  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 255106us
I20260709 13:01:11.708091  9393 raft_consensus.cc:2804] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:11.708757  9393 raft_consensus.cc:697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:11.709828  9393 consensus_queue.cc:237] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.668462  9176 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:11.706892  1641 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.646310  9244 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.712234  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.721776  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.725930  1670 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 26: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:11.722575  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.722911  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.728593  1678 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:11.721091  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:11.723515  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.736578  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.723850  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.738358  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.738358  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.735344  1641 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:11.741230  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:11.743906  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:11.744786  1669 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
W20260709 13:01:11.745659  9396 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:01:11.738739  8490 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:11.748593  9194 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.751657  9152 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:11.738582  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 26.
I20260709 13:01:11.752944  9176 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:11.753614  9176 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:11.755838  9386 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:11.756001  9100 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:11.756516  9386 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.756603  9100 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:11.756989  9386 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:11.757102  9100 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.754642  9176 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.760522  8490 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:11.761101  8490 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:11.761262  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:11.762034  1599 raft_consensus.cc:2376] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17. Re-sending same reply.
I20260709 13:01:11.762084  8490 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.751341  9194 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:11.706697  9323 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.768352  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.659530  9343 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:11.782632  1600 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:01:11.776444  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 111121us
I20260709 13:01:11.784618  9323 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.768401  8490 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:11.778803  1597 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:01:11.800920  1675 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:11.781576  1601 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:11.734912  9294 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:11.720448  9402 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:11.818621  1751 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:01:11.826081  9279 raft_consensus.cc:3055] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:11.666766  9381 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:11.832480  8490 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:11.833925  9414 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:11.798897  9399 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:11.774930  9103 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:11.705991  9385 consensus_queue.cc:1048] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:01:11.810542  9181 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.841378  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51580.6us
I20260709 13:01:11.762108  9407 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:11.720748  9342 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.857046  9415 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:11.819406  9294 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:11.866180  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.867663  9423 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:11.849371  9414 consensus_queue.cc:1243] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:11.863077  9418 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:01:11.835135  9279 raft_consensus.cc:740] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:11.853219  9139 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:11.921846  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:11.931627  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 51004.2us
I20260709 13:01:11.932670  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.934641  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:11.879892  9103 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:11.889300  9418 consensus_queue.cc:1243] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:11.937588  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:11.915275  9194 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:11.884194  9181 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.931089  9152 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:11.889039  9198 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.939412  9097 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.943531  9276 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:11.915954  9415 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:11.941808  9421 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:01:11.975941  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.951893  9341 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:11.979377  9097 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:11.966239  9178 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:01:11.998687  9152 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:11.948789  9399 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:12.027634  9103 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.028648  9399 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:11.955212  9194 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.033219  9198 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.034183  9194 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.004662  9178 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.035013  9381 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.035530  9178 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:01:11.979861  9276 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.025028  9181 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.003304  9097 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:12.053386  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 115958us
I20260709 13:01:12.063514  1675 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []
W20260709 13:01:12.073951  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 133022us
I20260709 13:01:12.001411  9335 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:12.083704  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.093592  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.037853  9244 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.055002  9276 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:12.097765  1641 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.096815  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:01:12.104552  1675 raft_consensus.cc:606] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:12.107738  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:01:12.093847  9388 consensus_meta.cc:287] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.001s
I20260709 13:01:12.122143  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:11.989619  9279 consensus_queue.cc:260] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:12.127028  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 205766us
I20260709 13:01:12.093441  9343 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.093257  9335 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:12.132653  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.072781  9248 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:01:12.054782  9100 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.121515  9194 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:12.151643  1752 pending_rounds.cc:85] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 11
I20260709 13:01:12.153095  1752 pending_rounds.cc:107] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:01:12.153578  1752 raft_consensus.cc:2889] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.101661  9341 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:01:12.136612  9410 log.cc:927] Time spent T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
W20260709 13:01:12.161087  2279 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 2.265s (SENT)
I20260709 13:01:12.128043  9244 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:12.162503  2279 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.158207  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:12.112891  9407 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:01:12.164752  1641 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d53e959bd0a14b21aa72696bbf6d090d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.167174  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.167797  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
W20260709 13:01:12.157274  9237 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.514s	user 0.014s	sys 0.000s
W20260709 13:01:12.160161  9228 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.000s
W20260709 13:01:12.169229  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.126294  9388 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.182451  1677 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:12.173913  1748 pending_rounds.cc:85] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 12
I20260709 13:01:12.159952  9248 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:12.183338  1748 pending_rounds.cc:107] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:12.184695  1748 raft_consensus.cc:2889] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.161615  9341 consensus_queue.cc:1243] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:12.190814  1641 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:12.130231  9418 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:12.145298  9383 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.173017  9431 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:12.180966  9424 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:12.163962  9244 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:12.204389  1675 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:12.212114  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:12.213001  1599 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:12.216361  1596 raft_consensus.cc:1240] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:12.220638  1749 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:01:12.219245  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.224457  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:12.227085  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.197098  9393 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.227816  9139 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:12.228734  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:12.232326  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:12.233168  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 457632us
I20260709 13:01:12.227988  1594 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:12.235244  1750 raft_consensus.cc:1275] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:01:12.188295  9248 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:12.240407  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:12.228139  9393 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.196233  9237 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:12.252522  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.253438  1749 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:12.235998  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:12.253883  1747 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:12.254985  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.219332  9244 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.259364  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:12.263702  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:12.264462  1599 raft_consensus.cc:2468] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:12.228511  9139 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:12.264043  9103 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.282757  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:12.197548  9386 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.240500  9423 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:12.287528  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.310607  1747 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:01:12.230221  9431 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.183523  9335 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.270726  9381 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:12.299563  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67066.4us
I20260709 13:01:12.313212  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.314942  2316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:52868
W20260709 13:01:12.324545  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.385399  2316 raft_consensus.cc:606] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:12.291560  9228 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:01:12.299470  9349 consensus_meta.cc:287] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.006s
W20260709 13:01:12.394459  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81453us
I20260709 13:01:12.284432  9438 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:12.416608  1602 raft_consensus.cc:1240] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 13:01:12.414166  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:12.419569  2313 raft_consensus.cc:2368] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:12.391251  9423 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.424775  9100 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.387656  9103 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.420957  9438 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:12.428149  9438 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:12.428450  9103 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.432024  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:12.433655  9441 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:01:12.434304  9406 log.cc:927] Time spent T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.117s	user 0.000s	sys 0.007s
I20260709 13:01:12.415200  9335 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.436836  9393 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.319192  9415 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.264498  9407 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.396875  9325 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:12.441100  9017 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.003s
I20260709 13:01:12.403769  9228 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:01:12.446450  9400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.001s	sys 0.007s
I20260709 13:01:12.400415  9446 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:01:12.418136  9402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.004s	sys 0.003s
I20260709 13:01:12.469762  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:12.474155  9434 log.cc:927] Time spent T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 13:01:12.478268  9323 consensus_meta.cc:287] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.007s
I20260709 13:01:12.420228  9349 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.483592  1674 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:12.483877  9349 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.306784  9248 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.485401  9248 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:12.441346  9341 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:01:12.468400  9228 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:12.492825  9294 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.494848  9294 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:12.472194  9400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.001s	sys 0.008s
I20260709 13:01:12.472532  9446 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:12.451506  9237 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:01:12.507516  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:12.511330  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:12.515493  2314 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:01:12.498404  9232 consensus_meta.cc:287] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.797s	user 0.014s	sys 0.001s
I20260709 13:01:12.479104  9323 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:12.529275  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 142665us
I20260709 13:01:12.496104  9388 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.496948  9402 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:12.478310  9386 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.466842  9017 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.503084  9446 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:12.539956  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 472292us
W20260709 13:01:12.541251  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.542586  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.542452  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 154498us
I20260709 13:01:12.524194  9237 consensus_queue.cc:1243] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:01:12.553372  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.554203  9178 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.518s	user 0.015s	sys 0.000s
I20260709 13:01:12.602499  9276 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:12.609134  2279 leader_election.cc:336] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 3.236s (SENT)
W20260709 13:01:12.566862  9448 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:01:12.617826  9411 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:12.618188  9178 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.625062  1744 raft_consensus.cc:1240] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:01:12.651751  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.654039  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.655030  1752 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:12.656327  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:12.660111  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.661339  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.610745  9386 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.667336  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:12.663326  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73852.7us
I20260709 13:01:12.669173  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.564357  9097 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:12.657648  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 113682us
I20260709 13:01:12.581054  9139 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.687987  1599 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:12.683117  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.689886  8490 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:12.690948  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.691358  8490 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.693049  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.693912  1599 raft_consensus.cc:2393] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:12.680390  1752 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:12.694948  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:12.697980  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.701589  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:12.702644  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.707688  9435 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:12.666508  9325 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:12.709698  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.715170  8490 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:12.714049  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51932.6us
I20260709 13:01:12.717121  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:12.720674  8490 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:12.724133  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.658869  9411 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.693153  9400 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.701375  9343 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:12.733866  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.734385  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:12.737768  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.714506  9100 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:12.745674  1599 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:12.746335  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.745864  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.747234  1601 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:12.748934  1594 raft_consensus.cc:2410] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:01:12.730428  1641 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:12.749691  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.702768  9232 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:01:12.750705  1601 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 26.
I20260709 13:01:12.746910  1747 raft_consensus.cc:2410] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 25 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:01:12.699759  9386 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.752904  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.753938  1594 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:12.754338  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.735277  9194 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:12.758669  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:12.662482  9402 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.734936  9343 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:12.724623  9152 consensus_queue.cc:1059] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:01:12.760977  1673 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:12.758780  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:12.750452  9100 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:12.761121  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:12.770103  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:12.774813  9276 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:12.763242  9194 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:12.776355  9194 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:12.776844  9411 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.777866  9411 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.756455  9436 consensus_queue.cc:1048] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:01:12.781441  1671 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:12.783248  1745 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 26. Current term is 27. Ops: [24.13-26.14]
I20260709 13:01:12.783509  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:12.784996  9342 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:12.774916  9100 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:12.787202  9457 log.cc:927] Time spent T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:01:12.788731  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.789306  9435 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:12.789899  9435 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.789546  9438 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.790373  9435 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:12.770859  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:12.728415  9325 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.769157  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.795467  1566 leader_election.cc:400] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:12.797343  1566 leader_election.cc:403] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.802423  9436 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:12.763115  9383 raft_consensus.cc:2804] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:12.807694  9228 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:12.808542  8490 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:12.807920  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:12.809612  9325 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.810250  9325 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:12.810360  9228 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.813009  9097 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:12.778839  9411 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:12.816690  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 47665.3us
I20260709 13:01:12.746376  9400 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:12.976052  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.912355  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:12.880542  1670 raft_consensus.cc:1240] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.900384  1745 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:01:12.771595  9343 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:12.987068  1752 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:12.833588  1600 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:12.991706  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.983665  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:12.995121  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.897552  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:12.861662  8490 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:12.996500  8490 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:12.932133  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50830.3us
I20260709 13:01:12.898914  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.864039  2310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237"
dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:52868
I20260709 13:01:12.945291  9423 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:12.984368  9335 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.003s
W20260709 13:01:12.868709  9467 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:01:12.826161  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:12.861447  9417 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.008416  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.009953  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:13.010202  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:13.012681  1750 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:01:13.001911  2310 raft_consensus.cc:606] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:13.013549  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:12.940356  9438 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.021607  1751 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:12.900920  9139 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.863807  9017 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 30 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.815304  9232 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.968340  9228 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:01:12.959810  9325 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:12.900123  9178 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:12.947516  9386 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.992705  9248 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.014564  9426 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.017198  9244 consensus_meta.cc:287] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.731s	user 0.013s	sys 0.001s
I20260709 13:01:12.898855  9194 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.823137  9383 raft_consensus.cc:697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:13.024732  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:13.039778  9232 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:12.870451  9303 consensus_queue.cc:1059] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.151s
I20260709 13:01:13.054226  8490 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.025192  9335 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:13.045615  9325 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.047668  9248 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.051461  9244 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.059092  9414 consensus_queue.cc:1059] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:01:13.051761  9426 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:13.132925  9473 log.cc:927] Time spent T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 13:01:13.148976  9419 raft_consensus.cc:3055] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:13.170442  9477 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:13.174397  9435 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.167455  9411 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:13.180683  9325 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.086696  9383 consensus_queue.cc:237] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.155156  9419 raft_consensus.cc:740] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:13.233119  9419 consensus_queue.cc:260] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.235020  9419 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:13.191473  9426 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.192916  9418 raft_consensus.cc:3055] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:13.236557  9418 raft_consensus.cc:740] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:13.238003  9418 consensus_queue.cc:260] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:13.243729  9446 consensus_meta.cc:287] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.622s	user 0.014s	sys 0.003s
I20260709 13:01:13.244704  9446 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.277021  9435 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.293274  9446 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:12.836892  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:12.822276  1595 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
W20260709 13:01:13.366791  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.832494  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:13.370568  1597 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 24: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:12.861310  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:13.372598  1598 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:13.373238  1595 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:13.374166  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:13.374766  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:12.934350  1596 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:01:13.376009  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:13.376456  1596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3687) took 1128 ms. Trace:
I20260709 13:01:13.377115  1597 raft_consensus.cc:2393] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 23: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:12.831640  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:13.376997  1596 rpcz_store.cc:276] 0709 13:01:12.248473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.926767 (+678294us) service_pool.cc:224] Handling call
0709 13:01:12.927191 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.375880 (+448689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.376266 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.991691  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:13.378898  1601 raft_consensus.cc:2410] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:12.864313  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:13.379613  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:13.380424  1598 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:13.383806  1595 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:13.405411  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.006500  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:13.415867  1669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.010s
W20260709 13:01:13.416694  1669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.007s	sys 0.010s
I20260709 13:01:13.023149  1745 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:13.436812  1678 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:13.441329  1603 raft_consensus.cc:1275] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:01:13.443526  1601 pending_rounds.cc:85] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 13
I20260709 13:01:13.455876  1601 pending_rounds.cc:107] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:01:13.456487  1601 raft_consensus.cc:2889] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.458196  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:13.459336  1600 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:01:13.460899  1603 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:01:13.444672  1595 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 9.
W20260709 13:01:13.448346  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.463207  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.464262  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.449172  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:13.451267  1715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.028s	sys 0.022s
I20260709 13:01:13.464740  1596 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:01:13.465260  1715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.029s	sys 0.022s
I20260709 13:01:13.465564  1751 raft_consensus.cc:2410] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
W20260709 13:01:13.465804  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 694607us
I20260709 13:01:13.466925  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:13.468920  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:13.469604  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:13.451154  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.214638  9400 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:13.032703  9100 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.562808  9181 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:13.564138  9181 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.584403  9426 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.591019  1674 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:13.591451  9276 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:13.592201  9421 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:01:13.592847  9417 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:13.593173  9450 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.593824  9416 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:13.624722  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53396.2us
I20260709 13:01:13.586475  9426 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.660794  9421 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:13.661707  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.012s	sys 0.012s
W20260709 13:01:13.695112  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.012s
W20260709 13:01:13.695760  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 650268us
I20260709 13:01:13.702106  9248 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:13.703500  9481 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:13.704816  9481 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.708916  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:13.710611  1670 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
W20260709 13:01:13.712373  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 241049us
I20260709 13:01:13.717422  9100 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.720376  9426 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.724179  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:13.663738  9194 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.725358  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:13.726948  9194 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:13.664853  9454 consensus_queue.cc:1048] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:01:13.727924  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:13.729507  9454 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:13.663196  9228 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:13.730042  9454 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.671939  9139 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:13.730587  9228 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.731242  9139 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.734040  9228 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.734485  9139 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.665450  9176 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:13.682770  9416 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.735693  9176 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.738188  9416 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.676246  9279 raft_consensus.cc:3060] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:13.740494  9481 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.679627  9325 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:13.743394  9325 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.745882  9325 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:13.747102  1752 consensus_meta.cc:287] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.011s
I20260709 13:01:13.730587  9454 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:13.750017  1744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1668) took 1594 ms. Trace:
I20260709 13:01:13.750510  1744 rpcz_store.cc:276] 0709 13:01:12.156064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.156234 (+   170us) service_pool.cc:224] Handling call
0709 13:01:12.156592 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.637221 (+480629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.749285 (+1112064us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540017c5d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.749717 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071323520}
I20260709 13:01:13.685886  9232 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.686465  9446 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.688493  2280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.012s
W20260709 13:01:13.756376  2280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.010s	sys 0.012s
I20260709 13:01:13.756587  9446 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:13.758749  1743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46136 (request call id 1673) took 1113 ms. Trace:
I20260709 13:01:13.756639  9237 raft_consensus.cc:993] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: : Instructing follower 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:01:13.674464  9181 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:13.761031  9446 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.738590  9176 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:13.717271  1600 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 30.
I20260709 13:01:13.764700  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 3677) took 1985 ms. Trace:
I20260709 13:01:13.765233  1602 rpcz_store.cc:276] 0709 13:01:11.779267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.779472 (+   205us) service_pool.cc:224] Handling call
0709 13:01:11.780018 (+   546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.417451 (+637433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.763881 (+1346430us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54001a4354. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.764427 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463449472}
I20260709 13:01:13.725418  2279 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:13.767814  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.003s	sys 0.023s
W20260709 13:01:13.768548  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.003s	sys 0.023s
W20260709 13:01:13.769682  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 784154us
I20260709 13:01:13.771425  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.772557  1748 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
I20260709 13:01:13.775300  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.776328  1747 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:01:13.777652  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.780138  1749 raft_consensus.cc:2468] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:13.690500  9450 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.778447  9454 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.786911  9480 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:13.787889  9323 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:13.790478  1598 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:13.759308  1743 rpcz_store.cc:276] 0709 13:01:12.644878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.645107 (+   229us) service_pool.cc:224] Handling call
0709 13:01:12.645615 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.748304 (+102689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.748345 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.748396 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:12.748439 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.758120 (+1009681us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540013a954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.758209 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.758518 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235645184}
W20260709 13:01:13.791262  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61373.2us
I20260709 13:01:13.786899  9454 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.796077  9181 raft_consensus.cc:1081] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Signalling peer 693257b3078444e0bd26d3e82159d452 to start an election
I20260709 13:01:13.801874  9438 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:01:13.795229  1752 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:13.802553  9438 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:13.792979  9450 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.831583  9388 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.833988  9388 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.841382  9438 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:13.846654  9438 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:01:13.847280  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48448 (request call id 3258) took 1202 ms. Trace:
I20260709 13:01:13.847792  1745 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:13.847883  1749 rpcz_store.cc:276] 0709 13:01:12.645328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.662814 (+ 17486us) service_pool.cc:224] Handling call
0709 13:01:13.847019 (+1184205us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002e7054. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:13.847198 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558045440}
I20260709 13:01:13.851191  1745 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:13.852330  1749 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:01:13.855396  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.858397  1747 pending_rounds.cc:85] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 6
I20260709 13:01:13.858788  1747 pending_rounds.cc:107] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:01:13.859135  1747 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.862260  9388 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.864372  1752 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:01:13.866559  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.878033  1677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46986 (request call id 3507) took 2163 ms (client timeout 2047 ms). Trace:
I20260709 13:01:13.880708  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3273) took 1017 ms. Trace:
I20260709 13:01:13.881279  1750 rpcz_store.cc:276] 0709 13:01:12.863113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.902979 (+ 39866us) service_pool.cc:224] Handling call
0709 13:01:12.903301 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.020601 (+117300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.880105 (+859504us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001c39d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.880442 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250499968}
I20260709 13:01:13.866717  1752 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:01:13.885468  1752 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Aborting all ops after (but not including) 12
W20260709 13:01:13.876421  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.887136  1752 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 20.13
I20260709 13:01:13.888033  1752 raft_consensus.cc:2917] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Aborting config change with OpId 20.13: Aborted: Op aborted by new leader
W20260709 13:01:13.874338  9343 consensus_meta.cc:287] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.859s	user 0.016s	sys 0.005s
I20260709 13:01:13.889870  9343 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:13.880873  1677 rpcz_store.cc:269] 0709 13:01:11.714528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.717458 (+  2930us) service_pool.cc:224] Handling call
0709 13:01:13.877481 (+2160023us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540036f6d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:13.877731 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019793152}
I20260709 13:01:13.868232  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:13.890826  1752 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:13.899055  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 75474.8us
W20260709 13:01:13.885408  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38702 (request call id 1756) took 1735 ms (client timeout 1658 ms). Trace:
I20260709 13:01:13.907745  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3523) took 1141 ms. Trace:
W20260709 13:01:13.908129  1675 rpcz_store.cc:269] 0709 13:01:12.149752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.154992 (+  5240us) service_pool.cc:224] Handling call
0709 13:01:13.884791 (+1729799us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b5400193f54. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f94814912fa 00007f9486452b17 00007f947f9cd6d4 00007f947f9cd662 00007f947f9cd591 00007f947f9cd50c 00007f947f9cc7c2 00007f947f7c848c 00007f947f7c78c6 00007f947f7c726f
0709 13:01:13.885062 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89358208}
I20260709 13:01:13.912987  1674 rpcz_store.cc:276] 0709 13:01:12.764242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.764418 (+   176us) service_pool.cc:224] Handling call
0709 13:01:12.764827 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.645148 (+880321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.894570 (+249422us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54001d3dd4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.905465 (+ 10895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818154880}
I20260709 13:01:13.890908  9418 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.930397  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3517) took 1865 ms. Trace:
W20260709 13:01:13.931973  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 162631us
I20260709 13:01:13.931752  1678 rpcz_store.cc:276] 0709 13:01:12.065226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.065406 (+   180us) service_pool.cc:224] Handling call
0709 13:01:12.095625 (+ 30219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.454798 (+1359173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.916484 (+461686us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003e62d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.930293 (+ 13809us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3084108544}
I20260709 13:01:13.921897  9279 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:13.938460  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:13.948446  1671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1760) took 1064 ms. Trace:
I20260709 13:01:13.949069  1671 rpcz_store.cc:276] 0709 13:01:12.862323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.862522 (+   199us) service_pool.cc:224] Handling call
0709 13:01:12.906547 (+ 44025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.414782 (+508235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:13.593152 (+178370us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.646562 (+ 53410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.646712 (+   150us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:13.647837 (+  1125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.917081 (+269244us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540006d954. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:13.917136 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.926216 (+  9080us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147817,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":9100,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":45047,"spinlock_wait_cycles":1167220992,"thread_start_us":221236,"threads_started":2,"wal-append.queue_time_us":194221}
W20260709 13:01:13.966444  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.973263  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.975028  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.976034  1744 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 24.
I20260709 13:01:13.980381  9493 ts_tablet_manager.cc:933] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:13.984063  9427 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:14.023736  9427 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.025362  9427 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.026424  9335 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:14.026731  9429 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:14.027400  9429 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:01:14.028518  9435 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.029271  9435 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.030475  9429 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:14.030998  9438 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.985157  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:13.989814  9244 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:13.993532  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 125534us
I20260709 13:01:13.995731  9343 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:13.998106  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:13.998695  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:13.995726  1747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3556) took 1004 ms. Trace:
I20260709 13:01:14.036932  1750 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:14.007967  1752 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 18 index: 7. (index mismatch)
W20260709 13:01:14.011983  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 93942.6us
I20260709 13:01:14.013981  9459 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:14.020961  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.027364  9335 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:13.994872  1594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55880 (request call id 1079) took 1164 ms. Trace:
I20260709 13:01:14.046872  1671 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 14: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:01:13.970381  9437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.019s	sys 0.032s
I20260709 13:01:14.045874  9478 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.033218  9323 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.041105  9459 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.072578  1598 raft_consensus.cc:1240] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:14.073611  9427 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:14.073796  9148 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.074193  9480 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:14.077929  9383 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:14.106642  9383 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:14.107191  9383 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:14.108678  9383 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.038955  9438 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.112625  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.114893  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.079797  9237 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:14.137459  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.080868  9244 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:14.080780  9388 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:14.081943  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.140939  1752 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:01:14.142599  1752 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 26. Current term is 27. Ops: [24.13-26.14]
I20260709 13:01:14.082412  9194 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:14.054481  9437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.020s	sys 0.033s
I20260709 13:01:14.115252  9438 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.037312  1747 rpcz_store.cc:276] 0709 13:01:12.991089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.778944 (+787855us) service_pool.cc:224] Handling call
0709 13:01:13.830753 (+ 51809us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:13.864663 (+ 33910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.864703 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:13.866717 (+  2014us) log.cc:844] Serialized 78 byte log entry
0709 13:01:13.876065 (+  9348us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b48002001d8. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94863b6aa1 00007f94863adb37 00007f94863ad9ca 00007f94864a526f 00007f94864a4f37 00007f94864b955c 00007f94864b9508 00007f94864b9488 00007f94864b9443 00007f94864b86ec 00007f94853e2a96
0709 13:01:13.938070 (+ 62005us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:13.938130 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.938230 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.995317 (+ 57087us) raft_consensus.cc:1685] finished
0709 13:01:13.995341 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.995636 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4021,"raft.run_cpu_time_us":1043,"raft.run_wall_time_us":11819,"spinlock_wait_cycles":25094016,"thread_start_us":66805,"threads_started":1,"wal-append.queue_time_us":89281}
I20260709 13:01:14.043574  1594 rpcz_store.cc:276] 0709 13:01:12.830634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.834355 (+  3721us) service_pool.cc:224] Handling call
0709 13:01:12.835045 (+   690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.835639 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:12.835682 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.846100 (+ 10418us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.768251 (+922151us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b1800278bc0. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e382e07 00007f94871ddab9 00007f947e39f69b 00007f947e39d93f 00007f947e39fc02 00007f948102720b 00007f948102cd23 00007f948102d0d1 00007f9481448a0f
0709 13:01:13.939945 (+171694us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:13.940014 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.943181 (+  3167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.994328 (+ 51147us) raft_consensus.cc:1685] finished
0709 13:01:13.994348 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.994649 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":18039,"spinlock_wait_cycles":2809600,"thread_start_us":137716,"threads_started":1,"wal-append.queue_time_us":1121505}
I20260709 13:01:14.093050  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.092602  9478 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.092644  9148 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.151470  9478 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.151760  9148 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.043479  9429 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:14.152627  9429 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.153199  1750 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:14.154363  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 133) took 6953 ms. Trace:
I20260709 13:01:14.156086  9429 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.097905  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.099754  9323 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.046069  9435 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.104489  9152 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.158255  9152 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.088680  9459 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:14.116034  1675 raft_consensus.cc:1240] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:14.164713  9383 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:14.118659  1597 raft_consensus.cc:1240] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:14.122265  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.080030  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.167289  1600 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
I20260709 13:01:14.167567  9435 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:14.123413  9335 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.132511  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.167881  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.168171  9435 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.134166  1598 raft_consensus.cc:1240] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:14.134891  9418 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:14.168664  9435 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:14.169062  9418 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.170519  9323 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:14.168659  1599 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 19.
I20260709 13:01:14.172861  9152 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.174285  9418 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:14.135663  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
W20260709 13:01:14.167289  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45204.9us
W20260709 13:01:14.176404  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57015.5us
I20260709 13:01:14.177702  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.177772  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:14.182181  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.192584  9460 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:14.192704  1674 raft_consensus.cc:2376] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 26. Re-sending same reply.
I20260709 13:01:14.193325  9460 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:14.193837  9460 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.179890  9323 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:14.179242  9335 raft_consensus.cc:2764] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:01:14.195241  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.196626  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.197959  1677 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:14.181751  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.200179  9335 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:14.201117  9335 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:14.201432  1677 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260709 13:01:14.202548  9335 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.204686  1677 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:14.205597  9478 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:14.206171  9323 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.206960  9323 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:14.206786  9429 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:14.182771  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.212924  1675 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:14.214318  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.215818  9478 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:14.216347  9478 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:14.216851  9478 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:14.217458  9493 tablet_copy_client.cc:323] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:01:14.229791  1751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48454 (request call id 3555) took 1239 ms. Trace:
I20260709 13:01:14.244975  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:14.247216  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 112247us
I20260709 13:01:14.154848  1501 rpcz_store.cc:276] 0709 13:01:07.200677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.200870 (+   193us) service_pool.cc:224] Handling call
0709 13:01:14.154071 (+6953201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:10.691894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:10.693625 (+  1731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:10.693667 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:01:10.693690 (+    23us) tablet.cc:662] Decoding operations
0709 13:01:10.955736 (+262046us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:10.959176 (+  3440us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:10.961923 (+  2747us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:11.271617 (+309694us) tablet.cc:701] Row locks acquired
0709 13:01:11.275867 (+  4250us) write_op.cc:260] PREPARE: finished
0709 13:01:11.306247 (+ 30380us) write_op.cc:270] Start()
0709 13:01:11.312363 (+  6116us) write_op.cc:276] Timestamp: P: 1783602071302619 usec, L: 0
0709 13:01:11.314952 (+  2589us) op_driver.cc:348] REPLICATION: starting
0709 13:01:11.382851 (+ 67899us) log.cc:844] Serialized 3790 byte log entry
0709 13:01:11.796639 (+413788us) op_driver.cc:464] REPLICATION: finished
0709 13:01:11.837344 (+ 40705us) write_op.cc:301] APPLY: starting
0709 13:01:11.837481 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:12.426095 (+588614us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:12.426215 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:12.899982 (+473767us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:12.900292 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:01:12.900355 (+    63us) write_op.cc:312] APPLY: finished
0709 13:01:12.900715 (+   360us) log.cc:844] Serialized 89 byte log entry
0709 13:01:13.044991 (+144276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:13.046804 (+  1813us) write_op.cc:454] Released schema lock
0709 13:01:13.046869 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:13.047387 (+   518us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:13.047419 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147444,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":40288,"apply.run_cpu_time_us":49474,"apply.run_wall_time_us":1210037,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41801,"num_ops":9,"prepare.queue_time_us":251837,"prepare.run_cpu_time_us":25599,"prepare.run_wall_time_us":860488,"raft.queue_time_us":220716,"raft.run_cpu_time_us":8195,"raft.run_wall_time_us":43584,"replication_time_us":481390,"thread_start_us":624465,"threads_started":5,"wal-append.queue_time_us":357922,"wal-append.run_cpu_time_us":41928,"wal-append.run_wall_time_us":2301247}]]}
I20260709 13:01:14.224160  9460 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.230477  1751 rpcz_store.cc:276] 0709 13:01:12.990524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.470105 (+479581us) service_pool.cc:224] Handling call
0709 13:01:13.470744 (+   639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.471483 (+   739us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:13.655168 (+183685us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.228923 (+573755us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.229282 (+   359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.229354 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:14.229421 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.229530 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.229697 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1699,"prepare.queue_time_us":350554,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":10024,"raft.queue_time_us":5203,"thread_start_us":566291,"threads_started":2}
I20260709 13:01:14.258342  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.268919  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.273176  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:14.243399  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 17 to 18, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:14.281658  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.281828  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.270857  9152 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:14.279215  1497 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 18 to 19, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.287345  9429 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:14.280992  9459 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.306352  9148 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:14.315374  9342 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:14.320930  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.297750  9152 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.323279  9342 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:14.327996  1497 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:14.330309  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:14.331473  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.330920  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.333544  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 81053.2us
I20260709 13:01:14.335649  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.338232  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:14.339864  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.325320  9429 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:14.338904  1749 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:14.340200  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.341833  1675 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
W20260709 13:01:14.342496  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 81975.6us
I20260709 13:01:14.333214  9342 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:14.341377  9335 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:14.346859  2279 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.350073  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.343902  1497 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 17 to 19, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:14.350808  1752 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
W20260709 13:01:14.346199  9506 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:01:14.329437  9148 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.361512  1675 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:14.333695  9435 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.350744  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.352334  9402 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:14.349896  9438 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.365540  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.365778  9438 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.366560  1671 raft_consensus.cc:2393] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 9: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:14.355527  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.355765  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.355887  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.368321  9438 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.368606  2310 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:01:14.352511  9388 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.369236  9402 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.369789  9388 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:14.371666  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.372365  9388 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.356702  9152 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.357018  9429 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.358136  9479 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:14.357995  9418 consensus_queue.cc:1059] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:14.358930  9335 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:14.374788  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.374635  9479 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.354442  9460 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.384588  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.389338  2310 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:14.384181  9479 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:14.382375  9438 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:14.398404  9438 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.402856  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.407254  1678 raft_consensus.cc:2368] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19.
I20260709 13:01:14.394454  9402 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.410022  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:14.415939  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.417030  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.419031  9148 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.416265  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.422509  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.429368  1671 raft_consensus.cc:2393] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:14.420537  9343 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:14.436542  9503 log.cc:927] Time spent T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:14.436246  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.438635  9402 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:14.438985  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet d53e959bd0a14b21aa72696bbf6d090d from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:01:14.440022  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet d53e959bd0a14b21aa72696bbf6d090d from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-d53e959bd0a14b21aa72696bbf6d090d
I20260709 13:01:14.439913  9402 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:14.444949  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 52377.4us
I20260709 13:01:14.445922  9402 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.446138  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:14.446516  9438 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.447342  9438 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:01:14.448542  9335 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.449442  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.416075  9459 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.454676  9435 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.446934  1497 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 20 to 21, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.420806  9478 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.458835  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.463992  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.464540  9427 raft_consensus.cc:3055] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:14.465164  9335 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.470371  9335 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.472788  9335 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.457067  9460 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:14.463387  9323 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.482596  1677 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
I20260709 13:01:14.467779  9427 raft_consensus.cc:740] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.492383  1497 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 17 to 18, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:14.495105  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.495983  1674 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:14.500813  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:14.501477  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:14.506207  1677 raft_consensus.cc:1240] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:14.507051  9418 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:14.508832  9335 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:14.509359  9335 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.509748  9335 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.509538  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.512413  9478 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:14.505420  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 91179us
I20260709 13:01:14.514030  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.515269  9323 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:14.515805  9510 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260709 13:01:14.520072  9323 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:14.522142  1688 tablet_copy_source_session.cc:215] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:14.517458  9479 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.533456  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:14.536052  9479 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.524039  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.537935  1751 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:14.524559  9427 consensus_queue.cc:260] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.540527  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.540946  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.541224  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.524574  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.541770  1671 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:14.526167  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.542970  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.541512  1674 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:14.515395  1497 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 13 to 16, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.527000  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.544694  1745 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:14.545127  1497 catalog_manager.cc:5697] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:14.545187  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.527863  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.547494  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.536777  9460 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:14.547884  1752 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:14.547905  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.548296  9460 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.548740  9460 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.548913  1674 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:14.550236  1670 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:14.552011  9427 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:14.558193  1745 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:14.560707  1497 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.564863  1678 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:14.562893  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.572042  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.573076  9480 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.574743  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.576148  9493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e959bd0a14b21aa72696bbf6d090d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.575768  1497 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 reported cstate change: term changed from 23 to 24, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 24 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.568404  1671 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:14.569693  9342 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.571132  9479 consensus_queue.cc:1059] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:14.535214  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:14.590216  9479 raft_consensus.cc:3055] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:14.591112  9479 raft_consensus.cc:740] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.523063  9418 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.594455  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.595309  1671 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:14.592733  9479 consensus_queue.cc:260] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.597270  9323 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:14.600852  9323 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:14.601394  9323 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:14.601730  9479 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.616842  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.617771  1670 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:14.623064  9342 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:14.608085  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73054.4us
I20260709 13:01:14.606180  9335 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.609163  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:14.627092  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 116978us
I20260709 13:01:14.628047  1671 raft_consensus.cc:2410] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:01:14.634579  9335 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.635118  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.637252  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.640339  1670 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:14.642827  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.643249  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:14.642763  1566 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.590s (SENT)
I20260709 13:01:14.644232  9248 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:14.641511  9427 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.647362  9460 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.654850  9460 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:14.656599  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.657096  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.673154  1678 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:14.657399  1670 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 12.
I20260709 13:01:14.657557  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.658010  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.674677  1677 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:14.658412  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.677151  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:14.678218  1599 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:14.674677  1675 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:14.677142  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.681321  1752 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:14.658856  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:14.662776  1745 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25. Ops: [22.13-24.14]
I20260709 13:01:14.683504  1669 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23.
I20260709 13:01:14.663343  1598 raft_consensus.cc:1240] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
W20260709 13:01:14.657145  1566 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.613s (SENT)
W20260709 13:01:14.668285  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 93682us
I20260709 13:01:14.669864  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:14.674710  9323 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.689378  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.689670  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:14.690382  1598 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:14.691339  9248 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:14.691898  9248 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.691754  9342 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:14.692222  1598 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:14.692346  9248 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:14.694154  9342 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:14.694811  9342 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:14.696691  9480 consensus_queue.cc:1059] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:14.698519  9418 raft_consensus.cc:3055] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:14.699043  9418 raft_consensus.cc:740] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.700177  9418 consensus_queue.cc:260] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.700446  1598 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:14.701963  9418 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.703908  1598 raft_consensus.cc:1275] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:01:14.699051  9437 consensus_queue.cc:1059] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 13:01:14.705152  9437 raft_consensus.cc:3055] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:14.705593  9437 raft_consensus.cc:740] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.705869  1598 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:14.706056  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:14.706768  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.707114  9335 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:14.707600  9493 tablet_copy_client.cc:806] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:14.707834  1599 raft_consensus.cc:2393] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:14.708364  9493 tablet_copy_client.cc:670] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:14.708647  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.709556  9335 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:14.710395  9335 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.709302  9437 consensus_queue.cc:260] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.710709  1745 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:01:14.710837  9335 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:14.712965  9437 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:14.720613  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.721593  9342 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.691270  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.723519  9385 consensus_queue.cc:1059] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:14.729562  9385 raft_consensus.cc:3055] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:14.729992  9385 raft_consensus.cc:740] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.730545  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.731367  1598 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:01:14.731046  9385 consensus_queue.cc:260] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.733317  9385 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.737141  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.737560  9323 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 26 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:14.738175  2282 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.739485  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 48377us
I20260709 13:01:14.726300  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:14.726905  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.742960  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:14.744153  9460 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:14.744819  1715 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.726541  9335 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.723744  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.739997  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:14.746317  9276 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:14.746771  9276 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:14.747188  9276 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.724457  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:14.747887  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93"
dest_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:54670
I20260709 13:01:14.748149  1597 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:14.748708  1600 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:14.749118  1600 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:14.741649  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.752120  9427 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:14.752677  9427 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.753028  9427 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:14.746342  1599 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:14.753733  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:14.754443  1669 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:14.760435  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.761291  1743 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:14.764371  1748 raft_consensus.cc:1240] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:14.764336  9276 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.766628  9460 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:14.767498  9460 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:14.767969  1752 raft_consensus.cc:1240] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Rejecting Update request from peer 570958eb733a4af7ae16ae020998c8b4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:14.771905  1600 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.748019  9335 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.771714  9248 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:14.780464  1600 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:14.774730  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 54230.6us
I20260709 13:01:14.783874  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.784901  1748 raft_consensus.cc:2410] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 13:01:14.785094  1751 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:14.776510  9429 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:14.790362  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.790912  9429 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.790855  9418 consensus_queue.cc:1059] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:14.789511  1745 raft_consensus.cc:3055] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:14.791895  1745 raft_consensus.cc:740] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:14.787231  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.795673  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.795419  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.801224  9343 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:14.801756  9343 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.802135  9343 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:14.803921  9418 consensus_queue.cc:1059] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:14.805040  9438 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:14.805145  9495 raft_consensus.cc:3055] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:14.805572  9438 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.805721  9495 raft_consensus.cc:740] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:14.806008  9438 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:01:14.808343  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.810797  1669 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:01:14.797791  9429 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:14.809508  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.813716  1597 raft_consensus.cc:2410] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 13:01:14.813686  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.816365  1599 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:14.816570  1743 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:01:14.806887  9495 consensus_queue.cc:260] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.820976  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.800385  9479 raft_consensus.cc:3055] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:14.829161  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:14.829718  1752 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
W20260709 13:01:14.830349  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.825268  1598 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:01:14.834182  1597 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:14.829892  1745 consensus_queue.cc:260] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.847352  1749 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:01:14.853435  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.820713  9480 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.854540  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.830813  9323 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:14.857264  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.861111  1752 raft_consensus.cc:2393] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 27: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:14.857831  1745 raft_consensus.cc:3060] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:14.858878  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.861896  1749 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:14.829319  9479 raft_consensus.cc:740] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:01:14.863118  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49555.4us
I20260709 13:01:14.863729  9479 consensus_queue.cc:260] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.864601  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:14.865573  9479 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.840886  9276 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:14.873095  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.876242  1599 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:14.887120  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.891259  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.894367  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.895164  1746 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:14.896246  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.896755  9248 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:14.897410  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.895113  1747 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:01:14.899963  2316 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:01:14.900449  2316 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 12
I20260709 13:01:14.900751  2316 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 20.13
I20260709 13:01:14.901079  2316 raft_consensus.cc:2917] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Aborting config change with OpId 20.13: Aborted: Op aborted by new leader
I20260709 13:01:14.901618  2316 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:14.902823  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.880484  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.906100  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:14.910746  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:14.894240  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.911439  1601 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 18.
I20260709 13:01:14.920256  1745 raft_consensus.cc:1275] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:14.923298  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:14.924090  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:14.939256  1745 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:14.924686  9493 tablet_copy_client.cc:538] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:14.868595  9480 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.941498  2279 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:14.946776  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.946959  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.930022  9495 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.966089  2310 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:14.967604  9478 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.968184  9478 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.970566  9478 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.946426  9383 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.976212  9383 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:14.978709  9383 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:14.950273  9437 raft_consensus.cc:2804] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:14.953217  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:14.946077  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:14.910251  9427 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:14.956067  1669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
new_leader_uuid: "693257b3078444e0bd26d3e82159d452"
 from {username='slave'} at 127.0.0.1:50078
I20260709 13:01:15.003911  1669 raft_consensus.cc:606] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Received request to transfer leadership to TS 693257b3078444e0bd26d3e82159d452
I20260709 13:01:14.958765  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:14.957178  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:14.961439  9523 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:01:14.954005  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.026472  1598 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:14.993027  2313 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:15.002720  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54264.6us
I20260709 13:01:15.004665  2316 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:15.028075  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:15.004678  1749 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 24.
I20260709 13:01:14.946877  9525 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:15.024963  9437 raft_consensus.cc:697] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:15.036868  9527 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:15.084182  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 127211us
I20260709 13:01:15.002199  9343 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.051497  9383 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.034415  9438 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.096704  9529 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.093782  2313 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
W20260709 13:01:15.099759  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 234737us
W20260709 13:01:15.104619  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 198714us
I20260709 13:01:15.107421  1594 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:15.109511  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:15.110332  1749 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 26.
W20260709 13:01:15.123896  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.129109  9427 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.129567  9343 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.130713  9437 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.132838  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:15.135637  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:15.136384  1598 raft_consensus.cc:3060] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:15.136803  9323 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:15.096012  9335 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:15.139765  9529 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.142499  9529 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.143000  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.144073  9383 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.150290  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:15.180356  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 71477.2us
I20260709 13:01:15.139808  9438 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.197261  1598 raft_consensus.cc:2468] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 23.
I20260709 13:01:15.189355  9335 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:01:15.248421  2314 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 14.
I20260709 13:01:15.188294  9525 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:01:15.268711  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.191731  9343 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:15.252487  9538 consensus_queue.cc:1059] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:01:15.270277  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 125660us
I20260709 13:01:15.272581  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:01:15.288012  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.267287  9438 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.268620  9525 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.178697  9383 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:01:15.320936  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.326165  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:15.316809  9515 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:15.332711  1674 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 13:01:15.310673  9531 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:15.310467  9343 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:15.318931  9480 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:15.318758  9538 consensus_queue.cc:1243] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:15.362792  9493 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:01:15.363744  9527 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.319561  9438 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.377460  9546 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.382274  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:15.379951  9546 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.386719  9479 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.387238  9479 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.387809  9479 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:15.395345  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.375635  9531 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.386840  9343 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.400043  9546 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.403016  9546 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:15.403077  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 107056us
I20260709 13:01:15.404171  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:15.403594  9546 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:15.406922  9546 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.407135  9438 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.408802  9529 raft_consensus.cc:3055] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:15.409287  9529 raft_consensus.cc:740] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:15.410233  9529 consensus_queue.cc:260] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.412931  9529 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:15.413488  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 87522us
W20260709 13:01:15.414091  9429 consensus_meta.cc:287] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.009s
I20260709 13:01:15.414548  9429 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.415277  9524 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:15.416239  9524 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:15.422338  9432 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:15.422500  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:15.424393  9432 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:15.424717  9531 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:15.424904  9432 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:15.425391  9432 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:15.426504  9534 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:15.427783  9460 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:15.428236  9460 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.429224  9460 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.432301  9429 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.433431  1669 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:15.435858  9460 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.436461  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.437161  9479 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:15.462610  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 190222us
W20260709 13:01:15.470062  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 55416.2us
I20260709 13:01:15.464308  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:15.475693  9383 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:15.490301  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.489557  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.493897  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:15.494244  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.494621  1669 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:15.500288  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.491974  9526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.017s	sys 0.019s
I20260709 13:01:15.479981  9531 consensus_queue.cc:1059] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:01:15.496383  9479 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:15.505045  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.512665  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:15.513881  1669 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:01:15.515758  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.516218  2314 raft_consensus.cc:1240] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
W20260709 13:01:15.501808  9526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.018s	sys 0.019s
I20260709 13:01:15.519158  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:15.520347  2313 raft_consensus.cc:2410] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:15.492110  9512 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:15.522921  2279 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:15.524005  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:15.532020  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.532464  1674 raft_consensus.cc:1240] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:15.533427  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:15.534878  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.536357  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.527650  9553 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:15.537251  9553 consensus_queue.cc:1243] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:15.537674  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.538957  9553 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.501080  9383 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:15.530055  9479 raft_consensus.cc:2804] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:15.540767  9479 raft_consensus.cc:697] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:15.541308  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.540973  9383 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.541970  1675 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:15.541730  9479 consensus_queue.cc:237] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.535014  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.545818  1677 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:15.529011  9558 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:15.522120  9554 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:01:15.554461  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.557884  1669 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 29. Current term is 30. Ops: []
I20260709 13:01:15.558573  9432 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.565025  9512 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:15.567312  2313 raft_consensus.cc:2468] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 17.
I20260709 13:01:15.569375  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.572866  9526 raft_consensus.cc:3055] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:15.586644  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.590212  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.594476  2314 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:15.595700  1674 raft_consensus.cc:2393] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 26: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:15.595942  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:15.583251  9526 raft_consensus.cc:740] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:15.599654  9526 consensus_queue.cc:260] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.583279  9512 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:15.601478  1675 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:15.582976  9554 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:15.602830  9554 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.604159  1677 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:15.605185  9554 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:15.605799  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.607707  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 92103.9us
I20260709 13:01:15.610409  9553 consensus_queue.cc:1048] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:15.618525  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 140792us
W20260709 13:01:15.621611  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.623972  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.621026  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.627882  2313 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:15.600878  9526 raft_consensus.cc:3060] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:15.611274  9553 consensus_queue.cc:1243] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:15.635152  9529 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:15.629354  9554 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:01:15.642303  9512 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.657361  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.659054  9512 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:15.660732  9429 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:15.661255  9429 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:15.661697  9429 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:15.662444  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 195) took 10933 ms. Trace:
I20260709 13:01:15.647876  9546 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.664181  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.646787  9560 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:01:15.666392  9546 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:15.662947  1497 rpcz_store.cc:276] 0709 13:01:04.732189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.732421 (+   232us) service_pool.cc:224] Handling call
0709 13:01:15.662348 (+10929927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:14.651229 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:14.652076 (+   847us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:14.652137 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:01:14.652161 (+    24us) tablet.cc:662] Decoding operations
0709 13:01:14.653442 (+  1281us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:14.653561 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:14.653596 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:14.654991 (+  1395us) tablet.cc:701] Row locks acquired
0709 13:01:14.655051 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:01:14.655292 (+   241us) write_op.cc:270] Start()
0709 13:01:14.655501 (+   209us) write_op.cc:276] Timestamp: P: 1783602074655208 usec, L: 0
0709 13:01:14.684230 (+ 28729us) op_driver.cc:348] REPLICATION: starting
0709 13:01:14.685261 (+  1031us) log.cc:844] Serialized 4422 byte log entry
0709 13:01:14.916986 (+231725us) op_driver.cc:464] REPLICATION: finished
0709 13:01:15.096859 (+179873us) write_op.cc:301] APPLY: starting
0709 13:01:15.096978 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:15.350243 (+253265us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:15.350405 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:15.612721 (+262316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:15.613202 (+   481us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:01:15.613269 (+    67us) write_op.cc:312] APPLY: finished
0709 13:01:15.613814 (+   545us) log.cc:844] Serialized 105 byte log entry
0709 13:01:15.615009 (+  1195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:15.615213 (+   204us) write_op.cc:454] Released schema lock
0709 13:01:15.615307 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:15.615910 (+   603us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:15.615952 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":138909,"apply.run_cpu_time_us":24838,"apply.run_wall_time_us":519033,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":24746,"prepare.run_cpu_time_us":9799,"prepare.run_wall_time_us":82021,"raft.queue_time_us":112079,"raft.run_cpu_time_us":15001,"raft.run_wall_time_us":179999,"replication_time_us":189643,"thread_start_us":181408,"threads_started":4,"wal-append.queue_time_us":49117}]]}
I20260709 13:01:15.671836  9524 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:15.673043  1715 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:15.672843  9460 consensus_queue.cc:1059] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:15.672819  9432 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:15.673738  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.674834  9524 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:15.677038  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.679927  1496 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.684264  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:15.683852  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 74635.1us
I20260709 13:01:15.689167  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.688163  1715 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:15.692795  9531 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:15.693297  9531 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:15.693713  9531 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:15.687489  9512 raft_consensus.cc:2804] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:15.683822  9524 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:15.691138  9558 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:15.697906  9432 raft_consensus.cc:3055] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:15.704701  9432 raft_consensus.cc:740] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.705750  9432 consensus_queue.cc:260] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.707140  9432 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:15.709206  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.710055  1677 raft_consensus.cc:2393] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 25: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:15.695823  9512 raft_consensus.cc:697] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.712340  9512 consensus_queue.cc:237] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.720897  9479 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.721642  9479 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.724259  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.728541  1641 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:15.730370  9460 raft_consensus.cc:2804] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:15.732136  9557 consensus_queue.cc:1059] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:15.732452  9460 raft_consensus.cc:697] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.733476  9558 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:15.733556  9534 raft_consensus.cc:3055] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:15.734081  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:15.733678  9460 consensus_queue.cc:237] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.735281  9534 raft_consensus.cc:740] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.735936  9524 consensus_queue.cc:1059] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:15.736737  9524 consensus_queue.cc:1243] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 17.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:15.736685  9534 consensus_queue.cc:260] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.735287  9558 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:15.740868  1669 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:15.741508  1496 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.744637  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.747046  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.740911  9558 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:15.740038  9560 raft_consensus.cc:2764] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:01:15.754755  9479 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:15.749627  9524 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.758744  1715 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:15.734673  9429 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.751278  9525 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:15.759850  9525 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:15.760921  9525 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.7, Last appended by leader: 7, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.762284  9525 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:15.762506  9512 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.761844  9429 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.739367  9534 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:15.743028  9557 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.750308  9343 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:15.765295  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.738288  9529 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.761844  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:15.773069  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:15.734527  9531 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.749671  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:01:15.776290  2279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.780484  1750 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:15.787998  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:15.787205  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:15.782974  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:15.785610  1496 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:15.790098  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 99311.7us
I20260709 13:01:15.824206  1678 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:01:15.820406  9323 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:15.817970  9529 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:15.819958  9276 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:15.821710  9460 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:01:15.859817  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:15.860459  1750 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:15.777096  9512 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:15.788108  9429 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:15.774935  9557 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.817220  9342 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 29.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:01:15.821203  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.841035  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.841276  9480 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:15.826699  9531 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.827441  1496 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 22 to 23, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:15.847208  9558 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.853117  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:15.859251  9526 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:15.870896  2313 raft_consensus.cc:2393] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:15.856597  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:15.859997  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:15.867594  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:15.861610  9512 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.856910  9323 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:15.872721  9342 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:01:15.872705  1496 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 21, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:15.877151  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:15.873901  1749 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:01:15.874413  9418 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:01:15.875154  9558 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.878139  1747 raft_consensus.cc:2410] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:01:15.864980  9524 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:15.891053  1750 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:15.863732  9529 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:15.881984  9531 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.870232  9429 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:15.898180  9531 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.899101  9429 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.900588  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:15.901611  9553 consensus_queue.cc:1059] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:15.902383  9383 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:15.870095  9478 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.903288  9478 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.905185  1496 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.905953  9531 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.897224  9560 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:01:15.906560  9478 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:15.888688  9527 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:15.891001  9495 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.880573  9512 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:15.897018  9558 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.909786  9495 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.910080  9558 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.911471  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:15.912130  1597 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:15.895781  9541 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.913050  9541 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.884433  9323 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:15.893769  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76366.9us
I20260709 13:01:15.907019  1496 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.886265  9342 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.910436  1747 raft_consensus.cc:1240] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:15.912400  9558 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:15.881166  9526 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.934871  9534 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:15.935463  9534 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:15.935389  9529 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.936615  9534 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.938169  9534 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:15.939610  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.941367  9342 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:15.942909  9342 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:01:15.917541  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.944116  1600 raft_consensus.cc:2393] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 24: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:01:15.945111  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.945576  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.946563  1595 raft_consensus.cc:2410] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:01:15.918991  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:15.907511  9527 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.921581  1598 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:15.923846  1496 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.906656  9560 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:15.925895  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:15.957229  1750 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 27.
I20260709 13:01:15.957571  1602 raft_consensus.cc:2410] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:01:15.959126  1594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:15.960503  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.961915  1595 raft_consensus.cc:2393] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:15.959144  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:15.972072  1594 raft_consensus.cc:2368] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23.
I20260709 13:01:15.974718  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:15.978057  1594 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 29. Current term is 30. Ops: []
I20260709 13:01:15.972604  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.975600  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:15.987526  1594 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:15.993603  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:15.994601  1602 raft_consensus.cc:2393] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:15.994704  1600 raft_consensus.cc:1240] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:15.993639  1596 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:15.995767  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.015843  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:16.016986  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:15.896589  9524 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:15.956773  9527 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:16.025066  1496 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 22, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:16.024166  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:16.033838  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:16.030970  1496 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.038765  1496 catalog_manager.cc:5697] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:16.052969  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.052654  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 171772us
I20260709 13:01:16.064184  1496 catalog_manager.cc:5697] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 24, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 24 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.071447  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:16.072431  1669 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 13.
I20260709 13:01:16.077994  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.081512  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.076763  1678 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:16.082456  1750 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:01:16.080060  1496 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 13:01:16.089795  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.053040  9495 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.091285  1496 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:16.061240  9383 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.076960  9418 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.112105  1598 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:16.112545  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.138466  9383 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.144718  1598 raft_consensus.cc:2468] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:01:16.164548  1598 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:16.110270  1496 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 24, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:16.166782  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.167629  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 81704.8us
I20260709 13:01:16.096870  9553 consensus_queue.cc:1059] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:01:16.170843  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:16.194979  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.207931  1597 raft_consensus.cc:2468] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:16.211102  1598 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.120384  9418 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:16.228402  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 325795us
I20260709 13:01:16.230818  1598 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:16.237186  1601 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:16.109630  9560 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.249940  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:01:16.252344  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.252161  9574 consensus_queue.cc:1059] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:16.252837  1599 raft_consensus.cc:1240] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:01:16.253134  9553 consensus_queue.cc:1048] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:16.256471  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:16.257787  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.258603  1603 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:16.259091  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.259626  1596 raft_consensus.cc:1240] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:16.261382  9565 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:16.261874  9565 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:16.262243  9565 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.258483  1595 raft_consensus.cc:1240] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
W20260709 13:01:16.263733  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.264124  9580 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:16.266371  9580 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:16.266832  9580 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:16.267246  9580 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:16.266618  1677 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 12 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:16.272914  9383 raft_consensus.cc:3055] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:16.273505  9383 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.274622  9383 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.276113  9546 raft_consensus.cc:3055] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:16.276595  9546 raft_consensus.cc:740] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.277570  9546 consensus_queue.cc:260] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.278373  9554 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:16.278498  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:16.279054  9546 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:16.287257  9383 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:16.280380  9589 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:16.288479  9589 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:16.289151  9589 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:16.293601  9541 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.291064  1600 raft_consensus.cc:2468] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:01:16.279778  9553 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:16.298434  9553 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.301041  9418 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.302953  9524 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:16.305202  9493 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:16.308195  9577 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.300892  9585 raft_consensus.cc:2764] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:01:16.309896  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:16.311194  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.313763  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.314774  1597 raft_consensus.cc:3060] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.320535  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:01:16.318462  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 184559us
I20260709 13:01:16.243777  9576 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.329543  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.328301  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.331627  1600 raft_consensus.cc:2368] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22.
I20260709 13:01:16.326383  1603 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:16.333223  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:16.335593  1597 raft_consensus.cc:2468] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 18.
I20260709 13:01:16.341948  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:16.344348  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.346436  1669 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:16.279453  9554 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:01:16.352321  1598 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 26.
I20260709 13:01:16.308843  9577 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.354038  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:16.354880  1669 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 11.
I20260709 13:01:16.323539  9460 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:16.360219  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.361008  1749 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:01:16.361116  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:16.359090  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 188560us
I20260709 13:01:16.362118  1598 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 9.
I20260709 13:01:16.344465  9575 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:16.365803  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.368870  9575 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.369494  9575 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.372112  2314 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:16.372361  9582 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:16.372844  9582 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:16.373294  9582 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:16.373521  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.374411  1602 raft_consensus.cc:3060] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:16.379506  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.299412  9553 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.386699  1597 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:16.386909  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:16.325294  9527 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:16.389292  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.388089  1598 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 21.
I20260709 13:01:16.384893  9581 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.339278  9576 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.400833  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:16.402834  9593 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:16.404584  2313 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:16.402172  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:16.390429  9432 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:16.380865  9460 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.416393  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:16.390300  9587 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:16.419685  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:16.420013  1602 raft_consensus.cc:2468] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 10.
I20260709 13:01:16.408326  9553 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:16.430390  1598 raft_consensus.cc:1275] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:16.430418  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.431072  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.433337  1749 raft_consensus.cc:2393] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:16.411347  9480 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.416052  9529 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:01:16.436705  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:16.441766  9526 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.422690  9541 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:01:16.439142  2313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:16.455313  2313 raft_consensus.cc:2393] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:16.428633  9525 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:01:16.439003  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:16.456194  9525 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.456707  9525 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:01:16.444886  9480 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.457587  9480 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.428669  9534 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:01:16.463438  9554 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.420353  9432 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.449231  9565 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.422266  9429 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:01:16.444283  9512 consensus_meta.cc:287] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.002s
I20260709 13:01:16.452165  9529 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:16.478721  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.479061  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.489631  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.421818  9589 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.496590  1669 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:16.505446  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.514235  9323 consensus_meta.cc:287] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.007s
I20260709 13:01:16.411616  9593 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.540586  9323 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.541504  9546 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:16.542026  9546 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:16.542464  9546 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:16.410804  9581 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.426398  9587 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.542798  9569 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:16.544129  9584 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.544468  9581 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.544736  9584 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.480146  9529 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:01:16.433527  9585 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:01:16.547470  9527 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.494494  9429 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:16.589998  9594 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.600684  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 111286us
I20260709 13:01:16.486843  9512 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.608108  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.609602  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.579787  9479 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.610580  9557 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:16.626142  9342 consensus_meta.cc:287] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.011s
I20260709 13:01:16.633771  9587 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.618891  9479 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.635963  9576 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.637284  9589 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.640517  9584 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.650671  1744 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 30.
I20260709 13:01:16.611231  9594 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:16.653162  9590 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:01:16.654624  9583 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.645393  9575 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.670677  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:16.659713  9595 log.cc:927] Time spent T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.220s	user 0.006s	sys 0.004s
I20260709 13:01:16.669003  9383 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.713264  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.715647  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.715731  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.713497  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:16.717109  2314 raft_consensus.cc:2393] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 18: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:16.722630  9383 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.725309  1598 raft_consensus.cc:1275] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:16.726626  9383 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:16.727519  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 57016.7us
I20260709 13:01:16.728621  1715 leader_election.cc:400] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23.
I20260709 13:01:16.728958  1715 leader_election.cc:403] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260709 13:01:16.730687  1566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.512s (SENT) [suppressed 24 similar messages]
I20260709 13:01:16.733520  9590 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.734453  9590 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.736738  9276 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:01:16.669325  9580 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.668651  9582 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:16.752595  1566 leader_election.cc:336] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.540s (SENT)
I20260709 13:01:16.753216  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.717216  9565 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.672904  9479 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.679392  9429 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.755187  9577 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.766855  1671 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:16.762236  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.722945  9524 raft_consensus.cc:3060] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.739532  9276 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 22. Current term is 23.
W20260709 13:01:16.776121  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 369248us
I20260709 13:01:16.779394  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:16.780954  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:16.781527  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.781767  1677 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:16.783335  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:16.784229  1677 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:16.785032  9493 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
W20260709 13:01:16.799175  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46648us
W20260709 13:01:16.800089  1566 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.715s (SENT)
I20260709 13:01:16.800556  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.785501  9577 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:16.783212  9558 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:16.807219  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 465581us
I20260709 13:01:16.792439  9479 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:16.793534  9605 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.802605  9512 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.830994  9493 tablet_bootstrap.cc:492] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:01:16.832526  9460 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.814719  9602 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:16.834520  9575 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.842316  9569 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:16.843703  9432 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:16.845309  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.846407  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.826238  9605 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.857823  9594 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:16.854522  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.859815  9605 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.859901  9580 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:16.861799  9598 raft_consensus.cc:3055] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:16.861599  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:16.871865  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 78156.5us
I20260709 13:01:16.870752  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.873769  9565 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:16.875839  9609 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:01:16.874051  9580 consensus_queue.cc:1059] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:16.877653  9580 raft_consensus.cc:3055] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:16.878074  9580 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.816093  9610 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:01:16.879066  9580 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:16.880198  9493 ts_tablet_manager.cc:1403] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 1.518s	user 0.060s	sys 0.026s
I20260709 13:01:16.862376  9598 raft_consensus.cc:740] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.888015  1749 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:01:16.883744  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 56275.8us
I20260709 13:01:16.883898  9605 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:16.874081  9554 consensus_queue.cc:1059] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:01:16.885804  9609 consensus_queue.cc:1059] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:16.885998  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.887146  1747 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:16.863394  9276 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:16.889940  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.894197  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.902680  1744 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 24.
I20260709 13:01:16.895335  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.898002  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.899592  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:16.888736  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:16.904697  1743 raft_consensus.cc:2410] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:01:16.905565  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:16.880820  9580 raft_consensus.cc:3060] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:16.909135  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:16.914146  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 114128us
I20260709 13:01:16.920738  2314 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:16.924026  9611 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.924783  9611 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:16.927531  9611 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.934965  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:16.936261  1597 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:16.937623  1743 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:16.940268  9432 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:16.931871  9609 consensus_queue.cc:1243] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:16.941058  9598 consensus_queue.cc:260] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.942332  9598 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:16.942960  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:16.940653  9590 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:16.943693  1602 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:16.944182  9560 raft_consensus.cc:3055] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:16.944706  9560 raft_consensus.cc:740] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.944300  9583 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:16.887917  9587 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:16.892387  9480 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:16.947640  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61769.7us
I20260709 13:01:16.910147  9526 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.901547  9276 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.970345  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:16.977092  1750 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:16.977708  1597 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:16.973254  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:16.974972  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.981038  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.956084  9554 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:17.001780  9480 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.005146  9276 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.005400  9582 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.005963  9607 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 13:01:17.007244  9607 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:17.007647  9607 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.008680  9607 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:17.014873  9525 consensus_meta.cc:287] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.003s
I20260709 13:01:17.015630  9525 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.984608  1602 raft_consensus.cc:2468] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
I20260709 13:01:16.976436  9560 consensus_queue.cc:260] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.024595  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:16.986261  9575 consensus_queue.cc:1048] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:16.979825  9611 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:16.991917  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 88452us
I20260709 13:01:16.993505  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.028764  1601 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 24.
I20260709 13:01:16.994207  9429 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.994552  9565 raft_consensus.cc:3055] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:17.032603  9529 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:16.971848  9610 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:17.034006  9610 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:17.034502  9610 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.038130  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:16.996486  9553 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:17.039784  9553 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.040259  9553 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:17.040915  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:17.042296  1715 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:17.023459  9432 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:16.998569  9593 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:16.992010  9576 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:01:17.045357  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.999974  9323 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.046233  9592 raft_consensus.cc:2804] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:17.047032  9592 raft_consensus.cc:697] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.048300  9592 consensus_queue.cc:237] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.025985  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:17.045018  9557 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:17.026995  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 43493.5us
W20260709 13:01:17.029451  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 123979us
I20260709 13:01:17.029466  9611 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.031469  9429 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.032680  9560 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.032948  9493 raft_consensus.cc:359] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 NON_PARTICIPANT]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.033396  9565 raft_consensus.cc:740] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:16.980114  9609 consensus_queue.cc:1059] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:01:16.999794  1749 raft_consensus.cc:2468] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 24.
W20260709 13:01:17.053367  1566 leader_election.cc:336] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.988s (SENT)
I20260709 13:01:17.056880  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:17.028187  9598 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:01:17.058841  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:17.059449  1747 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.060099  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.060757  1671 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.061409  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.062055  1678 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:01:17.063802  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.064433  1677 raft_consensus.cc:3060] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.064148  9565 consensus_queue.cc:260] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.063829  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:17.065471  1743 raft_consensus.cc:3060] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.065623  9565 raft_consensus.cc:3060] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:17.068177  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.071081  1671 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:17.072557  1715 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:17.068842  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:17.067799  9603 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:17.053939  9432 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:17.081508  9479 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:17.081962  9479 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.082345  9479 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:17.082487  1743 raft_consensus.cc:2468] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 15.
I20260709 13:01:17.073871  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:17.080395  9554 consensus_queue.cc:1059] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:17.084093  9575 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:17.084372  9554 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:17.056200  9611 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.082656  9582 raft_consensus.cc:3055] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:17.084964  9554 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:17.085198  9582 raft_consensus.cc:740] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:17.086054  9554 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.086225  9582 consensus_queue.cc:260] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:17.084432  9429 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.088522  9582 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:17.089525  9554 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:17.058175  9383 consensus_queue.cc:1048] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:01:17.092752  1747 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:01:17.096807  9529 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.098176  9605 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:17.081049  9493 raft_consensus.cc:740] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:01:16.982374  9526 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.074707  9593 consensus_queue.cc:1059] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:01:17.084544  9575 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.111896  9575 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.120998  9576 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:17.055243  9546 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.095196  9524 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.124964  9607 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:17.127987  9525 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.104367  9493 consensus_queue.cc:260] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:17.141466  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.156476  1677 raft_consensus.cc:2468] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 12.
I20260709 13:01:17.157842  1599 raft_consensus.cc:1240] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 24. Current term is 25. Ops: [20.11-24.14]
I20260709 13:01:17.181245  1600 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:01:17.181474  1602 raft_consensus.cc:2410] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:01:17.160149  1603 raft_consensus.cc:1217] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 11.6->[14.7-18.9]   Dedup: 14.7->[16.8-18.9]
I20260709 13:01:17.162858  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:17.163931  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 104297us
I20260709 13:01:17.183091  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:17.164234  1597 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:01:17.107703  9526 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:17.169872  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 116584us
W20260709 13:01:17.185532  1566 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.999s (SENT)
I20260709 13:01:17.179570  1594 raft_consensus.cc:1240] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:17.190191  1598 raft_consensus.cc:1275] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:17.166586  9432 raft_consensus.cc:2804] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:17.182232  1603 pending_rounds.cc:85] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting all ops after (but not including) 7
I20260709 13:01:17.202088  1603 pending_rounds.cc:107] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:01:17.202438  1603 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.197167  1596 raft_consensus.cc:1240] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: [20.12-21.13]
I20260709 13:01:17.198189  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.163194  9529 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.203855   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:17.207863  9557 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.212296  9493 ts_tablet_manager.cc:1434] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.332s	user 0.009s	sys 0.004s
I20260709 13:01:17.216192  9432 raft_consensus.cc:697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:01:17.230537  1641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.238169  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 52716.2us
I20260709 13:01:17.240514  1595 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 17: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:17.173996  9553 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:17.243040  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.245903  1596 raft_consensus.cc:1240] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:01:17.253875  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:17.258910  1715 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:17.261456  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.262271  1677 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:17.263337  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:17.266573  1715 leader_election.cc:400] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Vote denied by peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007) with higher term. Message: Invalid argument: T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for earlier term 21. Current term is 22.
I20260709 13:01:17.267383  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.267607  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:17.268164  1669 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:17.270959  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.271896  1600 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:17.270972  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.272738  1602 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 24: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:17.272814  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:17.250579  9565 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.274108  1677 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:01:17.275432  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.276153  1669 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 26.
I20260709 13:01:17.260109  9593 raft_consensus.cc:2804] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:17.264300  9524 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:01:17.277719  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.278724  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.291945  1675 raft_consensus.cc:2393] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 17: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:17.278780  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.246786  9605 consensus_queue.cc:1059] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:01:17.281756  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.294699  1671 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.273681  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.297247  1677 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
W20260709 13:01:17.299674  1566 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.033s (SENT)
I20260709 13:01:17.284091  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.287668  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.270686  9432 consensus_queue.cc:237] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.264003  9574 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.281158  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.293222  1678 raft_consensus.cc:2410] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:01:17.274654  9529 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.319314  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:17.264111  9526 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:01:17.320861  9611 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.290126  9524 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.322268  9524 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:01:17.287357  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.310509  1674 raft_consensus.cc:2376] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 23. Re-sending same reply.
I20260709 13:01:17.301427  1669 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:17.302724  1670 raft_consensus.cc:1240] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:17.326717  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:17.251003  9557 consensus_queue.cc:1059] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:01:17.299964  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.329708  1602 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:17.265228  9553 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.312763  9574 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.313316  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.260246  9525 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:17.313634  9605 raft_consensus.cc:3055] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:17.314147  9593 raft_consensus.cc:697] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.266049  9429 consensus_queue.cc:1059] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:01:17.277842  9594 raft_consensus.cc:2804] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:17.289695  9583 consensus_queue.cc:1048] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:01:17.316792  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.328498  2279 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:17.332093  1600 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:17.326411   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:17.281059  9592 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:17.340675  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.341411  1670 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:17.338800  2279 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:17.343199  1600 raft_consensus.cc:1240] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 18. Current term is 19. Ops: []
W20260709 13:01:17.345480  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46040.1us
I20260709 13:01:17.349365  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.350766  1670 raft_consensus.cc:2410] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:01:17.357414  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.358310  1596 raft_consensus.cc:2468] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:17.359633  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.360677  1678 raft_consensus.cc:2410] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:01:17.360608  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.360913  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.361711  1599 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:17.363701  1603 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:17.366883  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.384867  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.386533  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.334425  9605 raft_consensus.cc:740] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.388988  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.326474  9611 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.290223  9565 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.366446  9529 raft_consensus.cc:3055] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:17.390867  2279 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:17.384577  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.392257  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.389750  9584 raft_consensus.cc:2804] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.394162  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.333923  9342 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:17.333632  9512 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:17.343466  9581 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:17.397343  1603 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:17.389525  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.438946  1599 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:17.439199  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.343864  9527 raft_consensus.cc:2804] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:17.440783  9342 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.398342  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:17.399169  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.349625  9460 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.404615  1671 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13.
I20260709 13:01:17.446591  1602 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:17.447340  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.448549  1671 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:17.390367  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.449257  1670 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.422924  1669 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:17.294488  9602 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:01:17.360886  9590 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:01:17.427917  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.463100  1678 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:17.396314  9534 consensus_queue.cc:1059] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:01:17.411078  9529 raft_consensus.cc:740] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:17.429500  9611 raft_consensus.cc:2804] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:17.432906  9526 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.432865  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:01:17.435318  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.385354  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-d53e959bd0a14b21aa72696bbf6d090d received from {username='slave'} at 127.0.0.1:38702
I20260709 13:01:17.390576  9594 raft_consensus.cc:697] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.437561  1672 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22.
I20260709 13:01:17.404057  9495 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.445698  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
W20260709 13:01:17.453068  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.406737  9575 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.392053  9479 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.442606  9581 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.454941  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.456600  9584 raft_consensus.cc:697] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:17.481060  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-d53e959bd0a14b21aa72696bbf6d090d on tablet d53e959bd0a14b21aa72696bbf6d090d with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:17.482563  2309 raft_consensus.cc:1217] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEARNER]: Deduplicated request from leader. Original: 22.13->[24.14-24.14]   Dedup: 24.14->[]
I20260709 13:01:17.486207  9342 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.488674  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.513212  1595 raft_consensus.cc:3060] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.444904  9527 raft_consensus.cc:697] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:17.489634  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.499935  1678 raft_consensus.cc:2468] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:17.445030  9512 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:17.505482  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 106535us
I20260709 13:01:17.474839  9585 raft_consensus.cc:3055] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:17.518859  1675 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:17.492425  9558 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:17.488202  9525 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.500794  1670 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:01:17.462885  9460 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.527737  9525 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.529958  9525 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.516464  9429 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.531769  9512 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.532174  9429 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.511596  9581 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.539597  1715 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:17.546232  2310 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 25: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:17.526747  9558 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:01:17.556622  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.478760  9526 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.487855  9495 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.558719  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:17.529958  9460 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.535511  9585 raft_consensus.cc:740] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.470409  9593 consensus_queue.cc:237] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.541684  9342 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.537766  9534 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.576059  1595 raft_consensus.cc:2468] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:01:17.541532  9546 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:17.587507  1676 raft_consensus.cc:1240] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 23. Current term is 24. Ops: []
W20260709 13:01:17.570963  9610 consensus_meta.cc:287] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.004s
I20260709 13:01:17.644161  9610 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:17.646093  9632 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:17.646618  9610 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.591902  9574 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.594798  9527 consensus_queue.cc:237] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.636853  9534 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:17.605587  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47015.3us
I20260709 13:01:17.650813  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:17.634770  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 99918.3us
I20260709 13:01:17.490713  9605 consensus_queue.cc:260] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.549171  9611 raft_consensus.cc:697] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:17.576784  2315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:17.536002  9592 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.587816  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:17.630599  9460 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:17.594058  9495 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.561290  9432 consensus_queue.cc:1059] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
W20260709 13:01:17.591981  9631 log.cc:927] Time spent T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:01:17.641068  9575 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.642907  9558 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:17.631636  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:17.652899  2311 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:17.655652  1675 raft_consensus.cc:2468] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:01:17.653503  2279 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:17.555471  9429 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.653887  2315 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
I20260709 13:01:17.660264  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:17.668852  2317 raft_consensus.cc:2368] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:01:17.655045  9565 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.659933  9460 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.630651  9594 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:17.634933  9342 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.667762  9637 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:17.582553  9584 consensus_queue.cc:237] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.689141  9460 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:17.689936  9432 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:17.666875  9512 consensus_queue.cc:1059] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:17.728682  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.723193  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.731458  1675 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:17.731065  1677 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.674832  9636 consensus_queue.cc:1059] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 13:01:17.701751  9605 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:17.703747  9637 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:17.739234  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:01:17.751585  9641 log.cc:927] Time spent T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:01:17.757880  9643 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:17.738580  9611 consensus_queue.cc:237] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.762490  1677 raft_consensus.cc:2468] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:01:17.763533  9610 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:17.764065  9610 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.720415  9644 raft_consensus.cc:2804] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:17.730966  9479 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.729580  9432 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:17.768364  9534 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:17.771831  9628 log.cc:927] Time spent T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 13:01:17.764473  9610 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.773047  9429 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:17.745122  9637 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.780326  9524 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.787271  9342 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:17.804106  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.807121  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 147045us
I20260709 13:01:17.809444  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:17.778101  9512 raft_consensus.cc:3055] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:17.780335  9323 raft_consensus.cc:3055] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:17.811426  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:17.781533  9432 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.819728  1595 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 30. Current term is 31. Ops: []
I20260709 13:01:17.788430  9644 raft_consensus.cc:697] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:17.733332  9592 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:17.908277  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 97044.6us
I20260709 13:01:17.875859  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.905567  1669 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:01:17.896705  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.916169  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.916945  1670 raft_consensus.cc:2376] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17. Re-sending same reply.
I20260709 13:01:17.917448  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:17.919018  2316 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:17.812361  9276 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:17.920518  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 60480.2us
W20260709 13:01:17.857141  9654 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:01:17.846949  1599 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 12 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:17.858901  9577 raft_consensus.cc:3055] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:01:17.821331  9607 consensus_meta.cc:287] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.006s
I20260709 13:01:17.816915  9323 raft_consensus.cc:740] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.814915  9512 raft_consensus.cc:740] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.930701  2309 raft_consensus.cc:1240] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEADER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:17.929158  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.931845  1670 raft_consensus.cc:2393] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:17.838225  9526 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.913159  9557 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:17.802958  9429 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.933145  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:17.928218  9577 raft_consensus.cc:740] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:17.945966  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.947629  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.948796  1603 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 17.
I20260709 13:01:17.950408  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:17.951272  1743 raft_consensus.cc:2393] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:17.947592  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:17.952009  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.862115  9585 consensus_queue.cc:260] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.858227  9529 consensus_queue.cc:260] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.956887  9585 raft_consensus.cc:3060] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:17.957239  9529 raft_consensus.cc:3060] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:17.957630  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:17.954229  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:17.960227  1749 raft_consensus.cc:2368] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:01:17.959913  9512 consensus_queue.cc:260] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.960691  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.961457  9512 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.961987  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.962680  1676 raft_consensus.cc:2376] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21. Re-sending same reply.
I20260709 13:01:17.960044  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:17.964334  1601 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.961459  1600 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:17.967059  1749 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:17.943006  9526 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:17.944591  9636 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:17.969432  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.967370  9323 consensus_queue.cc:260] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.969324  9577 consensus_queue.cc:260] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:17.973070  9323 raft_consensus.cc:3060] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:17.979517  1672 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [19.9-21.10]
I20260709 13:01:17.979966  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.980301  9429 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:17.980732  1674 raft_consensus.cc:1240] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:01:17.979367  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:17.981930  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.984078  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:17.981902  1669 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 27.
I20260709 13:01:17.990365  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.992663  1597 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:01:17.992723  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.991300  9526 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:17.994032  1597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:17.994804  1597 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:17.996229  9524 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 31 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:17.968472  9644 consensus_queue.cc:237] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.000730  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.002323  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.003351  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.005321  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:18.006258  1596 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 21: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
W20260709 13:01:18.008023  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 60587us
I20260709 13:01:17.973142  9577 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:18.017195  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:18.015651  1716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.018090  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:17.982800  9636 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.014321  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.018121  2314 raft_consensus.cc:2393] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:18.028065  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.028684  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.029227  1678 raft_consensus.cc:2393] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 24: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:18.035427  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.040980  1744 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 30 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:01:18.016325  9276 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:18.023428  9636 raft_consensus.cc:3060] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:18.053542  1600 raft_consensus.cc:2468] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 25.
I20260709 13:01:18.062708  1678 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:01:18.063385  1678 pending_rounds.cc:85] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 11
I20260709 13:01:18.064430  1678 pending_rounds.cc:107] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:01:18.064798  1678 raft_consensus.cc:2889] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.018656  9657 consensus_queue.cc:1048] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:01:18.046023  9276 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.077447  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.078511  1675 raft_consensus.cc:2410] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:01:18.080061  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.049858  9526 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:18.091313  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.037676  9637 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.054817  9650 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:18.106468  1676 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:18.077627  9276 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:18.121927  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.125049  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.130128  1676 raft_consensus.cc:1240] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:18.130697  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.135152  1674 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:18.137717  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.141860  9590 raft_consensus.cc:3055] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:18.142530  9590 raft_consensus.cc:740] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:18.142984  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.143466  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.143853  1746 raft_consensus.cc:3060] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:18.145215  9633 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.592s	user 0.000s	sys 0.003s
I20260709 13:01:18.113010  9650 consensus_queue.cc:1243] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 693257b3078444e0bd26d3e82159d452 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:18.141970  9665 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.150568  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.155134  1678 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
W20260709 13:01:18.157998  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.159184  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.162037  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.160115  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:18.165503  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.139650  9657 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.139950  9593 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.182574  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.183481  1672 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:18.177239  1675 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:18.185335  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.179419  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.176031  1674 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:18.186416  1671 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:01:18.188879  1675 raft_consensus.cc:1240] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:18.191118  1675 raft_consensus.cc:1275] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:01:18.193545  1670 raft_consensus.cc:1275] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 13:01:18.194206  1670 pending_rounds.cc:85] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 12
I20260709 13:01:18.194670  1670 pending_rounds.cc:107] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 22.13
I20260709 13:01:18.198349  1678 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:18.182161  9667 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:18.204525  1715 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.201090  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.174193  9524 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.174542  9526 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.206447  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.212363  1669 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:18.204350  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.140235  9460 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.202862  1670 raft_consensus.cc:2917] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Aborting config change with OpId 22.13: Aborted: Op aborted by new leader
I20260709 13:01:18.210486  1715 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.178534  9383 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.178728  9565 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.211061  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:18.198800  9581 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.004s
I20260709 13:01:18.210534  1671 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28.
I20260709 13:01:18.222290  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.222517  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.222831  1672 raft_consensus.cc:2376] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 13. Re-sending same reply.
I20260709 13:01:18.222988  1671 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:01:18.200609  9557 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.218189  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.214150  9605 raft_consensus.cc:2804] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:18.234248  9581 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.225708  9383 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.239388  9581 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.218924  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.215131  1670 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.245952  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.246670  1678 raft_consensus.cc:2376] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 22. Re-sending same reply.
I20260709 13:01:18.227171  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.234882  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.254364  1745 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:01:18.235644  1671 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 27.
I20260709 13:01:18.241696  1746 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:01:18.254926  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.242427  2316 raft_consensus.cc:1240] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:01:18.157369  9590 consensus_queue.cc:260] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.259804  1674 raft_consensus.cc:2368] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25.
I20260709 13:01:18.164474  9665 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.194355  9657 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.246697  1672 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:18.249791  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.250777  1670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 16) took 16824 ms. Trace:
I20260709 13:01:18.251029  9637 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.265619  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:18.266243  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.266641  1746 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:18.219628  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:18.226632  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.256937  1678 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.198403  9593 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.259120  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.244448  1748 raft_consensus.cc:2393] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:18.261075  1677 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:18.244894  9569 raft_consensus.cc:2804] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:18.211520  9610 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.262008  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.260901  1670 rpcz_store.cc:276] 0709 13:01:01.426859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.431721 (+  4862us) service_pool.cc:224] Handling call
0709 13:01:02.779787 (+1348066us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4c003b1540. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947f759a20 00007f947f76aa29 00007f947f730644 00007f947f757f2d 00007f947f757b93 00007f94813e61af 00007f94813e5f3e 00007f948146b888 00007f948148875c 00007f948148976a 00007f948148891b
0709 13:01:02.781615 (+  1828us) log.cc:844] Serialized 506 byte log entry
0709 13:01:18.250616 (+15469001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8793,"raft.queue_time_us":178,"raft.run_cpu_time_us":1052,"raft.run_wall_time_us":91915,"spinlock_wait_cycles":45197184,"thread_start_us":57955,"threads_started":1,"wal-append.queue_time_us":288182,"wal-append.run_cpu_time_us":4291,"wal-append.run_wall_time_us":1187724}
I20260709 13:01:18.300362  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.300848  9460 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.301812  9590 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:18.301959  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.302770  1746 raft_consensus.cc:2468] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 17.
W20260709 13:01:18.252200  9661 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:01:18.243006  9557 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.303592  9650 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:18.305733  9557 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.309989  1675 raft_consensus.cc:1240] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 19. Current term is 20. Ops: []
W20260709 13:01:18.288417  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 61399us
I20260709 13:01:18.214397  9524 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.246889  9383 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:18.292491  1601 raft_consensus.cc:2468] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 16.
I20260709 13:01:18.295183  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.297685  1670 pending_rounds.cc:107] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:01:18.313381  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.225473  9565 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.223865  9526 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:18.323191  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.320572  1672 raft_consensus.cc:2376] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 27. Re-sending same reply.
W20260709 13:01:18.324644  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.318172  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.336855  1669 raft_consensus.cc:2393] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:18.337706  1746 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:01:18.338567  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.338658  1670 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.339224  1746 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:18.320577  1745 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28.
I20260709 13:01:18.304167  9650 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.345207  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.346532  1670 raft_consensus.cc:2410] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:01:18.350607  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.357514  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.357744  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.292490  9534 raft_consensus.cc:3055] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:18.321028  9569 raft_consensus.cc:697] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:18.362022  1672 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:18.348047  9650 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:18.365602  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet d53e959bd0a14b21aa72696bbf6d090d: Aborted: Op aborted by new leader
I20260709 13:01:18.359403  9557 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:18.377280  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.377897  1669 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:18.379199  9665 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:18.380894  9524 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:18.385434  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.386410  1675 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:18.386857  9587 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.387481  9587 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.388827  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.389493  1675 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:18.396781  9526 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:18.404094  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:18.405772  1675 raft_consensus.cc:2468] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:18.412254  1677 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:18.413039  1678 raft_consensus.cc:2468] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:01:18.414211  1673 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:18.418794  2279 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.419962  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.423107  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.423576  1746 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:18.424823  1670 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
W20260709 13:01:18.432705  1566 leader_election.cc:336] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.918s (SENT)
W20260709 13:01:18.434203  1566 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.983s (SENT)
I20260709 13:01:18.434852  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:18.440249  1676 raft_consensus.cc:1240] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:18.440992  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.363456  9668 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:18.362228  9534 raft_consensus.cc:740] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:18.379199  9565 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:18.444459  1672 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:18.444706  2279 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
W20260709 13:01:18.436801  9432 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
I20260709 13:01:18.360239  9664 consensus_queue.cc:1048] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:01:18.428448  9611 raft_consensus.cc:2804] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:18.454881  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.453842   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:18.466365  1566 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.091s (SENT)
I20260709 13:01:18.469662  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:18.472226  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.473237  1746 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:01:18.474694  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.478868  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.479691  1672 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 18.
I20260709 13:01:18.448319  9605 raft_consensus.cc:697] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:18.466460  9529 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:18.448719  9575 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:01:18.495466  1566 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.094s (SENT)
I20260709 13:01:18.496205  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:18.471413  9664 consensus_queue.cc:1243] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:18.481138  9620 raft_consensus.cc:2804] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:18.463644  9432 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.475716  9587 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:18.504434  9276 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.516991  9593 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.523931  9557 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:18.533986  9323 consensus_meta.cc:287] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.560s	user 0.014s	sys 0.000s
I20260709 13:01:18.524832  9620 raft_consensus.cc:697] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:18.487924  9526 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:18.534091  9383 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.524191  9610 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:18.535531  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 90953.6us
W20260709 13:01:18.507304  9512 consensus_meta.cc:287] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:01:18.537884  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.540665  1746 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 31.
W20260709 13:01:18.527415  9577 consensus_meta.cc:287] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 13:01:18.546119  9529 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:18.548470  9645 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:18.539427  9657 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.481386  9569 consensus_queue.cc:237] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.558265  9383 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.560890  9432 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.561399  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.562156  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.562968  1675 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:18.563745  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.564363  1672 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:18.564759  9620 consensus_queue.cc:237] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:18.536410  9585 consensus_meta.cc:287] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.001s
I20260709 13:01:18.569393  9276 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:18.501891  9534 consensus_queue.cc:260] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.549490  9636 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.562835  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.575810  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.576357  1752 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:18.576606  1678 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:18.577895  1744 raft_consensus.cc:2368] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:01:18.580480  1744 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:18.582654  9383 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:18.584398  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 89006.6us
W20260709 13:01:18.585732  1566 leader_election.cc:336] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.166s (SENT)
I20260709 13:01:18.586479  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:18.588508  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.588759  9460 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:18.589438  9460 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.591636  1750 raft_consensus.cc:1275] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:18.592624  9460 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.594116  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:18.594663  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.595198  2316 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 14.
I20260709 13:01:18.594749  2311 raft_consensus.cc:3060] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEARNER]: Advancing to term 22
I20260709 13:01:18.600379  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.601145  1673 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 19.
I20260709 13:01:18.601548  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:18.549721  9605 consensus_queue.cc:237] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.612793  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:18.614277  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:18.616735  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.616947  1672 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:18.617612  1749 raft_consensus.cc:2468] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 24.
I20260709 13:01:18.617952  2316 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:18.615231  1673 pending_rounds.cc:85] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 12
I20260709 13:01:18.619077  1673 pending_rounds.cc:107] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:01:18.619590  1673 raft_consensus.cc:2889] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.621218  1747 raft_consensus.cc:2468] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 17.
W20260709 13:01:18.625244  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.620209  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:18.627969  2309 raft_consensus.cc:2393] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 25: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
W20260709 13:01:18.628813  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.630178  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.636168  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:18.636945  1595 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:18.629601  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452"
I20260709 13:01:18.638561  1675 raft_consensus.cc:3055] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:18.638881  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.636168  1678 raft_consensus.cc:2410] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:01:18.639649  1670 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:18.639725  2279 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
I20260709 13:01:18.640573  1751 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:18.641440  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:18.642060  1677 raft_consensus.cc:3060] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:18.644493  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:18.639081  1675 raft_consensus.cc:740] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:18.629478  9526 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:18.651763  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.652179  1750 raft_consensus.cc:1275] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:18.652567  1743 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 14.
I20260709 13:01:18.582508  9636 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:18.646643  1675 consensus_queue.cc:260] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.659768  1675 raft_consensus.cc:3060] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:18.661231  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.668653  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.668568  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:18.671325  1743 raft_consensus.cc:2393] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 22: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:18.672821  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.673610  1743 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:18.658979  9584 raft_consensus.cc:2804] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:18.674683  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.675428  9584 raft_consensus.cc:697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
W20260709 13:01:18.670881  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 85202.7us
I20260709 13:01:18.676311  1752 raft_consensus.cc:1240] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:01:18.658547  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.678993  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.682896  9673 raft_consensus.cc:493] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:18.682940  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:18.683882  9673 raft_consensus.cc:515] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.684371  1752 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:18.685683  1743 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:18.686025  1595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
I20260709 13:01:18.687700  1595 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:18.635759  9611 raft_consensus.cc:697] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:18.695520  1749 raft_consensus.cc:1240] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:18.695937  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.696692  1676 raft_consensus.cc:2376] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 28. Re-sending same reply.
I20260709 13:01:18.697415  1749 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
W20260709 13:01:18.698096  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.702346  1641 leader_election.cc:400] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
I20260709 13:01:18.703240  1596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "693257b3078444e0bd26d3e82159d452" is_pre_election: true
W20260709 13:01:18.692251  1566 leader_election.cc:336] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 2.311s (SENT)
I20260709 13:01:18.703972  1596 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:18.704054  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:18.693568  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:18.705181  9584 consensus_queue.cc:237] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.700935  9565 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.706933  1715 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.706812  9565 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.708134  9611 consensus_queue.cc:237] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.709457  9565 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:18.708886  9526 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:18.710593  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.702894  1641 leader_election.cc:403] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.712052  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:18.713483  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 73909.4us
I20260709 13:01:18.712989  1752 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:18.720435  2311 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:01:18.720949  2311 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Aborting all ops after (but not including) 12
W20260709 13:01:18.721189  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.721247  2311 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:01:18.723240  2311 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:18.807951  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.727977  2316 raft_consensus.cc:2468] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:18.725425  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.738433  1677 raft_consensus.cc:2468] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 18.
I20260709 13:01:18.717132  9565 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15.
W20260709 13:01:18.808981  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 94720us
I20260709 13:01:18.816781  2279 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 
W20260709 13:01:18.817209  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.817085  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91819.5us
I20260709 13:01:18.725504  9636 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:18.820604  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.734503  9524 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:18.745806  9569 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:18.811177  9592 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.743924  9577 consensus_queue.cc:1048] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 13:01:18.724157  9529 consensus_queue.cc:1059] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:01:18.734066  9383 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:01:18.827780  9610 raft_consensus.cc:2804] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:18.830472  9585 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:18.837646  9673 leader_election.cc:290] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:18.831465  9534 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:18.862286  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.855336  1677 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:01:18.901597  1677 pending_rounds.cc:85] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 12
W20260709 13:01:18.901945  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.901983  1677 pending_rounds.cc:107] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:01:18.902599  1677 raft_consensus.cc:2889] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.860230  9569 raft_consensus.cc:697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:18.896981  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:18.911376  1670 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:18.897526  1678 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Rejecting Update request from peer fab19506de7242869c29d70c9fffb739 for earlier term 26. Current term is 27. Ops: []
I20260709 13:01:18.897912  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:18.899264  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 174672us
I20260709 13:01:18.864444  1675 raft_consensus.cc:1275] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:01:18.913436  1675 pending_rounds.cc:85] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 16
I20260709 13:01:18.913750  1675 pending_rounds.cc:107] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:01:18.914026  1675 raft_consensus.cc:2889] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.840323  9664 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:18.865922  9585 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.838914  9526 consensus_queue.cc:1059] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:18.908438  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a0f19eac6047fdb1fd191d07ab7355" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:18.900945  9679 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:18.896200  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:18.902544  9610 raft_consensus.cc:697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:18.929329  1715 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.930308  9610 consensus_queue.cc:237] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.932190  9665 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:18.933940  9607 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:01:18.934417  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.931839  9667 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:18.864116  9650 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.935140  9667 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.935755  9667 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.935990  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 216) took 6547 ms. Trace:
I20260709 13:01:18.937397  9650 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:18.938424  1744 raft_consensus.cc:1240] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:01:18.932010  9673 raft_consensus.cc:2804] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:18.940554  9673 raft_consensus.cc:697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:18.940197  9569 consensus_queue.cc:237] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.941628  9673 consensus_queue.cc:237] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.925539  9585 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:18.947650  9686 raft_consensus.cc:3055] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:18.948210  9686 raft_consensus.cc:740] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:18.925925  9529 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.949429  9686 consensus_queue.cc:260] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.950353  9529 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:18.951069  9686 raft_consensus.cc:3060] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.947443  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.953195  9529 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:18.955080  9685 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.955714  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.891019  9646 consensus_queue.cc:1048] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:01:18.956368  1676 raft_consensus.cc:1275] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:01:18.921913  9682 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:18.857206  9565 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 13:01:18.904206  9620 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:18.961764  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 48134.9us
I20260709 13:01:18.963523  1745 raft_consensus.cc:1240] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: []
W20260709 13:01:18.972770  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 110647us
I20260709 13:01:18.844872  9524 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:18.955922  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.917354  9664 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.864959  9581 consensus_queue.cc:1048] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:01:18.864355  9592 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.021536  1673 raft_consensus.cc:1275] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:18.998903  9605 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:01:19.024457  9605 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:01:19.024896  9605 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:19.026165  9605 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:18.974717  9636 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:19.000645  1641 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.936532  1496 rpcz_store.cc:276] 0709 13:01:12.389094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.399975 (+ 10881us) service_pool.cc:224] Handling call
0709 13:01:18.935914 (+6535939us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:16.676306 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:16.676992 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:16.677031 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:01:16.677052 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:16.802881 (+125829us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:16.808951 (+  6070us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:16.810357 (+  1406us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:16.898750 (+ 88393us) tablet.cc:701] Row locks acquired
0709 13:01:16.898772 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:16.898973 (+   201us) write_op.cc:270] Start()
0709 13:01:16.899117 (+   144us) write_op.cc:276] Timestamp: P: 1783602076898910 usec, L: 0
0709 13:01:16.899151 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:01:16.900081 (+   930us) log.cc:844] Serialized 6221 byte log entry
0709 13:01:17.052415 (+152334us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b540036d920. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f94814046b8 00007f94814042fa 00007f9481488965 00007f9481488e09 00007f9484ec3581 00007f9484ec2d58 00007f9484ec79f1 00007f9484ec79a9 00007f9484ec7939 00007f9484ec7901
0709 13:01:17.428558 (+376143us) op_driver.cc:464] REPLICATION: finished
0709 13:01:17.552122 (+123564us) write_op.cc:301] APPLY: starting
0709 13:01:17.560352 (+  8230us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:17.851194 (+290842us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:17.852741 (+  1547us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:18.463285 (+610544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:18.511595 (+ 48310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:01:18.511666 (+    71us) write_op.cc:312] APPLY: finished
0709 13:01:18.512143 (+   477us) log.cc:844] Serialized 139 byte log entry
0709 13:01:18.512419 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:18.512625 (+   206us) write_op.cc:454] Released schema lock
0709 13:01:18.512699 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:18.513264 (+   565us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:18.513305 (+    41us) write_op.cc:454] Released schema lock
0709 13:01:18.519785 (+  6480us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18003ed400. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e3a0522 00007f947e3a27c1 00007f947e3a2779 00007f947e3a2709 00007f947e3a26d1 00007f947e3a19cd 000000000038f354 000000000038f199 00007f947e38383a
Metrics: {"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":95798,"apply.run_cpu_time_us":34206,"apply.run_wall_time_us":974551,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":331369,"prepare.run_cpu_time_us":52966,"prepare.run_wall_time_us":379053,"raft.queue_time_us":383783,"raft.run_cpu_time_us":15360,"raft.run_wall_time_us":33537,"replication_time_us":529209,"spinlock_wait_cycles":154109568,"thread_start_us":698732,"threads_started":4,"wal-append.queue_time_us":73102,"wal-append.run_cpu_time_us":51516,"wal-append.run_wall_time_us":1450532}]]}
I20260709 13:01:19.033809  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.035225  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.011106  1715 leader_election.cc:304] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:18.997119  9529 raft_consensus.cc:3055] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:19.003001  9620 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.042119  9529 raft_consensus.cc:740] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:19.021113  9664 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:19.061582  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.066926  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 56027.4us
I20260709 13:01:19.039104  9605 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:01:19.101373  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 66304.9us
I20260709 13:01:19.039515  9692 raft_consensus.cc:2804] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:19.032392  9636 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:19.105584  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:18.996254  9685 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:19.053794  9620 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.068580  9342 raft_consensus.cc:2749] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:19.100685  9687 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:19.107179  9691 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:19.114037  9636 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:19.113695  9667 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:19.148751  9593 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.153267  9593 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:19.154505  9667 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:19.155695  9593 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:19.135226  9691 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.158408  9691 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.158867  9685 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:19.123929  9692 raft_consensus.cc:697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:19.160135  9692 consensus_queue.cc:237] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.160830  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:19.122464  9687 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.134847  9565 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:19.163515  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:01:19.135432  9680 consensus_queue.cc:1059] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:01:19.127353  9529 consensus_queue.cc:260] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:19.194762  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.169500  9593 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.170140  9565 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.169881  9687 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:01:19.205931  9685 raft_consensus.cc:3055] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:01:19.222888  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.226135  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.207636  9565 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:19.232707  9592 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:19.247748  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 109879us
I20260709 13:01:19.208746  9593 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.260438  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.259318  1641 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.219235  9524 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.242694  9685 raft_consensus.cc:740] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:19.269551  1641 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.282501   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:19.286883  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 258513us
I20260709 13:01:19.272210  9680 raft_consensus.cc:2804] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:19.289048  2279 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:19.280445  9667 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.288060  9524 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.299571  9524 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.302044  9524 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.305181  9677 raft_consensus.cc:2804] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:01:19.316862  9696 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:19.297183  9702 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:19.319591  9702 raft_consensus.cc:697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:19.320839  9702 consensus_queue.cc:237] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.331758  9697 consensus_queue.cc:1048] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:19.292344  9691 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.337940  9691 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.343022  9593 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:19.339419  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.345309  9636 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.356110  1566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.026s	sys 0.027s
W20260709 13:01:19.361290  1566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.026s	sys 0.027s
W20260709 13:01:19.361812  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 643543us
I20260709 13:01:19.307847  9667 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.373061  9585 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.306655  9685 consensus_queue.cc:260] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.376717  9685 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:19.380802  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.382153  9524 raft_consensus.cc:2804] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:19.382615  9524 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:19.382979  9524 raft_consensus.cc:3060] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:01:19.398334  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.402711  9636 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:19.367132  9677 raft_consensus.cc:697] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEADER]: Becoming Leader. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Running, Role: LEADER
I20260709 13:01:19.404742  9677 consensus_queue.cc:237] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:19.409204  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49895.9us
W20260709 13:01:19.411746  9690 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.417s	user 0.004s	sys 0.000s
I20260709 13:01:19.412910  9593 consensus_queue.cc:1048] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:19.414806  2316 raft_consensus.cc:1275] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:01:19.416159  9644 consensus_queue.cc:1048] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:19.417945  9529 raft_consensus.cc:3060] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.418370  9592 consensus_queue.cc:1048] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:19.422454  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.411950  9569 raft_consensus.cc:1064] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:19.427058  1750 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:19.438194  9687 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.440984  9687 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:19.427659  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47006.8us
W20260709 13:01:19.431766  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.436023  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.455082  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.455699  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.457705  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:19.458624  1675 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:19.467744  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.451349  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.472626  1672 raft_consensus.cc:1275] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:01:19.435622  9698 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.499341  1674 raft_consensus.cc:1275] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:01:19.478798  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:19.480875  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:19.491657  1749 raft_consensus.cc:1275] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:01:19.479571  1672 raft_consensus.cc:1275] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:19.479960  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:19.521502  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:19.502157  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:19.495146  9593 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.450976  9569 raft_consensus.cc:1068] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Unable to promote non-voter 570958eb733a4af7ae16ae020998c8b4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:19.529402  1670 raft_consensus.cc:1275] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:01:19.523658  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.519410  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:19.530800  1672 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:19.536226  1671 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:19.453873  9680 raft_consensus.cc:697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:01:19.559720  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 282973us
I20260709 13:01:19.566437  1641 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:19.474869  9585 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:19.476009  9694 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:19.552997  1675 raft_consensus.cc:2468] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:19.524955  9691 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.557518  9686 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:19.590548  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:19.592480  1675 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:19.567329  9665 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:19.554807  9480 consensus_queue.cc:1048] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 13:01:19.566679  9636 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:19.526345  9698 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.593096  1672 raft_consensus.cc:2468] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:19.529320  9524 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.614084  9383 raft_consensus.cc:2764] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:01:19.620185  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.548424  9593 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.560961  9527 consensus_queue.cc:1048] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:19.591054  9686 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.592060  9526 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.651189  9696 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:19.584666  9691 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.666227  9664 consensus_meta.cc:287] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.007s
I20260709 13:01:19.676085  1715 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:19.583276  9694 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:19.734010  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58084.5us
I20260709 13:01:19.712728  9686 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.627781  9665 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.729739  9684 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:19.707887  9569 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.730975  9709 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.753129  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 301974us
I20260709 13:01:19.647239  9636 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.766744  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.740150  9667 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:19.770422  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.719274  9585 consensus_queue.cc:1048] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260709 13:01:19.776806  9565 consensus_meta.cc:287] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.009s
I20260709 13:01:19.719713  9526 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.788048  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.777814  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:19.770285  9620 consensus_meta.cc:287] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: Time spent flushing consensus metadata: real 0.642s	user 0.002s	sys 0.012s
I20260709 13:01:19.708415  9680 consensus_queue.cc:237] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.822928  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.738667  9664 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.828271  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.787799  9565 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.832981  9694 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:19.833745  9565 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.845391  9526 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.791115  9716 raft_consensus.cc:2804] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:19.847678  9716 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:19.848248  9716 raft_consensus.cc:3060] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:19.848585  9691 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:19.807205  9605 consensus_meta.cc:287] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.698s	user 0.017s	sys 0.000s
I20260709 13:01:19.793779  9715 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:19.852733  9524 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:19.852883  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56617.4us
I20260709 13:01:19.770567  9709 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.854339  9664 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:19.854818  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.855463  9709 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.857715  9636 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:19.767634  9569 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:19.863018  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.792856  9698 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:19.786082  9667 consensus_queue.cc:1048] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:01:19.873593  1677 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:19.833765  9694 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:01:19.852759  9715 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.869890  9534 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:19.800602  9620 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:19.875156  9691 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.899631  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 333428us
I20260709 13:01:19.887737  9694 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 28 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:19.884428  9715 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:19.915861  1500 catalog_manager.cc:5697] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:19.918581  1500 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:19.925559  2311 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 in current term 15: Already voted for candidate 570958eb733a4af7ae16ae020998c8b4 in this term.
I20260709 13:01:19.920637  9694 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:19.922174  9665 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:19.923447  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.929380  1500 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.931639  1500 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 15 to 16, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:19.935859  1643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.939276  9569 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:19.942713  1500 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 18, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:19.950129  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 214410us
I20260709 13:01:19.924093  1641 leader_election.cc:400] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:01:19.952178  1641 leader_election.cc:403] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:19.950347  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 23 to 25, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:19.952277  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.957571  1500 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 20 to 22, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:19.961040  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 57758.5us
I20260709 13:01:19.957221  1715 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.988487  1500 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.989812  1715 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:19.990607  1500 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 18 to 21, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:19.927977  9593 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:19.952823  9677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.024s	sys 0.033s
W20260709 13:01:19.996156  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 218556us
I20260709 13:01:19.995019  1500 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 15 to 20, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:19.909272  9691 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.002317  1500 catalog_manager.cc:5697] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:20.000501  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:20.005158  1749 raft_consensus.cc:1275] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:20.005592  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.001081  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:20.007277  1641 consensus_peers.cc:597] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbe0e89474f14ac0be0bd7343e0f4601. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:20.007819  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 44214us
I20260709 13:01:20.012871  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:20.013785  1675 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:20.011865  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:20.018893  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:20.020928  1566 leader_election.cc:400] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:01:20.021327  1566 leader_election.cc:403] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:19.987666  9665 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:01:20.022727  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.010448  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.025008  1669 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
W20260709 13:01:20.001363  9677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.024s	sys 0.033s
I20260709 13:01:20.030159  1641 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:19.996055  9585 raft_consensus.cc:2804] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:20.002372  9534 raft_consensus.cc:2804] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:20.038045  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.048013  1669 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:20.040037  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:20.051914  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:20.041581  9680 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:19.958909  9569 consensus_queue.cc:1048] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:01:20.011865  9524 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:20.068095  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:20.069212  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.071668  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.072140  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:20.073593  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.021134  9526 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:20.080210  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.026516  9636 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:20.029798  9342 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.089375  1641 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.028158  9665 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.104408  1675 raft_consensus.cc:2468] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:20.100328  9665 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:20.084589  9529 consensus_meta.cc:287] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.666s	user 0.015s	sys 0.000s
I20260709 13:01:20.071259  9605 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:20.070953  9569 consensus_queue.cc:1243] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:20.070540  9593 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:01:20.107905  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 92713us
I20260709 13:01:20.067417  9585 raft_consensus.cc:697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:20.093034  9534 raft_consensus.cc:697] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:20.080803  9524 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.125754  1641 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.143659  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:20.099274  9636 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.133427  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:20.081184  9698 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:20.182034  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:20.131773  9722 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:01:20.111316  9526 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:01:20.117010  9605 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.121992  9593 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.133455  9529 raft_consensus.cc:3060] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:01:20.194574  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.136611  9685 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:20.202203  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:20.187649  9636 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:20.184803  9524 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.187939  9664 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.235901  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.197454  9605 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:20.181166  9730 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:01:20.241851  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.193077  9512 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:20.200327  9593 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:20.198933  9620 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.203137  9723 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919) with higher term. Message: Invalid argument: T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 for earlier term 17. Current term is 18.
I20260709 13:01:20.256227  1671 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 20.
I20260709 13:01:20.228731  9698 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:20.188723  9611 consensus_queue.cc:1048] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:01:20.238003  9342 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:20.302341  9569 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:20.303139  9569 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.306447  9534 consensus_queue.cc:237] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.270658  9512 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.200152  9709 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 13:01:20.310472  9512 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.303049  9342 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.318842  9691 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.313792  9342 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:20.287746  9727 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:01:20.287916  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:20.288661  9731 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:01:20.249110  9702 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:20.296234  2311 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:20.296420  9719 log.cc:927] Time spent T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:01:20.247973  9707 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:20.300437  9607 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.339258  9607 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.342187  9607 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.256983  9585 consensus_queue.cc:237] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.344677  9697 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:20.345336  9697 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.313510  9726 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:20.327826  9740 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.286546  9728 log.cc:927] Time spent T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:01:20.249400  9664 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.331638  9735 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:20.332973  9739 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:01:20.357621  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.390198  9726 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:01:20.450378  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 317179us
I20260709 13:01:20.391513  9740 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:20.483119  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.433563  9687 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:20.472505  9686 consensus_meta.cc:287] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.004s
W20260709 13:01:20.434399  9716 consensus_meta.cc:287] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.001s
I20260709 13:01:20.423220  9739 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.487632  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.314875  9715 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.491036  1674 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:20.502594  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.484707  9687 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.506994  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.508026  1676 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:20.484860  9526 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:20.485886  9751 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.493604  9739 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:20.525830  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:20.525897  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 74496.2us
I20260709 13:01:20.529476  1745 raft_consensus.cc:1240] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:20.485915  9686 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.532467  1750 raft_consensus.cc:1240] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:20.534051  1745 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Rejecting Update request from peer 1a40ab12c220464db732562e88c32c11 for earlier term 30. Current term is 31. Ops: [30.18-30.18]
I20260709 13:01:20.515749  9691 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 13:01:20.532131  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.535975  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.493089  9716 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:01:20.551051  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54772.4us
I20260709 13:01:20.554659  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:20.555483  1750 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:20.556723  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:20.557194  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:20.557878  1744 raft_consensus.cc:3060] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:20.565349  1743 raft_consensus.cc:1275] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:01:20.566886  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 87799.8us
I20260709 13:01:20.538395  9691 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:01:20.572248  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.567766  9569 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.540738  9697 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.575629  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.576469  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.582494  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.583245  1751 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 28.
I20260709 13:01:20.589015  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.590265  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.595422  9748 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:20.595829  9342 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.596251  9748 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.596686  9342 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.598556  9746 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.599181  9746 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.600826  9716 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Requested vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.601429  9746 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.601958  9746 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.602422  9746 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.603456  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.604187  1750 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:20.604848  9342 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.605242  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:20.606673  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.606931  9758 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:20.608724  9758 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:20.608168  9734 log.cc:927] Time spent T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:20.607873  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.615188  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:20.624794  1743 raft_consensus.cc:3060] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:20.630926  9686 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.617370  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:20.633858  1566 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Timed out: RequestConsensusVote RPC to 127.0.107.194:39729 timed out after 1.512s (SENT)
W20260709 13:01:20.634974  1566 connection.cc:256] RPC call timeout handler was delayed by -1.9919466490000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:01:20.635468  9715 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.636884  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.548319  9694 consensus_queue.cc:1059] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:01:20.638437  1751 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:20.640697  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:20.566403  9735 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:01:20.521417  9751 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.645255  1751 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:01:20.650518  9747 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.653240  9748 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.653128  9605 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.660845  1670 pending_rounds.cc:85] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 9
I20260709 13:01:20.675107  1670 pending_rounds.cc:107] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:01:20.675429  1670 raft_consensus.cc:2889] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:20.678131  9665 consensus_meta.cc:287] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.002s
I20260709 13:01:20.678882  9665 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:20.681511  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.655467  9664 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.683362  9747 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.686123  9751 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.683944  1748 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:20.684867  9605 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.692060  9715 raft_consensus.cc:3055] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:20.692644  9715 raft_consensus.cc:740] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:20.641173  9686 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.711983  1744 raft_consensus.cc:2468] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 23.
I20260709 13:01:20.683952  9735 consensus_queue.cc:1243] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:20.568174  9526 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.664932  9744 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.730746  1743 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:20.661288  9740 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.705039  9747 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.683763  9726 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.711246  9751 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.717608  9636 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.655697  9691 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.744848  9758 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.727409  9686 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:20.776398  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 140648us
I20260709 13:01:20.754805  9664 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.780516  9691 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:01:20.781869  9755 log.cc:927] Time spent T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:01:20.782339  9665 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:20.783589  9753 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:01:20.760354  9751 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.789733  9686 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.750006  9744 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.793998  9744 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:20.795912  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.747443  9593 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:20.803234  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6799917609999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:01:20.803843  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6430917609999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:01:20.803404  9686 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.804260  1566 connection.cc:256] RPC call timeout handler was delayed by -1.6295917609999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 13:01:20.804680  1566 connection.cc:256] RPC call timeout handler was delayed by -1.5395917609999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:01:20.805271  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4999917609999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:01:20.804785  9686 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:20.805840  1566 connection.cc:256] RPC call timeout handler was delayed by -1.4684917609999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:01:20.806211  1566 connection.cc:256] RPC call timeout handler was delayed by -1.437891761000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 13:01:20.806510  1566 connection.cc:256] RPC call timeout handler was delayed by -1.3717078100000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:01:20.806829  1566 connection.cc:256] RPC call timeout handler was delayed by -1.2695917610000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 13:01:20.807173  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1116078100000664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 13:01:20.826829  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.834152  1745 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:20.749615  9715 consensus_queue.cc:260] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.801602  9687 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.801143  9746 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:20.812623  9524 consensus_meta.cc:287] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.005s
I20260709 13:01:20.813026  9751 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.814049  9740 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:01:20.835731  9529 consensus_meta.cc:287] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.003s
I20260709 13:01:20.802649  9664 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.830986  9745 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:20.837356  9763 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:01:20.844826  9686 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.847744  9745 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.857333  9745 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.857577  9636 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.817329  9758 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:20.830621  9735 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:01:20.834230  9766 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:20.860988  9715 raft_consensus.cc:3060] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:20.843916  9529 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001) with higher term. Message: Invalid argument: T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:01:20.861204  9740 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.869190  9758 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.860780  9751 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:20.893208  9751 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:20.895862  9758 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.890777  9740 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.841449  9524 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.900393  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.902014  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.909816  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:20.887247  9754 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.238s	user 0.001s	sys 0.002s
I20260709 13:01:20.903920  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.913995  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:20.915520  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.918664  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 86312.8us
I20260709 13:01:20.842550  9716 consensus_queue.cc:1059] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:01:20.928290  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.910872  9694 raft_consensus.cc:3055] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:20.920738  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.922730  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.920707  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:20.932719  1675 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:20.933109  1673 raft_consensus.cc:2410] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:20.907681  9751 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:20.940558  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.935627  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.943936  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:20.944850  1677 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:20.948475  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:20.949448  1676 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:01:20.950531  1674 raft_consensus.cc:1275] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:20.952553  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:20.953320  1673 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 27.
I20260709 13:01:20.960501  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.931897  9694 raft_consensus.cc:740] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:20.941854  9529 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:20.931015  9758 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:20.974449  1566 leader_election.cc:400] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25.
I20260709 13:01:20.983290  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
I20260709 13:01:20.986256  1676 raft_consensus.cc:2468] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:20.977397  9740 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:01:20.973107  9735 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:20.952013  9739 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.999405  9694 consensus_queue.cc:260] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:20.987020  9758 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.987212  9593 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:20.988394  9524 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:20.987020  9636 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:20.984246  1677 raft_consensus.cc:2468] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:01:21.005676  1675 raft_consensus.cc:2468] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 25.
I20260709 13:01:21.009649  9773 raft_consensus.cc:2804] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:21.012342  9773 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.005730  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.012781  9773 raft_consensus.cc:3060] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:21.013648  9716 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.014636  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.015669  9766 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:21.011699  9694 raft_consensus.cc:3060] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:21.023794  9636 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.024770  9739 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:21.032298  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.005394  9740 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 27 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:21.035427  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.005987  9735 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:21.033082  9691 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:21.036904  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:21.048939  1675 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:21.038331  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.052289  1677 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 32 because replica has last-logged OpId of term: 30 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 17.
I20260709 13:01:21.036751  9664 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:21.034934  9774 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:01:21.034123  9771 log.cc:927] Time spent T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
I20260709 13:01:21.039973  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:21.041136  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.058718  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.071766  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.072293  1745 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:21.070974  1715 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.073797  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:21.074445  1677 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:21.038874  9636 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:21.075839  9746 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:21.076448  9746 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.039181  9739 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:21.078765  9746 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:21.032168  9766 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:01:21.038709  9691 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.005986  9758 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:21.085510  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45678.7us
I20260709 13:01:21.091985  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:21.115446  1642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.114934  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.106902  1675 raft_consensus.cc:2468] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
I20260709 13:01:21.138724  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.132879  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:21.139730  1678 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:21.140121  1747 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 15: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
W20260709 13:01:21.084167  9736 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.855s	user 0.001s	sys 0.020s
I20260709 13:01:21.142820  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.142956  1677 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 21.
I20260709 13:01:21.101272  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.143959  1669 raft_consensus.cc:2410] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:01:21.154930  9383 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:21.086367  9534 raft_consensus.cc:2804] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:21.156837  9709 raft_consensus.cc:3055] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:21.157321  9709 raft_consensus.cc:740] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:21.164069  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:21.165135  1673 raft_consensus.cc:2368] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25.
I20260709 13:01:21.168057  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.085430  9766 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:01:21.173341  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:21.086719  9691 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:21.181734  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.083493  9716 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:21.098644  9758 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:21.191378  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.192425  1747 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570958eb733a4af7ae16ae020998c8b4 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
W20260709 13:01:21.230744  1641 leader_election.cc:336] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.214390  9724 log.cc:927] Time spent T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:21.241971  9773 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.248644  9773 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:21.256651  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 155546us
I20260709 13:01:21.257913  9534 raft_consensus.cc:697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:21.259594  9534 consensus_queue.cc:237] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.258141  9744 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.263772  9744 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.256841  9726 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:21.267302  9726 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:21.267889  9726 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:21.271952  9744 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:21.257969  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.274361  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.275746  9593 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:21.281147  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.277952  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:21.276335  9593 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:21.283102  9593 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:21.287621  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.292351  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:21.292838  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.293567  1749 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:21.296538  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:21.096479  9735 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.292896  1715 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.290617  9744 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:21.096067  9740 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:21.298386  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 83783.1us
I20260709 13:01:21.299228  1745 raft_consensus.cc:2393] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:21.302469  9636 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:01:21.304179  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.232923  2279 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.309504  1747 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:21.304847  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38702 (request call id 1851) took 1440 ms. Trace:
W20260709 13:01:21.312942  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 80162.3us
W20260709 13:01:21.309866  1641 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:21.311725  1672 rpcz_store.cc:276] 0709 13:01:19.864643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.864970 (+   327us) service_pool.cc:224] Handling call
0709 13:01:19.865463 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.865772 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.865811 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.871843 (+  6032us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.021398 (+149555us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:20.021452 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.021538 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.083356 (+1061818us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:21.298761 (+215405us) raft_consensus.cc:1685] finished
0709 13:01:21.298794 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.304776 (+  5982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7434240,"thread_start_us":142144,"threads_started":1,"wal-append.queue_time_us":245493}
I20260709 13:01:21.325508  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.300172  9744 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.290333  9605 consensus_queue.cc:1048] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:01:21.307282  9667 raft_consensus.cc:2804] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:21.329041  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.321475  9636 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.335141  1749 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:21.348809  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.354035  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.355391  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.355748  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.356206  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:21.366137  2312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.366636  1745 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:21.366669  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:21.368840  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 59075.5us
W20260709 13:01:21.369925  1641 consensus_peers.cc:597] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:21.380903  1641 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.382112  1641 leader_election.cc:336] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.383143  1641 leader_election.cc:336] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.377170  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 61733.6us
I20260709 13:01:21.389129  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:21.363719  9744 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:21.367303  9636 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:01:21.393275  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:21.411815  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:21.316177  9689 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:21.358433  9691 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.408324  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:21.429709  1748 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:21.413614  1749 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:21.422320  1641 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:21.428309  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
W20260709 13:01:21.433140  1641 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.434182  1641 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.435480  1641 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:21.434041  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:21.437367  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:21.442214  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:21.440567  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:21.464860  1749 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:21.436739  9691 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.482129  9691 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:21.465341  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.467024  9723 consensus_queue.cc:1059] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:01:21.470301  9383 consensus_queue.cc:1059] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:01:21.494181  2279 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:21.488924  9529 consensus_meta.cc:287] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.001s
I20260709 13:01:21.498697  9780 ts_tablet_manager.cc:933] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:21.502574  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.513480  9694 consensus_queue.cc:1059] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:21.514926  9694 raft_consensus.cc:3055] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:21.515457  9694 raft_consensus.cc:740] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:21.516745  9694 consensus_queue.cc:260] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.518587  9694 raft_consensus.cc:3060] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:21.508749  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:21.540119  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.540834  9716 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:21.532310  1566 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.502712  9691 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:21.510545  9584 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:21.525866  9592 raft_consensus.cc:1064] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:21.549341  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.541358  9716 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:21.565021  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.522485  9529 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:21.576617  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.553738  9758 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:21.511619  9773 consensus_queue.cc:1059] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:01:21.585712  9715 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:21.567296  9716 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:21.574643  9766 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:21.594713  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 302040us
I20260709 13:01:21.599233  1715 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.588097  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.592950  9479 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:21.596997  9667 raft_consensus.cc:697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:21.626922  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.596230  9758 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:21.640722  9715 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:21.659991  9667 consensus_queue.cc:237] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.635691  9766 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:21.640214  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:21.694936  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 54863.9us
I20260709 13:01:21.697916  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:21.728776  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 207259us
W20260709 13:01:21.730103  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 207797us
I20260709 13:01:21.682853  9766 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:21.639443  9479 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.732823  9758 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.7, Last appended by leader: 7, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.664474  9592 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:21.754417  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.757426  9479 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:21.727300  9715 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:01:21.767282  9784 log.cc:927] Time spent T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:01:21.638943  9709 consensus_queue.cc:260] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:21.776701  9789 log.cc:927] Time spent T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:21.777422  9749 raft_consensus.cc:2804] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:21.797327  9715 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.791833  9773 consensus_queue.cc:1243] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:01:21.795123  9691 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.804603  9715 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:21.808868  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 209827us
I20260709 13:01:21.812636  1715 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.802728  9709 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.820468  1749 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:01:21.815651  1715 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:21.825413  2279 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 72 similar messages]
I20260709 13:01:21.825721  1566 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:21.831014  1746 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 13:01:21.813289  9749 raft_consensus.cc:697] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:21.818874  9803 raft_consensus.cc:2804] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:21.833376  9740 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.826648  9766 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:21.828047  9773 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.831097  9735 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:21.886982  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 58753.5us
I20260709 13:01:21.890478  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.853246  9802 raft_consensus.cc:2804] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:01:21.880650  9593 consensus_meta.cc:287] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.003s
I20260709 13:01:21.897503  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.899339  9808 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:21.902971  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:21.885270  9773 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:21.892541  9785 log.cc:927] Time spent T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:21.852494  9636 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:21.913890  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.915815  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 163489us
W20260709 13:01:21.918958  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 47533.7us
I20260709 13:01:21.921772  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.918897  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.924693  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:21.925482  1672 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:21.885782  9735 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.929479  9735 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:21.870301  9740 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.904230  9593 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.917526  9584 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:21.932593  2311 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:21.933403  9593 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:21.933674  9636 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 28 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:21.935771  9793 log.cc:927] Time spent T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:01:21.899952  9749 consensus_queue.cc:237] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:21.915423  9803 raft_consensus.cc:697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
W20260709 13:01:21.902931  9788 log.cc:927] Time spent T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:01:21.870554  9766 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.938527  1750 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:21.939332  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:21.941363  1671 raft_consensus.cc:1275] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:21.900931  9780 tablet_copy_client.cc:323] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:01:21.943635  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:21.944445  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 119120us
I20260709 13:01:21.963148  9740 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:21.952984  9715 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:21.957180  9664 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.964736  9664 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:21.965497  9766 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:21.967010  1715 leader_election.cc:336] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:21.967840  9664 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:21.963236  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:21.951965  9726 consensus_meta.cc:287] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.012s
W20260709 13:01:21.974565  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:21.992043  2279 leader_election.cc:336] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:21.993599  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:21.902347  9694 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:01:21.937212  9798 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
W20260709 13:01:21.999789  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 60575.9us
W20260709 13:01:21.999478  2279 leader_election.cc:336] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:21.946321  9796 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.003822  1715 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:22.006126  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.008280  9798 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.014899  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:22.007488  9773 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:22.011698  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.019402  1675 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:22.020020  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.020666  1674 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:01:22.021124  1641 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:22.016476  2317 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 15.
W20260709 13:01:22.014819  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.027300  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.002326  9802 raft_consensus.cc:697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:22.032217  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:22.009541  9799 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:21.998852  9726 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:22.064018  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.040387  9664 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:22.079847  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.080178  1744 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:22.026476  9383 consensus_queue.cc:1048] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:01:22.081995  1675 raft_consensus.cc:2468] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 24.
I20260709 13:01:22.078768  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.021987  9796 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.068570  9746 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:22.076097  9758 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.064378  9819 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:22.104069  9716 consensus_meta.cc:287] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.000s
W20260709 13:01:22.114588  9822 log.cc:927] Time spent T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.066s	user 0.000s	sys 0.004s
I20260709 13:01:22.111410  9758 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.114655  9383 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:22.114670  9810 log.cc:927] Time spent T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:01:22.119357  9805 log.cc:927] Time spent T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:01:22.121538  9815 log.cc:927] Time spent T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:22.106710  9593 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:22.135830  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.102133  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet bbe0e89474f14ac0be0bd7343e0f4601 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:01:22.089282  9791 consensus_queue.cc:1048] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:01:22.044559  9803 consensus_queue.cc:237] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:22.128085  9744 consensus_meta.cc:287] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: Time spent flushing consensus metadata: real 0.695s	user 0.006s	sys 0.011s
I20260709 13:01:22.162717  1674 raft_consensus.cc:2468] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 28.
W20260709 13:01:22.148082  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 79440.6us
I20260709 13:01:22.067751  9802 consensus_queue.cc:237] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:22.147524  9794 log.cc:927] Time spent T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:01:22.109671  9746 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:22.197954  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 177259us
I20260709 13:01:22.201912  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:22.203330  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:22.150918  9593 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.206107  1641 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:22.131433  9716 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.164667  9799 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:22.220144  1641 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:22.143877  9383 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.196481  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet bbe0e89474f14ac0be0bd7343e0f4601 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-bbe0e89474f14ac0be0bd7343e0f4601
I20260709 13:01:22.212615  9593 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.166075  9744 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.250715  9716 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:22.257314  9820 log.cc:927] Time spent T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:01:22.258625  9821 log.cc:927] Time spent T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:22.260080  9796 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.263041  9828 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:22.265451  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 60570.2us
I20260709 13:01:22.279100  9726 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:22.247632  9812 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:22.317085  1688 tablet_copy_source_session.cc:215] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:22.245616  9830 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.266358  9824 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:01:22.264163  9828 raft_consensus.cc:2804] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:01:22.322547  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 102599us
I20260709 13:01:22.333880  1678 raft_consensus.cc:1275] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:01:22.336338  1641 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:22.319343  9812 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.318706  9798 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.343274  1641 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:22.329593  9824 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.346125  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
W20260709 13:01:22.356194  9825 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:01:22.333223  9830 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.358453  9529 raft_consensus.cc:3055] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:22.358999  9529 raft_consensus.cc:740] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:22.345845  9812 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:22.336948  9828 raft_consensus.cc:697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:22.360050  9529 consensus_queue.cc:260] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.361335  9828 consensus_queue.cc:237] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.362874  9830 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:22.367267  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.361258  9529 raft_consensus.cc:3060] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:22.375712  9383 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.377431  9780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe0e89474f14ac0be0bd7343e0f4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:22.344589  9796 raft_consensus.cc:2804] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:01:22.389959  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 43954.7us
W20260709 13:01:22.388454  9709 consensus_meta.cc:287] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.003s
I20260709 13:01:22.400074  9798 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.400986  9798 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:22.404264  1673 raft_consensus.cc:2410] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:22.353217  9824 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:01:22.367506  9691 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:22.423940  1744 raft_consensus.cc:1275] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:22.393558  9383 raft_consensus.cc:2764] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:01:22.429818  1744 raft_consensus.cc:1275] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:22.394013  9758 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.428292  9529 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:22.441697  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:22.445242  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72296.6us
I20260709 13:01:22.446353  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.428246  9796 raft_consensus.cc:697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:22.454490  9744 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:22.437703  9833 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:22.456619  9838 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.457120  9833 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:22.441852  9817 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.458352  9817 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:22.439599  9529 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.460800  9817 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:22.462040  9529 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.457299  9838 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.464886  9838 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.435276  9746 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:22.465736  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.466768  1743 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 31.
I20260709 13:01:22.468034  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.472694  9833 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.478152  9812 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.481742  9812 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:22.479151  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.485970  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.491452  9798 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:22.491803  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.492638  1671 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:22.501926  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.505293  1671 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 20.
I20260709 13:01:22.507395  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.511844  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.515228  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.516691  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.519316  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.520684  1675 raft_consensus.cc:2393] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:22.523473  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.513327  1671 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:22.533738  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.534747  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.535995  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.536589  1677 raft_consensus.cc:1240] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 13:01:22.533738  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:22.536603  9781 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.934s	user 0.007s	sys 0.000s
I20260709 13:01:22.453577  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.557402  1744 raft_consensus.cc:2393] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 20: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:22.562815  9796 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:22.566680  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.578954  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.580152  1671 raft_consensus.cc:2410] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 31 because replica has last-logged OpId of term: 30 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 17.
I20260709 13:01:22.581048  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.582671  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.583361  1670 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:22.583462  1715 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.587045  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.588116  1671 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:22.596766  1672 raft_consensus.cc:1275] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:01:22.599270  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.599494  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.600898  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:22.603197  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.605078  9824 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.615362  1674 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 28. Current term is 29. Ops: []
I20260709 13:01:22.615847  9664 raft_consensus.cc:2804] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:22.620059  9664 raft_consensus.cc:697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 24 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:22.621243  9664 consensus_queue.cc:237] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.622601  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.624359  9845 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.624963  1673 raft_consensus.cc:1217] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 20.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 13:01:22.625036  9845 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.625667  1673 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:01:22.613298  1715 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.607646  9809 raft_consensus.cc:1027] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: attempt to promote peer 570958eb733a4af7ae16ae020998c8b4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:01:22.607498  9824 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:22.638051  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.648756  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
W20260709 13:01:22.631798  9808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.010s	sys 0.014s
I20260709 13:01:22.656154  1676 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:22.633630  1670 raft_consensus.cc:2468] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:22.648073  1641 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:22.662601  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:22.662926  1678 raft_consensus.cc:1240] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:01:22.656332  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.664002  1673 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:22.664088  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.666610  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:22.666637  9819 consensus_queue.cc:1048] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:22.667457  1743 raft_consensus.cc:3060] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:22.667907  1670 raft_consensus.cc:1240] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:01:22.667768  1715 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.668977  9819 raft_consensus.cc:2804] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:22.669255  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.669502  9819 raft_consensus.cc:697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:22.669361  1671 raft_consensus.cc:2468] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 21.
I20260709 13:01:22.661428  9845 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.670351  9529 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.637521  9792 raft_consensus.cc:1027] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: attempt to promote peer 570958eb733a4af7ae16ae020998c8b4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:01:22.660321  9808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.010s	sys 0.015s
I20260709 13:01:22.655200  9791 raft_consensus.cc:2804] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:01:22.678297  1752 raft_consensus.cc:2393] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 19: Already voted for candidate 693257b3078444e0bd26d3e82159d452 in this term.
I20260709 13:01:22.654736  9694 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.678853  1671 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 18. (term mismatch)
I20260709 13:01:22.676676  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.674464  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.681494  1671 pending_rounds.cc:85] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 17
I20260709 13:01:22.608395  9593 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:22.681931  1671 pending_rounds.cc:107] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 30.18
I20260709 13:01:22.681939  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:22.683864  2311 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 15.
I20260709 13:01:22.683467  1671 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.690801  1743 raft_consensus.cc:2468] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:22.680372  9808 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:22.693842  9808 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:22.700564  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.701411  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.702101  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.702788  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.671115  9529 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.685287  9694 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.705829  9529 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.660647  9746 consensus_queue.cc:1048] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:01:22.712334  1750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48448 (request call id 3372) took 1353 ms. Trace:
I20260709 13:01:22.712865  1750 rpcz_store.cc:276] 0709 13:01:21.359177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.364216 (+  5039us) service_pool.cc:224] Handling call
0709 13:01:21.364645 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.962292 (+597647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.712021 (+749729us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54000d3254. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:22.712258 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320038272}
I20260709 13:01:22.705072  9723 raft_consensus.cc:3055] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:22.715693  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:22.724062  1752 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:01:22.716928  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:22.726383  1749 raft_consensus.cc:2393] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a40ab12c220464db732562e88c32c11 in current term 16: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:22.671511  9824 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.729413  1673 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
I20260709 13:01:22.723140  9723 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
W20260709 13:01:22.735226  9790 log.cc:927] Time spent T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.958s	user 0.000s	sys 0.007s
I20260709 13:01:22.723188  9791 raft_consensus.cc:697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 28 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:22.737857  9791 consensus_queue.cc:237] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.743335  1715 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.691946  9807 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:22.764297  9807 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.764779  9807 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:22.764953  9593 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:22.748637  9819 consensus_queue.cc:237] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.707330  9694 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.734714  9723 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:22.763574  9592 raft_consensus.cc:2804] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:22.776980  1752 raft_consensus.cc:2468] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 29.
W20260709 13:01:22.783114  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 79728.2us
W20260709 13:01:22.784437  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.791051  1641 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:22.767493  9780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36896 (request call id 561) took 1717 ms. Trace:
I20260709 13:01:22.789994  9592 raft_consensus.cc:697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:22.805763  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.824393  9592 consensus_queue.cc:237] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.807520  9723 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:22.829751  1641 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.831117  9799 raft_consensus.cc:2804] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:22.831816  9799 raft_consensus.cc:697] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:22.831971  1641 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:22.832839  9799 consensus_queue.cc:237] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.833979  9383 raft_consensus.cc:2804] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:01:22.834640  9383 raft_consensus.cc:697] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 29 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:22.835470  9808 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.835695  9383 consensus_queue.cc:237] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:22.836166  9808 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:22.838698  9808 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:22.798295  9780 rpcz_store.cc:276] 0709 13:01:21.050490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.050717 (+   227us) service_pool.cc:224] Handling call
0709 13:01:21.525487 (+474770us) ts_tablet_manager.cc:934] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
0709 13:01:22.375704 (+850217us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:22.679800 (+304096us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:22.679998 (+   198us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:22.766381 (+ 86383us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:22.766795 (+   414us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:22.767308 (+   513us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:22.767387 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":41214,"tablet-copy.queue_time_us":415615,"thread_start_us":557702,"threads_started":2}
I20260709 13:01:22.845772  9780 tablet_copy_client.cc:806] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
W20260709 13:01:22.807940  9801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.005s	sys 0.010s
I20260709 13:01:22.846755  9780 tablet_copy_client.cc:670] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:22.862211  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 112128us
I20260709 13:01:22.801987  9812 consensus_queue.cc:1048] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:01:22.849123  9846 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:01:22.872999  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:22.874226  2311 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:22.860040  9801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.006s	sys 0.011s
I20260709 13:01:22.887260  1676 raft_consensus.cc:1275] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:22.891258  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:22.892128  1676 raft_consensus.cc:3060] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.897001  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4; no voters: 
I20260709 13:01:22.801774  9796 consensus_queue.cc:1048] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:01:22.903326  1676 raft_consensus.cc:2410] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fab19506de7242869c29d70c9fffb739 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:22.879822  9846 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.885139  9694 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.915251  9709 raft_consensus.cc:2764] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:22.939154  2311 raft_consensus.cc:2468] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 16.
W20260709 13:01:22.964079  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.928256  9846 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:01:22.939591  9529 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.932763  9694 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:23.024173  9856 log.cc:927] Time spent T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:01:23.033106  9853 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:01:22.983808  9529 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:23.048056  1715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.048961  1715 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:23.055164  1678 raft_consensus.cc:1275] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:01:23.057628  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.063962  9809 raft_consensus.cc:2804] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:23.065583  9529 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:23.066741  9852 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:23.076785  9694 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:23.076476  9807 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:23.045099  9726 consensus_queue.cc:1048] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:01:23.093153  9808 consensus_queue.cc:1059] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:23.094293  9808 raft_consensus.cc:3055] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:23.093185  9529 consensus_queue.cc:1059] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:23.094762  9808 raft_consensus.cc:740] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:01:23.094961  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.095322  9849 raft_consensus.cc:3055] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:01:23.095693  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.095857  9849 raft_consensus.cc:740] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:23.081415  9809 raft_consensus.cc:697] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:23.096810  9849 consensus_queue.cc:260] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.097692  9809 consensus_queue.cc:237] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:23.098332  9849 raft_consensus.cc:3060] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:23.100855  9861 log.cc:927] Time spent T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:01:23.101564  9808 consensus_queue.cc:260] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.103065  9808 raft_consensus.cc:3060] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:01:23.106837  1717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.095515  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.118700  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.118551  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:23.118894  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.120397  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.122316  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.133625  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.148132  1566 connection.cc:256] RPC call timeout handler was delayed by -1.1552437469999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:01:23.148885  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0994437469999525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:01:23.153882  1566 connection.cc:256] RPC call timeout handler was delayed by -1.0688437469999599s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:01:23.180619  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.131649  9858 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:23.187876  9529 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:23.188634  9529 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:23.190919  9529 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:23.191265  9807 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:23.182904  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:23.108192  9694 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.092s
I20260709 13:01:23.181736  9791 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:23.204896  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:23.205658  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:23.206758  2317 raft_consensus.cc:2410] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
W20260709 13:01:23.211764  1715 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.214236  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 91051.8us
I20260709 13:01:23.214027  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.217751  1715 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.218633  1715 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.219368  1715 leader_election.cc:336] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.220371  1715 leader_election.cc:336] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.220794  1715 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.223191  1715 leader_election.cc:336] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.240749  1669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46986 (request call id 3643) took 1298 ms. Trace:
I20260709 13:01:23.241472  1669 rpcz_store.cc:276] 0709 13:01:21.942550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.942844 (+   294us) service_pool.cc:224] Handling call
0709 13:01:21.943366 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.030214 (+ 86848us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:01:22.160703 (+130489us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.274675 (+113972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.274775 (+   100us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:01:22.274878 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.240389 (+965511us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b540006e854. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f948148de01 00007f948148c83e 00007f9486451419 00007f947f9c8bd4 00007f947f9c8b62 00007f947f9c8a91 00007f947f9c8a0c 00007f947f9c7cc2 00007f947f7c848c 00007f947f7c78c6
0709 13:01:23.240452 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.240652 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4544,"prepare.queue_time_us":34538,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":57199,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":199020800,"thread_start_us":216455,"threads_started":3,"wal-append.queue_time_us":99611}
I20260709 13:01:23.222040  9593 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:01:23.249614  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 93504.3us
I20260709 13:01:23.226744  9863 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:01:23.251724  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.250274  9694 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:23.266110  9529 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:23.265906  9694 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:23.275424  9529 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.276203  9529 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.278744  9529 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:23.270033  9846 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.289480  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.290866  9846 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 32 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:23.291311  1746 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 28 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 27. Current term is 28. Ops: []
I20260709 13:01:23.292640  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.293530  1752 raft_consensus.cc:2410] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:23.294111  9694 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:23.300822  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.299032  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.322328  1752 raft_consensus.cc:1240] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 28. Current term is 29. Ops: [24.13-28.15]
W20260709 13:01:23.326774  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 75411.3us
I20260709 13:01:23.325379  1744 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23. Ops: []
W20260709 13:01:23.326565  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 400639us
I20260709 13:01:23.327823  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452; no voters: fab19506de7242869c29d70c9fffb739
W20260709 13:01:23.329424  1641 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.332012  1752 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 18 index: 7. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
I20260709 13:01:23.329979  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:23.335670  1641 leader_election.cc:336] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.336160  1641 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.338078  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:23.338466  1641 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.338322  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.338995  1641 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.340564  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:23.341683  1749 raft_consensus.cc:2393] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 20: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:23.346935  1746 raft_consensus.cc:1240] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: []
W20260709 13:01:23.346814  1641 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.351601  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.351927  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.353009  1566 leader_election.cc:400] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25.
I20260709 13:01:23.353319  1566 leader_election.cc:403] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.356462  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.357884  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.349562  1641 leader_election.cc:336] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.359056  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.337296  9836 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:23.357710  9529 raft_consensus.cc:3060] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:23.362529  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.349131  9694 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:23.365296  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.365638  1641 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.349306  9845 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:23.349370  9830 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:01:23.366079  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 140251us
I20260709 13:01:23.356071  9849 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:23.372547  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.355983  9859 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.371932  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 147614us
W20260709 13:01:23.374964  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.375483  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.359688  9808 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:01:23.375988  1641 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.376884  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.377401  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.380324  1641 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.371016  9836 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:23.398597  1641 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.380324  1715 leader_election.cc:336] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.402076  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.402684  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.403064  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.403326  1715 leader_election.cc:336] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.403959  1746 raft_consensus.cc:2468] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693257b3078444e0bd26d3e82159d452 in term 19.
W20260709 13:01:23.404677  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.401070  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:23.406106  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.411108  9780 tablet_copy_client.cc:538] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:23.406683  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.379665  9830 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:23.422693  1715 leader_election.cc:336] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.374660  9877 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:01:23.426826  1715 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.425185  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 62813.4us
I20260709 13:01:23.429875  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.431223  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:23.400908  9808 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:23.422562  9845 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:01:23.434779  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.445412  1715 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.436872  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.380892  9859 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.453981  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.432276  9694 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Leader. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:01:23.454903  1715 leader_election.cc:336] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.457693  1715 leader_election.cc:336] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.458304  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.460181  1568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.444013  9849 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:23.466467  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.468430  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.467310  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.444842  9744 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:23.472561  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:23.454041  9877 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:01:23.478734  1715 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.480436  1715 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.482820  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:23.482812  1715 leader_election.cc:336] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.487017  1715 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.469643  9809 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:23.470233  9808 raft_consensus.cc:3055] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:01:23.489379  1715 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.491403  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.489989  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62192.6us
I20260709 13:01:23.491981  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.472183  9878 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:01:23.498965  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:23.505409  1747 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 31 FOLLOWER]: Advancing to term 32
W20260709 13:01:23.506271  1715 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.506803  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.499480  1743 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:01:23.499606  1752 raft_consensus.cc:1275] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:01:23.508103  1748 raft_consensus.cc:1275] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:01:23.484645  9863 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:23.513269  1715 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.489085  9849 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.514284  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.513151  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:23.518260  1715 leader_election.cc:336] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.518713  1715 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.492570  9808 raft_consensus.cc:740] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:23.528535  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.510917  9879 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:23.499081  9877 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:23.517179  9809 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:23.517445  9878 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.535037  1747 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 32.
I20260709 13:01:23.528429  9863 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.537972  9849 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.538101  9859 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:23.539513  9877 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:23.539784  9830 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.520851  1715 leader_election.cc:336] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.543031  9873 log.cc:927] Time spent T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:23.520120  9694 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.527135  9792 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:23.563438  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.569177  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:23.572644  1641 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:23.569871  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.573348  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.575234  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.575862  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.576561  1672 raft_consensus.cc:2368] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
W20260709 13:01:23.575237  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 54427.7us
W20260709 13:01:23.577800  1715 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.560660  9808 consensus_queue.cc:260] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.578382  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.576613  9877 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:23.572124  9830 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:23.583751  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.584270  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.585347  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:23.592146  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.592514  1715 leader_election.cc:336] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.594436  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.594910  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.595938  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.597443  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.598363  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.600255  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.601177  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.601548  1670 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
I20260709 13:01:23.602816  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:23.576807  9796 raft_consensus.cc:2804] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 13:01:23.568936  9798 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:01:23.605453  1672 raft_consensus.cc:1240] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 22. Current term is 23. Ops: []
I20260709 13:01:23.606695  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.564972  9878 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:23.602918  1715 leader_election.cc:336] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.607002  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.578621  9863 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:23.572383  9836 consensus_queue.cc:1048] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:01:23.610288  1678 raft_consensus.cc:2393] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 25: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:23.603621  9808 raft_consensus.cc:3060] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:23.613195  9605 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:23.574965  9709 consensus_queue.cc:1048] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:23.607681  9819 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:23.603808  9877 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:23.601614  9859 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:23.623433  1746 raft_consensus.cc:1275] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:01:23.592738  9792 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:23.610723  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:23.611642  1715 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.613859  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.626828  1669 raft_consensus.cc:2410] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 10.
I20260709 13:01:23.613533  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:23.615479  1566 leader_election.cc:400] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
I20260709 13:01:23.627691  1566 leader_election.cc:403] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.638801  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:23.620293  9879 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:23.617914  9529 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 24. Current term is 25.
W20260709 13:01:23.644012  1715 leader_election.cc:336] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.609848  9883 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.647264  9883 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:23.648198  9883 consensus_queue.cc:1243] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer 1a40ab12c220464db732562e88c32c11 log is divergent from this leader: its last log entry 17.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:23.648296  9780 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:01:23.644672  9863 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:23.623219  9796 raft_consensus.cc:697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:23.628791  9859 raft_consensus.cc:493] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:23.656234  9859 raft_consensus.cc:515] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:23.658797  9859 leader_election.cc:290] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:23.661589  9808 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:23.620146  9877 consensus_queue.cc:1059] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:01:23.663573  9877 raft_consensus.cc:3055] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:01:23.664090  9877 raft_consensus.cc:740] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:23.664836  9878 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:23.665109  9877 consensus_queue.cc:260] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:23.666226  9830 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:23.666750  9877 raft_consensus.cc:3060] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:01:23.667757  1501 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.616813  9849 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:01:23.639739  9886 raft_consensus.cc:3060] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:01:23.696445   431 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 1628)
I20260709 13:01:23.698395  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:23.684538  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.702718  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 64304.5us
I20260709 13:01:23.705482  9796 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 18, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:23.704355  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.702783  1715 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.711530  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.712242  1715 leader_election.cc:336] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.713235  1715 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.713621  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:23.714846  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.722656  1752 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 31. Current term is 32. Ops: [31.18-31.18]
I20260709 13:01:23.724067  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.726562  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.731065  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.739135  1747 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:23.740801  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.740831  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:23.742054  1677 raft_consensus.cc:2410] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 13:01:23.745368  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:23.745579  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.684330  9836 consensus_queue.cc:1048] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:01:23.747203  1641 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.741298  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.749707  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.749738  1671 raft_consensus.cc:1240] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 27. Current term is 28. Ops: []
I20260709 13:01:23.754501  1669 raft_consensus.cc:2393] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 23: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:23.755686  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:23.756680  1678 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:23.760207  1670 raft_consensus.cc:1275] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:01:23.766021  1670 raft_consensus.cc:1275] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:01:23.740849  9863 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:01:23.768200  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:23.772943  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.776309  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.777361  1676 raft_consensus.cc:1275] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:23.745218  9849 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:23.786103  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 136454us
I20260709 13:01:23.787350  1670 raft_consensus.cc:1275] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:23.789669  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:23.790786  2317 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:23.743920  9808 consensus_queue.cc:1059] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:01:23.793032  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.749897  9830 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:23.802728  1678 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:23.804497  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:23.805873  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eac534aa8b349bc923752022b0b9ab6" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:23.782599  9878 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:23.809407  1678 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:01:23.811307  1678 pending_rounds.cc:85] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 11
I20260709 13:01:23.811805  1678 pending_rounds.cc:107] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:01:23.812366  1678 raft_consensus.cc:2889] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.834731  2317 raft_consensus.cc:2468] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:23.813935  9529 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.789631  9887 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:23.815663  9849 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:01:23.863773  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.801492  9830 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:23.876207  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.865446  9863 consensus_queue.cc:1048] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:01:23.976660  1567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.979176  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 202857us
I20260709 13:01:23.983428  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:23.885704  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.988659  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 102986us
I20260709 13:01:23.989348  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:23.990370  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.993152  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:23.868875  9529 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:24.006254  9830 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:24.011090  9894 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.012844  9849 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:24.013017  9894 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:24.016116  9898 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.017448  9898 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.011253  9895 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:24.015028  9849 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:24.028828  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46489.7us
I20260709 13:01:24.056432  9808 consensus_queue.cc:1243] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer fab19506de7242869c29d70c9fffb739 log is divergent from this leader: its last log entry 28.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 13:01:24.043180  2279 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.061997  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 65602.6us
I20260709 13:01:24.054327  9887 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
W20260709 13:01:24.079419  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 82527.5us
I20260709 13:01:24.089427  9887 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:24.096741  9894 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:24.113603  9809 consensus_queue.cc:1048] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:01:24.110663  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 117839us
I20260709 13:01:24.134549  9898 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:24.137364  1672 raft_consensus.cc:1240] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 LEADER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 31. Current term is 32. Ops: [31.18-31.18]
I20260709 13:01:24.138432  9792 consensus_queue.cc:1048] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:24.141732  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.146430  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 45653us
I20260709 13:01:24.153789  9605 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:24.156121  9858 consensus_queue.cc:1048] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:24.161825  9529 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:24.172209  9780 tablet_bootstrap.cc:700] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Time spent opening tablet: real 0.169s	user 0.003s	sys 0.000s
I20260709 13:01:24.186918  9796 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.202975  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 236) took 8610 ms. Trace:
I20260709 13:01:24.211500  9879 raft_consensus.cc:3055] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:01:24.211889  9887 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:24.212221  9879 raft_consensus.cc:740] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
W20260709 13:01:24.212775  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.214376  2279 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:24.214103  9879 consensus_queue.cc:260] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.224036  9879 raft_consensus.cc:3060] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:01:24.225018  1672 raft_consensus.cc:1275] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:01:24.222119  9796 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.171444  9809 consensus_queue.cc:1048] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:01:24.232214  9796 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:24.227779  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.247004  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.273778  9886 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729) with higher term. Message: Invalid argument: T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 for earlier term 20. Current term is 21.
W20260709 13:01:24.293697  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 116822us
W20260709 13:01:24.285036  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 47868us
I20260709 13:01:24.300690  9877 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:24.300911  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.302253  1747 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:24.304986  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.308189  9877 raft_consensus.cc:3060] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:24.317516  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:24.319741  9887 raft_consensus.cc:2804] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:24.320323  9887 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.320785  9887 raft_consensus.cc:3060] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:24.208823  1500 rpcz_store.cc:276] 0709 13:01:15.595725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.609365 (+ 13640us) service_pool.cc:224] Handling call
0709 13:01:24.202585 (+8593220us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:20.636817 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:20.656453 (+ 19636us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:20.656511 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:01:20.656540 (+    29us) tablet.cc:662] Decoding operations
0709 13:01:20.658341 (+  1801us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:20.658468 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:20.658519 (+    51us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:20.760610 (+102091us) tablet.cc:701] Row locks acquired
0709 13:01:20.765613 (+  5003us) write_op.cc:260] PREPARE: finished
0709 13:01:20.779631 (+ 14018us) write_op.cc:270] Start()
0709 13:01:20.797547 (+ 17916us) write_op.cc:276] Timestamp: P: 1783602080779502 usec, L: 0
0709 13:01:20.797576 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:01:20.798526 (+   950us) log.cc:844] Serialized 4407 byte log entry
0709 13:01:21.462028 (+663502us) op_driver.cc:464] REPLICATION: finished
0709 13:01:21.797926 (+335898us) write_op.cc:301] APPLY: starting
0709 13:01:21.800416 (+  2490us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.377061 (+576645us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.377185 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.463771 (+ 86586us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.464091 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:01:22.464137 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:22.479098 (+ 14961us) log.cc:844] Serialized 105 byte log entry
0709 13:01:22.607839 (+128741us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.608015 (+   176us) write_op.cc:454] Released schema lock
0709 13:01:22.608079 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.608603 (+   524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.608638 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4925,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":318815,"apply.run_cpu_time_us":53747,"apply.run_wall_time_us":818878,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":454318,"prepare.run_cpu_time_us":58026,"prepare.run_wall_time_us":422090,"raft.queue_time_us":432349,"raft.run_cpu_time_us":18433,"raft.run_wall_time_us":198756,"replication_time_us":664230,"thread_start_us":1170558,"threads_started":5,"wal-append.queue_time_us":364788,"wal-append.run_cpu_time_us":84763,"wal-append.run_wall_time_us":2314896}]]}
I20260709 13:01:24.335633  9883 consensus_queue.cc:1059] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: INVALID_TERM, Last received: 29.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 13:01:24.341719  9883 raft_consensus.cc:3055] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 13:01:24.342298  9883 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:24.343235  9529 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.343752  9849 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:24.344340  9529 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.347721  9529 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:24.348097  9883 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.350289  9883 raft_consensus.cc:3060] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:01:24.360394  9887 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:24.367038  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.363438  9887 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:24.391640  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.397814  1641 leader_election.cc:336] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:24.412756  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:24.420459  1641 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.417219  9887 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:24.432868  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.436285  9796 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:24.469550  9887 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:24.476785  1715 leader_election.cc:304] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:24.478363  9593 raft_consensus.cc:2749] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.478930  1715 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:24.497747  9809 raft_consensus.cc:2804] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:24.498422  9809 raft_consensus.cc:697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:24.500099  9809 consensus_queue.cc:237] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:24.499138  9819 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 9 to 14, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:24.508301  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 110581us
W20260709 13:01:24.512218  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 96724.3us
I20260709 13:01:24.513552  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.514783  9887 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:24.519141  2311 raft_consensus.cc:1275] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:24.524986  9796 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.523759  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.531697  9593 consensus_queue.cc:1048] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:24.531433  2311 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 9 to 14, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:24.555191  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:24.562053  9796 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.571496  1747 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
W20260709 13:01:24.572228  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.597076  9808 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:24.612004  9877 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:24.626207  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 102630us
I20260709 13:01:24.652231  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.638375  9809 consensus_queue.cc:1048] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:01:24.654762  9877 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:24.655699  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.656807  9877 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:24.680938  9877 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.681811  9877 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.683774  9796 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:24.684320  9877 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:24.682166  9836 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.685231  9836 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:24.668725  9846 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:24.699836  9836 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:24.701005   431 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 1628)
I20260709 13:01:24.693866  9846 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:24.720937  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 72197.7us
W20260709 13:01:24.732573  9923 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:01:24.738472  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 91938.7us
W20260709 13:01:24.741564  9921 log.cc:927] Time spent T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:24.743081  9846 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:24.744758  9830 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:24.750715  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:24.764078  1641 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:24.764772  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:24.765324  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:24.766355  2317 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:24.775455  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.776639  1746 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:24.766391  1677 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:24.781032  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:24.767827  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 45213.8us
I20260709 13:01:24.787245  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 134) took 9885 ms. Trace:
I20260709 13:01:24.826660  1746 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
W20260709 13:01:24.786278  9923 log.cc:927] Time spent T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: Append to log took a long time: real 0.051s	user 0.001s	sys 0.003s
W20260709 13:01:24.827932  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 44909.5us
W20260709 13:01:24.831314  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 67337.9us
I20260709 13:01:24.837800  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:24.826112  1501 rpcz_store.cc:276] 0709 13:01:14.790320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.799278 (+  8958us) service_pool.cc:224] Handling call
0709 13:01:24.670315 (+9871037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:23.924344 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:23.925126 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:23.925173 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:01:23.925197 (+    24us) tablet.cc:662] Decoding operations
0709 13:01:23.925759 (+   562us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:23.925847 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:23.925895 (+    48us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:23.926103 (+   208us) tablet.cc:701] Row locks acquired
0709 13:01:23.926120 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:01:23.926285 (+   165us) write_op.cc:270] Start()
0709 13:01:23.926411 (+   126us) write_op.cc:276] Timestamp: P: 1783602083926227 usec, L: 0
0709 13:01:23.926431 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:23.927247 (+   816us) log.cc:844] Serialized 536 byte log entry
0709 13:01:24.468638 (+541391us) op_driver.cc:464] REPLICATION: finished
0709 13:01:24.504282 (+ 35644us) write_op.cc:301] APPLY: starting
0709 13:01:24.504409 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:24.506317 (+  1908us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:24.506447 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:24.507429 (+   982us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:24.507822 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:01:24.507910 (+    88us) write_op.cc:312] APPLY: finished
0709 13:01:24.508368 (+   458us) log.cc:844] Serialized 25 byte log entry
0709 13:01:24.509878 (+  1510us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:24.510050 (+   172us) write_op.cc:454] Released schema lock
0709 13:01:24.510120 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:24.589928 (+ 79808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:24.591930 (+  2002us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4542,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":32252,"apply.run_cpu_time_us":5571,"apply.run_wall_time_us":54538,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":218932,"prepare.run_cpu_time_us":9063,"prepare.run_wall_time_us":128185,"raft.queue_time_us":187029,"raft.run_cpu_time_us":12290,"raft.run_wall_time_us":62007,"replication_time_us":506466,"thread_start_us":407138,"threads_started":4,"wal-append.queue_time_us":192628}]]}
I20260709 13:01:24.855909  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:24.861311  1566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.864262  9529 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.845304  9877 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.875277  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.882596  9877 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:24.865392  9529 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:24.885638  9877 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:24.887205  9529 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:24.889153  1641 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:24.917248  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.919771  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:24.921638  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.919771  1675 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 9 to 14, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:24.933857  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:24.936539  1750 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 693257b3078444e0bd26d3e82159d452: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:24.938136  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:24.939242  1678 raft_consensus.cc:2393] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate fab19506de7242869c29d70c9fffb739 in this term.
I20260709 13:01:24.940367  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:24.912920  9906 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:24.950145  1672 raft_consensus.cc:1217] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 12.5->[15.6-20.8]   Dedup: 15.6->[18.7-20.8]
I20260709 13:01:24.953791  1672 pending_rounds.cc:85] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Aborting all ops after (but not including) 6
I20260709 13:01:24.962153  1672 pending_rounds.cc:107] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Aborting uncommitted NO_OP operation due to leader change: 17.7
I20260709 13:01:24.978111  1672 raft_consensus.cc:2889] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:24.987596  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 77728.5us
I20260709 13:01:24.993616  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.002961  1670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:25.010289  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.027913  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:25.038650  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:25.043623  9845 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:25.044318  9845 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.044757  9845 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:25.048967  1497 catalog_manager.cc:5697] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.059751  9906 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:25.060424  9906 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.060786  9906 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:25.067922  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.071754  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:25.097352  9529 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.097671  9877 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.105233  9529 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.105634  9877 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:25.117071  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 121542us
W20260709 13:01:25.125895  9942 log.cc:927] Time spent T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:01:25.138904  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 46380.2us
I20260709 13:01:25.145109  9529 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.145262  2317 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:01:25.102959  1497 catalog_manager.cc:5697] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 22, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:25.148502  1497 catalog_manager.cc:5697] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 21, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 13:01:25.156522  9938 log.cc:927] Time spent T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:25.170051  9846 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.171949  1678 raft_consensus.cc:1240] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Rejecting Update request from peer 693257b3078444e0bd26d3e82159d452 for earlier term 21. Current term is 22. Ops: []
W20260709 13:01:25.184747  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 44922.5us
W20260709 13:01:25.141757  1641 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:25.188187  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 46495.7us
I20260709 13:01:25.150624  1497 catalog_manager.cc:5697] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
W20260709 13:01:25.204172  1641 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.205296  9529 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.206184  9529 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.209689  9529 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.224056  9937 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:01:25.220415  1497 catalog_manager.cc:5697] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 24 to 25, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195), no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:25.249930  9877 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:25.271924  1669 raft_consensus.cc:1275] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:01:25.250186  9845 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.286686  1497 catalog_manager.cc:5697] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.288939  1497 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:25.311932  9846 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.318357  9877 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.318706  1497 catalog_manager.cc:5697] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 15 to 16, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.323966  1497 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 23, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:25.337728  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 80921.3us
I20260709 13:01:25.337497  9877 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:25.344818  9906 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:25.348186  9906 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:25.349093  1715 leader_election.cc:336] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.540s (SENT)
I20260709 13:01:25.350103  9877 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:25.351672  9907 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.357434  9907 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.361433  9907 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.374817  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:25.375957  1746 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:25.381651  9907 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:25.382541  9907 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:25.383697  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:25.384642  1744 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:25.384982  9907 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:25.386504  9845 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.392889  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.395007  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.395816  9877 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:25.363714  1497 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 20, now has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:25.396607  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.402856  9529 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.404870  9529 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
W20260709 13:01:25.407223  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 58216.4us
I20260709 13:01:25.409893  9529 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:25.410367  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.410101  9937 consensus_queue.cc:1048] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:25.412611  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:25.413348  1751 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:25.418309  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:25.422505  9529 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.423242  9529 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.428223  9877 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.429098  9877 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.430553  1746 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
I20260709 13:01:25.430791  9529 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.429443  1751 raft_consensus.cc:2468] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
I20260709 13:01:25.433125  1497 catalog_manager.cc:5697] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 22 to 23, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.421885  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.435947  9709 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.436247  1497 catalog_manager.cc:5697] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:25.438503  9529 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:25.440586  1641 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:25.448987  1641 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:25.449369  9957 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:25.458974  9957 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:25.459426  9845 raft_consensus.cc:2804] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:25.462224  9845 raft_consensus.cc:697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:25.462117  9957 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:25.463449  9529 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.463681  9845 consensus_queue.cc:237] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.466022  9529 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.470451  9877 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.479533  1497 catalog_manager.cc:5697] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 23 to 24, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 24 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.475386  9529 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:01:25.460930  1641 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.503288  1497 catalog_manager.cc:5697] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 19, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.499846  9877 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.518929  1497 catalog_manager.cc:5697] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:25.517990  1641 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.522433  9529 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.527532  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 132714us
I20260709 13:01:25.528064  9529 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.529258  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.530539  9960 raft_consensus.cc:3060] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:25.530941  9529 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:25.533407  1641 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.542625  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.549270  1497 catalog_manager.cc:5697] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.532220  9877 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.559684  9877 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.561209  9955 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:25.566591  9877 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.567461  9877 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.569880  9877 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.571350  1744 raft_consensus.cc:2468] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 22.
W20260709 13:01:25.589500  1569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.592957  1715 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.778s (SENT)
W20260709 13:01:25.591606  1641 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.599260  9877 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:25.600999  9529 consensus_queue.cc:1059] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:25.626138  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.629096  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:25.630831  2279 leader_election.cc:336] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.631713  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.631721  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.633311  9587 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:25.634104  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.880s (SENT)
I20260709 13:01:25.634758  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:25.635044  1746 raft_consensus.cc:2393] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 22: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:25.628829  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.635905  9951 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:25.637094  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.623848  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583de7d6884c4f96b1f47ff7066c2da9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.638852  1497 catalog_manager.cc:5697] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 18, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.572607  9963 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.641776  1641 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
W20260709 13:01:25.644207  2279 leader_election.cc:336] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:25.644764  2279 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.648396  9587 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:25.642781  1497 catalog_manager.cc:5697] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 23 to 25, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 25 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:25.650004  9966 raft_consensus.cc:3055] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:25.650483  9966 raft_consensus.cc:740] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 693257b3078444e0bd26d3e82159d452, State: Running, Role: LEADER
I20260709 13:01:25.649866  1497 catalog_manager.cc:5697] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 22, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:25.655735  9845 raft_consensus.cc:2804] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:25.647853  9963 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.656548  9845 raft_consensus.cc:697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:25.651463  9966 consensus_queue.cc:260] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.657667  9966 raft_consensus.cc:3060] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:25.658221  9963 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.657858  9845 consensus_queue.cc:237] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.662083  1497 catalog_manager.cc:5697] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.665746  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.668200  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.672469  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.673712  1751 raft_consensus.cc:2393] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693257b3078444e0bd26d3e82159d452 in current term 21: Already voted for candidate 1a40ab12c220464db732562e88c32c11 in this term.
I20260709 13:01:25.674885  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:25.680362  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca72d2d43264fe99a56d5f4c01ed5f1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.681762  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.682122  9780 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:01:25.686955  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.686259  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.690095  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:25.690938  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 44683.6us
I20260709 13:01:25.690565  1497 catalog_manager.cc:5697] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 17, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.665746  9963 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.694592  1497 catalog_manager.cc:5697] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.695910  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.694689  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.687809  9780 tablet_bootstrap.cc:492] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:01:25.698261  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.700189  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.698249  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:25.701465  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:25.702517   431 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 1628)
I20260709 13:01:25.701231  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.703753  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.703866  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.715507  9960 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:25.716727  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.722041  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.720382  1497 catalog_manager.cc:5697] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 22 to 23, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.721391  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.725029  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:25.728060  9780 ts_tablet_manager.cc:1403] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 2.080s	user 0.086s	sys 0.022s
I20260709 13:01:25.729569  1497 catalog_manager.cc:5697] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 13 to 18, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.705794  9963 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.745082  9965 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.748874  9965 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:25.738265  9960 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.759142  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.811379  1497 catalog_manager.cc:5697] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 22, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:25.813601  9960 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.815421  9529 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.813335  1497 catalog_manager.cc:5697] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:25.826874  9529 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:25.839792  9877 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.840788  9877 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.858193  9960 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.861121  9963 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.865702  9877 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.869084  9965 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:25.871395  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 223310us
I20260709 13:01:25.885450  9529 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:25.892649  1715 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.907s (SENT)
I20260709 13:01:25.892253  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.894475  9529 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.896370  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.898156  9963 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:25.861284  9780 raft_consensus.cc:359] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 20 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.895020  9529 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.900556  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.879739  9965 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:25.905601  9965 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.901721  9963 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:25.891754  9877 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:25.916160  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.916692  9965 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.917203  9960 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:25.919212  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.921097  9960 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:25.923365  9963 raft_consensus.cc:3060] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:25.924085  9969 log.cc:927] Time spent T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:01:25.931850  9877 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:25.934588  9877 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:25.941807  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.942968  9529 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:25.944610  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 52028.2us
I20260709 13:01:25.945623  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:25.965060  9960 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:25.966316  9960 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:25.972632  9780 raft_consensus.cc:740] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:01:25.973989  9780 consensus_queue.cc:260] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:01:25.959630  1715 leader_election.cc:336] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.933s (SENT)
W20260709 13:01:25.955893  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:25.995785  1752 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:25.996821  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:25.997926  2311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:26.001256  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:26.005620  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.005939  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.007246  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.013147  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.014328  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.017923  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.018244  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.019277  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.025235  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.034763  9973 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.036706  9780 ts_tablet_manager.cc:1434] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.308s	user 0.015s	sys 0.003s
W20260709 13:01:26.037243  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 82039.4us
I20260709 13:01:26.047286  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5b3fd375a24b8cbcadef3f01d01da0" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.047605  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.048480  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:26.050997  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 93997.2us
I20260709 13:01:26.050985  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.051338  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.053023  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.061094  9960 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.061779  9960 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:26.060150  1715 leader_election.cc:336] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Timed out: RequestConsensusVote RPC to 127.0.107.193:37007 timed out after 1.936s (SENT)
I20260709 13:01:26.064293  9960 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:26.069020  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:26.070412  1715 consensus_peers.cc:597] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:26.071383  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:26.072319  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:26.073001  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.045723  9973 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.096391  1566 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.099244  1566 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.107000  9529 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:26.108582  1641 consensus_peers.cc:597] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.109632  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:26.095285  9973 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.113402  9877 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:26.115065  9974 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:26.101583  9966 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.117113  9966 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:26.101538  9960 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.120580  9960 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.121186  9966 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:26.113000  1566 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.122723  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.120990  9963 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:26.123575  9955 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:26.124707  9960 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.101580  9965 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:26.136042  9963 raft_consensus.cc:2749] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:26.138057  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-bbe0e89474f14ac0be0bd7343e0f4601 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:01:26.139626  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-bbe0e89474f14ac0be0bd7343e0f4601 on tablet bbe0e89474f14ac0be0bd7343e0f4601 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:26.145375  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.146533  9973 raft_consensus.cc:493] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:26.150388  9973 raft_consensus.cc:515] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:26.151424  9960 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:01:26.153138  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:26.153292  9973 leader_election.cc:290] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:26.159917  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.133770  9966 raft_consensus.cc:3060] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:26.162459  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.165364  9963 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:26.167214  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.164391  9960 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:26.159461  9973 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:26.171254  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.169560  9960 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:26.162636  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.173800  9960 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:26.174480  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.175388  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.176756  9960 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:26.180538  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.185714  9529 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:26.184450  9960 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:26.191638  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.194999  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.196521  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:26.198045  1743 raft_consensus.cc:1275] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:01:26.200510  1641 consensus_peers.cc:597] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.203238  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.206569  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.203147  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.206606  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.212110  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:26.216970  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.218394  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.179791  9965 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:26.220798  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 55064.5us
I20260709 13:01:26.223081  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a24b102b5d4949a5dd73c9f7d069ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.225169  9845 consensus_queue.cc:1048] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:01:26.236585  9529 raft_consensus.cc:493] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.240806  9529 raft_consensus.cc:515] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:26.247968  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:26.251232  9963 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:26.244032  9529 leader_election.cc:290] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.253480  1566 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:26.254077  9965 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.254441  9529 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:26.257421  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.259223  9966 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:26.267230  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.268339  9966 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:26.272104  9529 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:26.276448  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.278702  1566 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.280592  1566 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.284529  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.286000  9965 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:26.286907  9966 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:01:26.287261  9960 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:01:26.290935  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.294582  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:26.303210  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.287182  9963 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:26.310144  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.312896  9529 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:26.317152  9960 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:26.360425  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.361701  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.365710  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c15f4148e94b83a318e5a513f2f769" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:26.369956  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.376401  1750 raft_consensus.cc:1275] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:26.386998  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.391613  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3d6e391b54e51aa1381c0d66b3edb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.396157  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.397845  1566 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.399403  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.405592  1566 leader_election.cc:304] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:26.408375  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 94416.3us
I20260709 13:01:26.404742  9963 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:01:26.409358  9960 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:26.415043  9966 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.422829  9838 consensus_queue.cc:1048] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:01:26.433007  1566 leader_election.cc:304] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.437412  9529 raft_consensus.cc:2749] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:26.429111  1715 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:26.414746  9965 raft_consensus.cc:2749] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.438086  1566 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:26.440574  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:26.442600  9983 log.cc:927] Time spent T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: Append to log took a long time: real 0.150s	user 0.002s	sys 0.002s
W20260709 13:01:26.442862  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.444366  9529 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:26.432535  9960 raft_consensus.cc:493] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.456643  9960 raft_consensus.cc:515] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.471832  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:26.473002  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.459313  9960 leader_election.cc:290] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:26.474001  1715 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:26.485435  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:26.486903  9951 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:26.489866  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.490442  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa550f278b34a45a3bc714fdc04e95c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.507169  9824 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:26.522655  1566 leader_election.cc:304] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.523828  9960 raft_consensus.cc:2749] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:26.525558  1752 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:26.532013  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.539914  9960 raft_consensus.cc:493] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.540653  9960 raft_consensus.cc:515] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.543159  9960 leader_election.cc:290] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.545857  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.547250  2316 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 20 LEARNER]: Advancing to term 22
W20260709 13:01:26.549546  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:26.552959  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.554176  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8507985adb5b47a187ad9f20a3c73870" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.558130  1566 leader_election.cc:304] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.559173  9960 raft_consensus.cc:2749] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:26.569165  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.605780  2316 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:26.613834  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.637722  9824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38700 (request call id 17) took 8268 ms. Trace:
I20260709 13:01:26.639082  9824 rpcz_store.cc:276] 0709 13:01:18.369701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.375213 (+  5512us) service_pool.cc:224] Handling call
0709 13:01:18.416472 (+ 41259us) log.cc:844] Serialized 506 byte log entry
0709 13:01:18.523440 (+106968us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b1800265000. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f9487268de1 00007f94872755b1 00007f947e31ac0a 00007f9487a5a219 00007f947e3a2a40 00007f947e39d4e4 00007f947e39d455 00007f94813e6b0b 00007f948146bb63 00007f9481493752 00007f9486453d29
0709 13:01:18.583441 (+ 60001us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b54001e7e20. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481406142 00007f94813e6eaa 00007f94813edd53 00007f94813edcd9 00007f94813edc69 00007f94813edc31 00007f94813ecdfd 000000000038f354 000000000038f199 00007f947e3a0475
0709 13:01:26.637560 (+8054119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48623,"raft.queue_time_us":258405,"raft.run_cpu_time_us":4044,"raft.run_wall_time_us":106675,"spinlock_wait_cycles":17069056,"thread_start_us":377216,"threads_started":2}
W20260709 13:01:26.648047  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet 5e60b8714c5d46e8a8676914b0595721: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:26.654281  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet c3c15f4148e94b83a318e5a513f2f769: Illegal state: Request specified cas_config_opid_index of 9 but the committed config has opid_index of 14
I20260709 13:01:26.693284  9824 raft_consensus.cc:1064] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:26.696808  9824 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 15, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:26.703227   431 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 1628)
W20260709 13:01:26.729118  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.763000  9960 raft_consensus.cc:493] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.763677  2316 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:01:26.763814  9960 raft_consensus.cc:515] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.766404  9960 leader_election.cc:290] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.765465  9955 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:01:26.768301  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.771739  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6b8afa01f4aeaacc7cf39d3bdffeb" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.775061  9960 raft_consensus.cc:493] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.775628  1747 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:01:26.775913  9960 raft_consensus.cc:515] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:26.777704  9838 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:26.779281  9960 leader_election.cc:290] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:26.781142  1641 consensus_peers.cc:597] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.795055  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.796368  1566 leader_election.cc:304] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.803249  9960 raft_consensus.cc:2749] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:26.805160  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0193c6e20d1c4a33997d268895b8c083" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:26.819164  1566 leader_election.cc:304] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:26.827104  2279 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 215 similar messages]
I20260709 13:01:26.822494  9965 raft_consensus.cc:2749] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.842592  9845 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 15 to 17, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.853112  2309 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 15 to 17, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.863736  9960 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.864452  9960 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.867432  9965 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.868111  9965 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:26.872005  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.866840  9960 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.882519  9965 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:26.883802  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.895728  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.897820  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:26.902592  9960 raft_consensus.cc:493] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:26.903455  9960 raft_consensus.cc:515] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:26.906041  9960 leader_election.cc:290] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:26.908368  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.909940  9960 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:26.910347  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:26.912945  1501 catalog_manager.cc:5697] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 17 to 18, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.915201  1501 catalog_manager.cc:5697] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.917263  1501 catalog_manager.cc:5697] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.918641  1501 catalog_manager.cc:5697] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 16 to 17, leader changed from 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.931813  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f5002455b4bc4bc385d3b81511511" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:26.947113  1501 catalog_manager.cc:5697] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.953352  1747 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 15 to 17, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.957019  1501 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 9 to 14, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:26.962312  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 217) took 3462 ms. Trace:
I20260709 13:01:26.963590  1501 catalog_manager.cc:5697] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.962801  1497 rpcz_store.cc:276] 0709 13:01:23.500081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.500282 (+   201us) service_pool.cc:224] Handling call
0709 13:01:26.962220 (+3461938us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:26.024206 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:26.024959 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:26.025030 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:01:26.025053 (+    23us) tablet.cc:662] Decoding operations
0709 13:01:26.027217 (+  2164us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:26.027329 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:26.027360 (+    31us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:01:26.211219 (+183859us) tablet.cc:701] Row locks acquired
0709 13:01:26.211273 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:01:26.211532 (+   259us) write_op.cc:270] Start()
0709 13:01:26.211757 (+   225us) write_op.cc:276] Timestamp: P: 1783602086211449 usec, L: 0
0709 13:01:26.211777 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:26.249073 (+ 37296us) log.cc:844] Serialized 10957 byte log entry
0709 13:01:26.371879 (+122806us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b4400022b4c. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f947e228db1 00007f947e2c6c85 00007f947e2c76a2 00007f94810391db 00007f9481034aaf 00007f948102886e 00007f9481027bb6 00007f94810277d8 00007f9481031221 00007f94810311d9 00007f9481031169
0709 13:01:26.564193 (+192314us) op_driver.cc:464] REPLICATION: finished
0709 13:01:26.587269 (+ 23076us) write_op.cc:301] APPLY: starting
0709 13:01:26.587373 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:26.653297 (+ 65924us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:26.653320 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:26.884710 (+231390us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:26.885100 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:01:26.885171 (+    71us) write_op.cc:312] APPLY: finished
0709 13:01:26.885695 (+   524us) log.cc:844] Serialized 236 byte log entry
0709 13:01:26.885905 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:26.886099 (+   194us) write_op.cc:454] Released schema lock
0709 13:01:26.886152 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:26.886618 (+   466us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:26.886669 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":108027,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":22765,"apply.run_cpu_time_us":45866,"apply.run_wall_time_us":299339,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117149,"num_ops":27,"prepare.queue_time_us":35645,"prepare.run_cpu_time_us":11241,"prepare.run_wall_time_us":266007,"raft.queue_time_us":104876,"raft.run_cpu_time_us":3663,"raft.run_wall_time_us":15414,"replication_time_us":352239,"spinlock_wait_cycles":18304384,"thread_start_us":159999,"threads_started":4,"wal-append.queue_time_us":42774}]]}
W20260709 13:01:26.972702  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.943306  1566 leader_election.cc:304] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
W20260709 13:01:26.977246  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:26.977525  9960 raft_consensus.cc:2749] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:26.980284  1566 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:26.990262  9960 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:27.059753  9960 raft_consensus.cc:493] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:27.060388  9960 raft_consensus.cc:515] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:27.062819  9960 leader_election.cc:290] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:27.064359  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:27.088234  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852e1e3fa7a448bf924920b2d2b47558" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:27.096975  1566 leader_election.cc:304] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:27.100710  1501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52332 (request call id 135) took 1849 ms. Trace:
I20260709 13:01:27.104926  9960 raft_consensus.cc:2749] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:27.119576  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:27.095166  1500 catalog_manager.cc:5697] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.123636  1501 rpcz_store.cc:276] 0709 13:01:25.252757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.264815 (+ 12058us) service_pool.cc:224] Handling call
0709 13:01:27.100605 (+1835790us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:26.993673 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:26.994107 (+   434us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:26.994130 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:01:26.994142 (+    12us) tablet.cc:662] Decoding operations
0709 13:01:26.999574 (+  5432us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:26.999662 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:26.999697 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:01:27.000378 (+   681us) tablet.cc:701] Row locks acquired
0709 13:01:27.000399 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:27.000560 (+   161us) write_op.cc:270] Start()
0709 13:01:27.000687 (+   127us) write_op.cc:276] Timestamp: P: 1783602087000510 usec, L: 0
0709 13:01:27.000715 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:01:27.003651 (+  2936us) log.cc:844] Serialized 2898 byte log entry
0709 13:01:27.006007 (+  2356us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b540036d3d4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f6571 00007f9481488e28 00007f9484ec3581 00007f9484ec2d58 00007f9484ec79f1 00007f9484ec79a9 00007f9484ec7939 00007f9484ec7901 00007f9484ec6b2d 000000000038f354 000000000038f199
0709 13:01:27.006262 (+   255us) op_driver.cc:464] REPLICATION: finished
0709 13:01:27.006804 (+   542us) write_op.cc:301] APPLY: starting
0709 13:01:27.006886 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:27.011644 (+  4758us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:27.011675 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:27.016956 (+  5281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:27.017185 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:01:27.017235 (+    50us) write_op.cc:312] APPLY: finished
0709 13:01:27.017535 (+   300us) log.cc:844] Serialized 73 byte log entry
0709 13:01:27.047441 (+ 29906us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:27.047630 (+   189us) write_op.cc:454] Released schema lock
0709 13:01:27.047684 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:27.048127 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:27.048160 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17830,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":11245,"apply.run_wall_time_us":41296,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29302,"num_ops":7,"prepare.queue_time_us":14638,"prepare.run_cpu_time_us":5968,"prepare.run_wall_time_us":12542,"replication_time_us":5324,"spinlock_wait_cycles":5251200,"thread_start_us":14608,"threads_started":1}]]}
I20260709 13:01:27.122913  1500 catalog_manager.cc:5697] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.134052  9960 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.148554  9960 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:27.151080  9960 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:27.153012  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:27.153568  1500 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:27.154842  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:27.157401  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:27.158336  9960 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:27.155259  1500 catalog_manager.cc:5697] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 21 to 23, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.163287  1500 catalog_manager.cc:5697] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.167273  1500 catalog_manager.cc:5697] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 24 to 29, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 29 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:27.180827  1500 catalog_manager.cc:5697] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 20 to 23, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.192375  1500 catalog_manager.cc:5697] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.197408  1500 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 29 to 32, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 32 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:27.199671  1500 catalog_manager.cc:5697] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 25 to 28, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 28 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.202621  1500 catalog_manager.cc:5697] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:27.204756  1500 catalog_manager.cc:5697] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 21 to 24, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 24 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.202937  2309 consensus_queue.cc:237] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:27.208443  1500 catalog_manager.cc:5697] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.211016  1500 catalog_manager.cc:5697] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 22 to 25, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 25 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.213110  1500 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 17 to 19, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to 693257b3078444e0bd26d3e82159d452 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "693257b3078444e0bd26d3e82159d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } }
I20260709 13:01:27.264508  1747 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:01:27.267691  1671 raft_consensus.cc:1275] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Refusing update from remote peer 570958eb733a4af7ae16ae020998c8b4: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:01:27.297402  9995 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:27.300397  9975 consensus_queue.cc:1048] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:27.340773  9678 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 16 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:27.342736  1678 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 16 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:27.354635  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:27.371331  9960 raft_consensus.cc:493] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.372113  9960 raft_consensus.cc:515] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:27.374866  9960 leader_election.cc:290] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:27.378001  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:27.392987  1744 raft_consensus.cc:2955] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 16 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:27.397130  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e209bb7f848ca8067e613c9ef43a1" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:27.400377  1566 leader_election.cc:304] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:27.401587  9960 raft_consensus.cc:2749] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:01:27.402293  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:27.412830  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c468e528ecc447f9d2154d473a93b16 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.446205  9960 raft_consensus.cc:493] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.448130  9960 raft_consensus.cc:515] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:27.450544  9960 leader_election.cc:290] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:27.452011  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:27.452096  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077713cf7fff4fb39be348e99943d26f" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:27.461762  1566 leader_election.cc:304] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:27.460942  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index -1 to 17, term changed from 20 to 22, VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added, no longer has a pending config: VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193), VOTER 1a40ab12c220464db732562e88c32c11 (127.0.107.194), VOTER fab19506de7242869c29d70c9fffb739 (127.0.107.195), NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196). New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:27.463690  9960 raft_consensus.cc:2749] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:27.484988  9960 raft_consensus.cc:493] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:27.486006  9960 raft_consensus.cc:515] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:27.489501  9960 leader_election.cc:290] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:27.495088  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:27.507936  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29da50f1424c238eee239d451aab3c" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:27.510322  1566 leader_election.cc:304] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:27.511314  9960 raft_consensus.cc:2749] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:27.570376  1501 catalog_manager.cc:5697] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 16 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 23 leader_uuid: "570958eb733a4af7ae16ae020998c8b4" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:27.569290  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:27.587396  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:27.602953  9960 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.606575  1500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56644 (request call id 237) took 1716 ms. Trace:
I20260709 13:01:27.607215  9960 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:27.607126  1500 rpcz_store.cc:276] 0709 13:01:25.890022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.897810 (+  7788us) service_pool.cc:224] Handling call
0709 13:01:27.606497 (+1708687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:27.238882 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:27.239497 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:27.239575 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:01:27.239596 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:27.240981 (+  1385us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:27.241046 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:27.241081 (+    35us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:27.242313 (+  1232us) tablet.cc:701] Row locks acquired
0709 13:01:27.242329 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:01:27.244215 (+  1886us) write_op.cc:270] Start()
0709 13:01:27.244351 (+   136us) write_op.cc:276] Timestamp: P: 1783602087244159 usec, L: 0
0709 13:01:27.244371 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:27.245873 (+  1502us) log.cc:844] Serialized 6032 byte log entry
0709 13:01:27.250147 (+  4274us) op_driver.cc:464] REPLICATION: finished
0709 13:01:27.250520 (+   373us) write_op.cc:301] APPLY: starting
0709 13:01:27.250626 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:27.306451 (+ 55825us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:27.306576 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:27.449043 (+142467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:27.449777 (+   734us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:01:27.449825 (+    48us) write_op.cc:312] APPLY: finished
0709 13:01:27.450489 (+   664us) log.cc:844] Serialized 139 byte log entry
0709 13:01:27.451984 (+  1495us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:27.452196 (+   212us) write_op.cc:454] Released schema lock
0709 13:01:27.452284 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:27.457458 (+  5174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:27.457498 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":221,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":23735,"apply.run_wall_time_us":206852,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62790,"num_ops":15,"prepare.queue_time_us":281,"prepare.run_cpu_time_us":5354,"prepare.run_wall_time_us":13443,"replication_time_us":5630,"spinlock_wait_cycles":24320}]]}
I20260709 13:01:27.618629  9960 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:27.620687  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:27.622481  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd71f19da3340e6aae32a3f83215159" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:27.625326  1566 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:27.626942  9960 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:27.638767  9960 raft_consensus.cc:493] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.639500  9960 raft_consensus.cc:515] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:27.643347  9960 leader_election.cc:290] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:27.657347  1497 catalog_manager.cc:5697] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 22, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.665652  1497 catalog_manager.cc:5697] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 18 to 21, leader changed from fab19506de7242869c29d70c9fffb739 (127.0.107.195) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.678689  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:27.678717  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ec86569a4e46149249e63cfbd61fa4" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:27.688189  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 82763.6us
W20260709 13:01:27.690184  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 69464.2us
I20260709 13:01:27.695247  1566 leader_election.cc:304] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:27.704032   431 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 1628)
I20260709 13:01:27.698975  9960 raft_consensus.cc:2749] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:27.785828  1496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56632 (request call id 196) took 7177 ms. Trace:
I20260709 13:01:27.786516  1496 rpcz_store.cc:276] 0709 13:01:20.608134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.608524 (+   390us) service_pool.cc:224] Handling call
0709 13:01:27.712368 (+7103844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72333,"reported_tablets":41}
I20260709 13:01:27.811259  9960 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.840444  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c468e528ecc447f9d2154d473a93b16: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:01:27.842145  1744 consensus_queue.cc:237] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:27.828632  9960 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:27.964090   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:27.988124  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 56374.2us
I20260709 13:01:28.028165  9960 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.028505 10024 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.029114  9960 raft_consensus.cc:493] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.041229  9960 raft_consensus.cc:515] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.042703 10011 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:28.029349 10024 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.077626  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.083031 10032 raft_consensus.cc:493] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.083858 10032 raft_consensus.cc:515] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.086328 10020 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.087438   431 tablet_replica.cc:333] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.089373 10024 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.089664   431 raft_consensus.cc:2243] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.090574   431 raft_consensus.cc:2272] T bbe0e89474f14ac0be0bd7343e0f4601 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.087097 10020 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:28.094844 10019 log.cc:927] Time spent T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 13:01:28.095350 10020 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.097688  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.102200  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.102694   431 tablet_replica.cc:333] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.104302   431 raft_consensus.cc:2243] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.105333   431 raft_consensus.cc:2272] T e85f5002455b4bc4bc385d3b81511511 P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.075469 10011 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.108258 10011 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:28.110453   431 tablet_replica.cc:333] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.119249  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.120513  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516703d5c9f14537854665616191b5aa" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:28.143268  1566 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.165405   431 raft_consensus.cc:2243] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:28.169817  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 53161.4us
I20260709 13:01:28.171619   431 raft_consensus.cc:2272] T 077713cf7fff4fb39be348e99943d26f P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.156068 10011 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:28.175868  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 171988us
I20260709 13:01:28.179247 10032 leader_election.cc:290] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.179757   431 tablet_replica.cc:333] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.185185  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.190300 10034 raft_consensus.cc:493] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.196074  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.162354 10020 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.197326  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.199487 10020 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.200542   431 raft_consensus.cc:2243] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.202188 10020 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.205506 10034 raft_consensus.cc:515] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.208122 10034 leader_election.cc:290] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:28.168016 10024 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.211485  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:28.211242 10024 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.214555 10024 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:28.217648  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:28.219606   431 raft_consensus.cc:2272] T a9a24b102b5d4949a5dd73c9f7d069ad P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.223124   431 tablet_replica.cc:333] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.225062   431 raft_consensus.cc:2243] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.225979   431 raft_consensus.cc:2272] T 0193c6e20d1c4a33997d268895b8c083 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.229343   431 tablet_replica.cc:333] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.230795  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.232040  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.197252  9960 leader_election.cc:290] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.235446  2309 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:28.239094   431 raft_consensus.cc:2243] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.245685   431 pending_rounds.cc:70] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:28.257962  1678 raft_consensus.cc:1275] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:28.257680  9943 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:28.269923  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d13a42db4a4920828af42492055735" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.271492  1566 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.272595  9960 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:28.272480  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6af13b3ef4faca52c6c12ac945d51" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.273397 10024 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.273970 10024 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.274386  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c13780577e4e7f939bed39d7e72045" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.275075  1669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.275890  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d41e7558f84fa1b99e709cb935e448" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.275965  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5eeee076cc0489bb6f13e55dbc52d06" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.247176   431 pending_rounds.cc:77] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305634100849020928 op_type: NO_OP noop_request { }
I20260709 13:01:28.280004   431 raft_consensus.cc:2889] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.280535   431 raft_consensus.cc:2272] T 813e209bb7f848ca8067e613c9ef43a1 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.281499  9960 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.282106  9960 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.282618 10024 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.283636  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24407d61d8d743c58663bb69b069d26e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.284376   431 tablet_replica.cc:333] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.284704  9960 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.285189  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.296986  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.298007 10036 consensus_queue.cc:1048] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:28.301115  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:28.303476  1718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.304895  9960 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.305629  9960 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.309499  9960 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.326525  1743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.327607  1566 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:28.328703  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.330248  9960 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:28.332154  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.332499  1566 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:28.332973  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.337965   431 raft_consensus.cc:2243] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.339864  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.341517  1671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.343029  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.344714  9960 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:01:28.346155  9943 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:28.348767  1497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56640 (request call id 218) took 1153 ms. Trace:
I20260709 13:01:28.357753  2309 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:28.368777   431 pending_rounds.cc:70] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:28.369355   431 pending_rounds.cc:77] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 10 index: 10 } timestamp: 7305634101477695488 op_type: NO_OP noop_request { }
I20260709 13:01:28.369829   431 raft_consensus.cc:2889] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.380107   431 raft_consensus.cc:2272] T 852e1e3fa7a448bf924920b2d2b47558 P 693257b3078444e0bd26d3e82159d452 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:28.382277  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49966.3us
I20260709 13:01:28.384303   431 tablet_replica.cc:333] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.398878  9960 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.399348 10024 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.349244  1497 rpcz_store.cc:276] 0709 13:01:27.196426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.197400 (+   974us) service_pool.cc:224] Handling call
0709 13:01:28.348695 (+1151295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:27.702252 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:27.712867 (+ 10615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:27.712907 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:01:27.712929 (+    22us) tablet.cc:662] Decoding operations
0709 13:01:27.794469 (+ 81540us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:27.811772 (+ 17303us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:27.812730 (+   958us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:27.835883 (+ 23153us) tablet.cc:701] Row locks acquired
0709 13:01:27.838184 (+  2301us) write_op.cc:260] PREPARE: finished
0709 13:01:27.855783 (+ 17599us) write_op.cc:270] Start()
0709 13:01:27.855980 (+   197us) write_op.cc:276] Timestamp: P: 1783602087855712 usec, L: 0
0709 13:01:27.856023 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:01:27.856919 (+   896us) log.cc:844] Serialized 929 byte log entry
0709 13:01:28.035390 (+178471us) op_driver.cc:464] REPLICATION: finished
0709 13:01:28.068498 (+ 33108us) write_op.cc:301] APPLY: starting
0709 13:01:28.070506 (+  2008us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:28.105111 (+ 34605us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:28.105222 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:28.106652 (+  1430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:28.106853 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:01:28.106904 (+    51us) write_op.cc:312] APPLY: finished
0709 13:01:28.107145 (+   241us) log.cc:844] Serialized 33 byte log entry
0709 13:01:28.108260 (+  1115us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:28.108381 (+   121us) write_op.cc:454] Released schema lock
0709 13:01:28.108435 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:28.111792 (+  3357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:28.111825 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40662,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":19334,"apply.run_cpu_time_us":4822,"apply.run_wall_time_us":45012,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":11863,"prepare.run_wall_time_us":163427,"replication_time_us":154360,"spinlock_wait_cycles":2304}]]}
I20260709 13:01:28.509773 10034 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:28.528043  9960 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.528636 10024 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.528792 10034 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.530454   431 raft_consensus.cc:2243] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.531106  9960 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.531350 10024 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:28.531702 10034 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:28.532655  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 103561us
I20260709 13:01:28.531358   431 pending_rounds.cc:70] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
W20260709 13:01:28.527206  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.535390   431 pending_rounds.cc:77] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305634102263013376 op_type: NO_OP noop_request { }
I20260709 13:01:28.535982   431 raft_consensus.cc:2889] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.538424  1497 catalog_manager.cc:5697] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 14 to 15, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:28.536477   431 raft_consensus.cc:2272] T 516703d5c9f14537854665616191b5aa P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.561852  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3c15f4148e94b83a318e5a513f2f769 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:28.573412  1566 leader_election.cc:304] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.552678  1676 raft_consensus.cc:2955] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:28.589776   431 tablet_replica.cc:333] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
W20260709 13:01:28.590649  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:28.591495   431 raft_consensus.cc:2243] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.592489   431 raft_consensus.cc:2272] T caa550f278b34a45a3bc714fdc04e95c P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.582849  1566 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.576524 10034 raft_consensus.cc:2749] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:28.613716  1673 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.610610 10024 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:28.625811  1566 leader_election.cc:304] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:28.610929  9960 raft_consensus.cc:493] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.619916 10011 raft_consensus.cc:493] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.632681 10011 raft_consensus.cc:515] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.648025  1566 leader_election.cc:304] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.629122 10034 raft_consensus.cc:2749] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:28.645718  9960 raft_consensus.cc:515] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.659039  9960 leader_election.cc:290] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:28.635332 10011 leader_election.cc:290] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.683034   431 tablet_replica.cc:333] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
W20260709 13:01:28.684515  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:28.685752  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:28.684559   431 raft_consensus.cc:2243] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:28.701720  1566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53834us
I20260709 13:01:28.703752  1566 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.702382 10034 raft_consensus.cc:2749] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:28.709180  1566 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.710264   431 raft_consensus.cc:2272] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.701081 10011 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.713961  1566 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.710857  9960 raft_consensus.cc:2749] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:28.713703 10024 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:01:28.719627  9960 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:28.719266  1566 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.724197 10020 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:28.739449  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.727291 10011 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:28.744786  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:28.751792  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.738986  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:28.754079  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f356989b6064ce99355e7583b2314ec" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.754386  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.756182 10011 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.758248   431 tablet_replica.cc:333] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.759755   431 raft_consensus.cc:2243] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.767313   431 pending_rounds.cc:70] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Trying to abort 2 pending ops.
I20260709 13:01:28.770139   431 pending_rounds.cc:77] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 22 index: 12 } timestamp: 7305634106886717440 op_type: NO_OP noop_request { }
W20260709 13:01:28.767762  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.773675  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:28.735677  2309 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:01:28.777570   431 raft_consensus.cc:2889] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.778002   431 pending_rounds.cc:77] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 20 index: 11 } timestamp: 7305634045528420352 op_type: NO_OP noop_request { }
I20260709 13:01:28.778416   431 raft_consensus.cc:2889] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.778765   431 raft_consensus.cc:2272] T 24407d61d8d743c58663bb69b069d26e P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.782749  9960 raft_consensus.cc:493] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.771050  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.783375  9960 raft_consensus.cc:515] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.771921  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.772017  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc4812cc534228899ce2b7b14d2237" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.785804  9960 leader_election.cc:290] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.786458  9960 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.786974  9960 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.789544  9960 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.735380  1747 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:01:28.795763  9960 raft_consensus.cc:493] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.796617  9960 raft_consensus.cc:515] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:28.799525  9960 leader_election.cc:290] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:28.799726   431 tablet_replica.cc:333] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.803841   431 raft_consensus.cc:2243] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.804949   431 raft_consensus.cc:2272] T 8507985adb5b47a187ad9f20a3c73870 P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:28.800349  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:28.809507  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3690a974c249a88aaacf8c89e51b93" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.810402  9824 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:28.812608 10018 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:01:28.836581   431 tablet_replica.cc:333] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:28.839048   431 raft_consensus.cc:2243] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.855646  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.857542   431 pending_rounds.cc:70] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:28.858060   431 pending_rounds.cc:77] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305634086794924032 op_type: NO_OP noop_request { }
I20260709 13:01:28.864596   431 raft_consensus.cc:2889] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.863979  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.862303  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27da507a1bb04525952847c678820e4e" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.890729  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.893767   431 raft_consensus.cc:2272] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.898907  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:28.902056  9960 raft_consensus.cc:493] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.904520  9960 raft_consensus.cc:515] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.906965  9960 leader_election.cc:290] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:28.902240  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:28.909229  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.908212 10013 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Committing config change with OpId 22.18: config changed from index 17 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:28.909920  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:28.910627  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.913435  9960 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.914405  9960 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.915325 10011 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.915916 10011 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:28.916936  9960 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.918277 10011 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:28.919952  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a777ed30740c3a60219dad4a4a6ad" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.925561  1566 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:28.898754  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7ba20be4524b828e4259656531c103" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.927268  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60f7d5f008b4c6f8ee8b707a5916f7d" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.922914   431 tablet_replica.cc:333] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
W20260709 13:01:28.932475  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.942252  1566 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:28.943104  1566 raft_consensus.cc:2686] T 8f356989b6064ce99355e7583b2314ec P 693257b3078444e0bd26d3e82159d452: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:01:28.933979   431 raft_consensus.cc:2243] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.933326  1749 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Committing config change with OpId 22.18: config changed from index 17 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:28.935398 10011 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:28.944134   431 pending_rounds.cc:70] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:28.944448   431 pending_rounds.cc:77] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305634125720539136 op_type: NO_OP noop_request { }
I20260709 13:01:28.944873   431 raft_consensus.cc:2889] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:28.945247   431 raft_consensus.cc:2272] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.946323  1566 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.950451 10011 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:01:28.952222  1566 leader_election.cc:304] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.953512 10011 raft_consensus.cc:2749] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:28.953827  2309 raft_consensus.cc:2955] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Committing config change with OpId 22.18: config changed from index 17 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:28.957639  1566 leader_election.cc:304] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
W20260709 13:01:28.958458  1566 raft_consensus.cc:2686] T 6a3690a974c249a88aaacf8c89e51b93 P 693257b3078444e0bd26d3e82159d452: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:01:28.960005  1566 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.963775 10011 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:28.968097  1566 leader_election.cc:304] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.971936 10011 raft_consensus.cc:2749] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:28.975023  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.976502  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.976869  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69370730433544db93e2c777aba2b9b2" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:28.980010  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88aab1e8ec54d79b537a6d2dfbacdac" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:28.995330  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:28.996191  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:28.999612  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 17 to 18, VOTER 693257b3078444e0bd26d3e82159d452 (127.0.107.193) evicted. New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:29.004428  1566 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:28.977308   431 tablet_replica.cc:333] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.015592   431 raft_consensus.cc:2243] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.016523  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c6eb4be18b446b8252b29274f2b941" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:29.022921  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:29.024259  1566 leader_election.cc:304] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.024892 10011 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:29.030222   431 raft_consensus.cc:2272] T 15c13780577e4e7f939bed39d7e72045 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.031697 10011 raft_consensus.cc:2749] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:29.035426  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.036650  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.037433  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.041347   431 tablet_replica.cc:333] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
W20260709 13:01:29.043119  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.044416  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.045157  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.049674  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.050597  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.051115  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.053637  1566 leader_election.cc:304] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.056794 10011 raft_consensus.cc:2749] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:29.058394  1566 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.059333   431 raft_consensus.cc:2243] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.061844  1485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbe0e89474f14ac0be0bd7343e0f4601 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:29.062520 10011 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:29.063660   431 pending_rounds.cc:70] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Trying to abort 3 pending ops.
I20260709 13:01:29.064035   431 pending_rounds.cc:77] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 28 index: 15 } timestamp: 7305634120800219136 op_type: NO_OP noop_request { }
I20260709 13:01:29.064550   431 raft_consensus.cc:2889] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.064865   431 pending_rounds.cc:77] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 26 index: 14 } timestamp: 7305634071065907200 op_type: NO_OP noop_request { }
I20260709 13:01:29.065196   431 raft_consensus.cc:2889] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.065485   431 pending_rounds.cc:77] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 24 index: 13 } timestamp: 7305634038125121536 op_type: NO_OP noop_request { }
I20260709 13:01:29.065769   431 raft_consensus.cc:2889] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.066111   431 raft_consensus.cc:2272] T 57f6af13b3ef4faca52c6c12ac945d51 P 693257b3078444e0bd26d3e82159d452 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.070241   431 tablet_replica.cc:333] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.071496   431 raft_consensus.cc:2243] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.072657   431 pending_rounds.cc:70] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Trying to abort 2 pending ops.
I20260709 13:01:29.072942   431 pending_rounds.cc:77] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305634104356732928 op_type: NO_OP noop_request { }
I20260709 13:01:29.073351   431 raft_consensus.cc:2889] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.073709   431 pending_rounds.cc:77] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 11 index: 11 } timestamp: 7305634070615121920 op_type: NO_OP noop_request { }
I20260709 13:01:29.074060   431 raft_consensus.cc:2889] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.074406   431 raft_consensus.cc:2272] T 51d41e7558f84fa1b99e709cb935e448 P 693257b3078444e0bd26d3e82159d452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.076349  1566 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.077353 10011 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:29.081526  1490 maintenance_manager.cc:419] P de45a76180d64c6884c212bcc9eaa1c0: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033344
W20260709 13:01:29.087273  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c3c15f4148e94b83a318e5a513f2f769: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:01:29.088404 10011 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.089049 10011 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:29.091581 10011 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:29.105762  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:29.110060  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:29.115134  1566 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:29.119165 10011 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:29.121834   431 tablet_replica.cc:333] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.127478   431 raft_consensus.cc:2243] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.128556   431 raft_consensus.cc:2272] T ff5b3fd375a24b8cbcadef3f01d01da0 P 693257b3078444e0bd26d3e82159d452 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.145670   431 tablet_replica.cc:333] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.152822   431 raft_consensus.cc:2243] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:29.154431  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:29.159433   431 raft_consensus.cc:2272] T 86ec86569a4e46149249e63cfbd61fa4 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.164948  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.169476  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.181828   431 tablet_replica.cc:333] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.183447   431 raft_consensus.cc:2243] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.184962   431 raft_consensus.cc:2272] T 5e60b8714c5d46e8a8676914b0595721 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.187426  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:29.189359   431 tablet_replica.cc:333] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.192507   431 raft_consensus.cc:2243] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.194795   431 pending_rounds.cc:70] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:29.195194   431 pending_rounds.cc:77] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305634103370641408 op_type: NO_OP noop_request { }
I20260709 13:01:29.195812   431 raft_consensus.cc:2889] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.196264   431 raft_consensus.cc:2272] T 3eaa544af67a451a8d99cb7cc0f7e452 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.199713   431 tablet_replica.cc:333] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.200752   431 raft_consensus.cc:2243] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.201829   431 raft_consensus.cc:2272] T c3c15f4148e94b83a318e5a513f2f769 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.204942  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.205503 10011 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:29.206182 10011 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:29.211989 10011 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:29.214727  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:29.215024  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:29.216238  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:29.221369  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.221426  1566 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:29.223758  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.222807 10011 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:29.227789  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.228642  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.237861   431 tablet_replica.cc:333] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.241423   431 raft_consensus.cc:2243] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.249495 10011 raft_consensus.cc:493] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.250170 10011 raft_consensus.cc:515] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:29.253070 10011 leader_election.cc:290] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:29.253099   431 raft_consensus.cc:2272] T 27da507a1bb04525952847c678820e4e P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.257876   431 tablet_replica.cc:333] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.257678  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:29.259127   431 raft_consensus.cc:2243] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.260313   431 raft_consensus.cc:2272] T 5f4a777ed30740c3a60219dad4a4a6ad P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.260663  2316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8de6698b474b218d672997f3c708e3" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:29.265017   431 tablet_replica.cc:333] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.266268   431 raft_consensus.cc:2243] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.271525  1566 leader_election.cc:304] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.273011 10011 raft_consensus.cc:2749] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:29.267793   431 raft_consensus.cc:2272] T 583de7d6884c4f96b1f47ff7066c2da9 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.281000  1489 maintenance_manager.cc:643] P de45a76180d64c6884c212bcc9eaa1c0: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.198s	user 0.056s	sys 0.000s Metrics: {"bytes_written":9387,"delete_count":0,"lbm_write_time_us":1429,"lbm_writes_lt_1ms":8,"reinsert_count":0,"update_count":386}
I20260709 13:01:29.283320  1490 maintenance_manager.cc:419] P de45a76180d64c6884c212bcc9eaa1c0: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.432742
I20260709 13:01:29.290556   431 tablet_replica.cc:333] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.292007   431 raft_consensus.cc:2243] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.292914   431 raft_consensus.cc:2272] T a5eeee076cc0489bb6f13e55dbc52d06 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.297986   431 tablet_replica.cc:333] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.299121   431 raft_consensus.cc:2243] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.299952   431 raft_consensus.cc:2272] T 33f3320caa9849f893ce5125d17a0d48 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.303326   431 tablet_replica.cc:333] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.304353 10011 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:29.305002 10011 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:29.306377   431 raft_consensus.cc:2243] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.307688   431 raft_consensus.cc:2272] T bc29da50f1424c238eee239d451aab3c P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.310726  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:29.316174 10011 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:29.318874  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8238df60414b3d8b25f82937649e9a" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:29.322477  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:29.322360  1566 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.323596 10011 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:29.330549   431 tablet_replica.cc:333] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.331761   431 raft_consensus.cc:2243] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.332542   431 pending_rounds.cc:70] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:29.332828   431 pending_rounds.cc:77] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 19 index: 13 } timestamp: 7305634084937281536 op_type: NO_OP noop_request { }
I20260709 13:01:29.333222   431 raft_consensus.cc:2889] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.333566   431 raft_consensus.cc:2272] T a60f7d5f008b4c6f8ee8b707a5916f7d P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.336867   431 tablet_replica.cc:333] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.337947   431 raft_consensus.cc:2243] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.339187   431 raft_consensus.cc:2272] T fcd92efcb3084fe59e6f16a5467bcd9e P 693257b3078444e0bd26d3e82159d452 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.354210   431 tablet_replica.cc:333] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.355288   431 raft_consensus.cc:2243] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.356038   431 pending_rounds.cc:70] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Trying to abort 2 pending ops.
I20260709 13:01:29.356312   431 pending_rounds.cc:77] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 23 index: 13 } timestamp: 7305634091952504832 op_type: NO_OP noop_request { }
I20260709 13:01:29.356709   431 raft_consensus.cc:2889] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.357069   431 pending_rounds.cc:77] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 22 index: 12 } timestamp: 7305634071167152128 op_type: NO_OP noop_request { }
I20260709 13:01:29.357412   431 raft_consensus.cc:2889] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.363628   431 raft_consensus.cc:2272] T acc3d6e391b54e51aa1381c0d66b3edb P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.366173  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:29.367329   431 tablet_replica.cc:333] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.368466   431 raft_consensus.cc:2243] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.369187   431 raft_consensus.cc:2272] T 03d13a42db4a4920828af42492055735 P 693257b3078444e0bd26d3e82159d452 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.372666   431 tablet_replica.cc:333] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.373714   431 raft_consensus.cc:2243] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.374541   431 pending_rounds.cc:70] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Trying to abort 3 pending ops.
I20260709 13:01:29.374801   431 pending_rounds.cc:77] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 18 index: 9 } timestamp: 7305634080378187776 op_type: NO_OP noop_request { }
I20260709 13:01:29.375213   431 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.375586   431 pending_rounds.cc:77] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 16 index: 8 } timestamp: 7305634044905074688 op_type: NO_OP noop_request { }
I20260709 13:01:29.376001   431 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.376364   431 pending_rounds.cc:77] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 14 index: 7 } timestamp: 7305633969556611072 op_type: NO_OP noop_request { }
I20260709 13:01:29.376889   431 raft_consensus.cc:2889] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.377290   431 raft_consensus.cc:2272] T 8a8238df60414b3d8b25f82937649e9a P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.397557   431 tablet_replica.cc:333] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.398651   431 raft_consensus.cc:2243] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.399751   431 raft_consensus.cc:2272] T 46080b3c17204e34b7cfa66296431876 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.412207   431 tablet_replica.cc:333] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.420174   431 raft_consensus.cc:2243] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.421047   431 raft_consensus.cc:2272] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 693257b3078444e0bd26d3e82159d452 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.428107   431 tablet_replica.cc:333] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.429155   431 raft_consensus.cc:2243] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.430099   431 raft_consensus.cc:2272] T 69370730433544db93e2c777aba2b9b2 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.440050   431 tablet_replica.cc:333] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.441049   431 raft_consensus.cc:2243] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.441679   431 pending_rounds.cc:70] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:29.441892   431 pending_rounds.cc:77] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7305634135221207040 op_type: NO_OP noop_request { }
I20260709 13:01:29.442239   431 raft_consensus.cc:2889] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.442591   431 raft_consensus.cc:2272] T e88aab1e8ec54d79b537a6d2dfbacdac P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.449229   431 tablet_replica.cc:333] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.450335   431 raft_consensus.cc:2243] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.451426   431 raft_consensus.cc:2272] T 3d7ba20be4524b828e4259656531c103 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.456065   431 tablet_replica.cc:333] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.457183   431 raft_consensus.cc:2243] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.458540   431 raft_consensus.cc:2272] T 75dc4812cc534228899ce2b7b14d2237 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.467469  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.469897   431 tablet_replica.cc:333] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.474706   431 raft_consensus.cc:2243] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.475989   431 raft_consensus.cc:2272] T 3f8de6698b474b218d672997f3c708e3 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.485417   431 tablet_replica.cc:333] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.486488   431 raft_consensus.cc:2243] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.487110   431 pending_rounds.cc:70] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:29.487380   431 pending_rounds.cc:77] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 31 index: 18 } timestamp: 7305634123129184256 op_type: NO_OP noop_request { }
I20260709 13:01:29.487820   431 raft_consensus.cc:2889] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.488242   431 raft_consensus.cc:2272] T 88f288076c934a55b8d0dfe7855d4db9 P 693257b3078444e0bd26d3e82159d452 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.492612   431 tablet_replica.cc:333] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.498943   431 raft_consensus.cc:2243] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.500108   431 raft_consensus.cc:2272] T 32a3fe9094ec43a1a21a897a8aa2513d P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.511988   431 tablet_replica.cc:333] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.518092   431 raft_consensus.cc:2243] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.531996   431 pending_rounds.cc:70] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:29.532366   431 pending_rounds.cc:77] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 21 index: 11 } timestamp: 7305633987174309888 op_type: NO_OP noop_request { }
I20260709 13:01:29.532775   431 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.533172   431 raft_consensus.cc:2272] T d53e959bd0a14b21aa72696bbf6d090d P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.536690   431 tablet_replica.cc:333] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.537684   431 raft_consensus.cc:2243] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.538378   431 raft_consensus.cc:2272] T 6f7e0c6a13bf4ad685049c44899c240e P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.541421   431 tablet_replica.cc:333] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.542687   431 raft_consensus.cc:2243] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.543623 10011 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.543679   431 raft_consensus.cc:2272] T 6cd71f19da3340e6aae32a3f83215159 P 693257b3078444e0bd26d3e82159d452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.544261 10011 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:01:29.546654 10011 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:29.549512  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:29.551024  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae709ecc740b452bbba5c6360b053347" candidate_uuid: "693257b3078444e0bd26d3e82159d452" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:29.552073   431 tablet_replica.cc:333] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.553085  1566 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693257b3078444e0bd26d3e82159d452; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:29.554688 10011 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:29.553038   431 raft_consensus.cc:2243] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.573797   431 pending_rounds.cc:70] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Trying to abort 2 pending ops.
I20260709 13:01:29.574254   431 pending_rounds.cc:77] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305634044612050944 op_type: NO_OP noop_request { }
I20260709 13:01:29.574754   431 raft_consensus.cc:2889] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.575227   431 pending_rounds.cc:77] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 20 index: 15 } timestamp: 7305634001491259392 op_type: NO_OP noop_request { }
I20260709 13:01:29.575646   431 raft_consensus.cc:2889] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.576141   431 raft_consensus.cc:2272] T 1c1cbc949b954ba587e016d3b0db3715 P 693257b3078444e0bd26d3e82159d452 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.629254   431 tablet_replica.cc:333] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.630185   431 raft_consensus.cc:2243] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.630896   431 raft_consensus.cc:2272] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 693257b3078444e0bd26d3e82159d452 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.635124   431 tablet_replica.cc:333] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.636003   431 raft_consensus.cc:2243] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.636976   431 pending_rounds.cc:70] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
W20260709 13:01:29.643203  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.644330   431 pending_rounds.cc:77] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 23 index: 17 } timestamp: 7305634099749974016 op_type: NO_OP noop_request { }
I20260709 13:01:29.644842   431 raft_consensus.cc:2889] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.645227   431 raft_consensus.cc:2272] T 3c468e528ecc447f9d2154d473a93b16 P 693257b3078444e0bd26d3e82159d452 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.648375   431 tablet_replica.cc:333] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.653105   431 raft_consensus.cc:2243] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.663064   431 raft_consensus.cc:2272] T c8ce4edad7b14292b8c162db2d204922 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.680649   431 tablet_replica.cc:333] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.681963   431 raft_consensus.cc:2243] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.682682   431 raft_consensus.cc:2272] T 979e85778d254fc7a74198c589e12967 P 693257b3078444e0bd26d3e82159d452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.702529   431 tablet_replica.cc:333] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.709992   431 raft_consensus.cc:2243] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.729542   431 pending_rounds.cc:70] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Trying to abort 1 pending ops.
I20260709 13:01:29.729871   431 pending_rounds.cc:77] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452: Aborting op as it isn't in flight: id { term: 27 index: 17 } timestamp: 7305634125767839744 op_type: NO_OP noop_request { }
I20260709 13:01:29.733349   431 raft_consensus.cc:2889] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:29.733786   431 raft_consensus.cc:2272] T e922046ac7c0490f8b70ef22b66bfc6b P 693257b3078444e0bd26d3e82159d452 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.737026   431 tablet_replica.cc:333] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.737912   431 raft_consensus.cc:2243] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.738804   431 raft_consensus.cc:2272] T c1c6eb4be18b446b8252b29274f2b941 P 693257b3078444e0bd26d3e82159d452 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.767409   431 tablet_replica.cc:333] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452: stopping tablet replica
I20260709 13:01:29.773830   431 raft_consensus.cc:2243] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.774863   431 raft_consensus.cc:2272] T ae709ecc740b452bbba5c6360b053347 P 693257b3078444e0bd26d3e82159d452 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.773706  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:29.795836  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:29.811744  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:29.830917  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:29.898082  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.916070  1489 maintenance_manager.cc:643] P de45a76180d64c6884c212bcc9eaa1c0: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.630s	user 0.138s	sys 0.028s Metrics: {"cfile_cache_miss":11,"cfile_cache_miss_bytes":30370,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":16716,"lbm_read_time_us":28828,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":25,"lbm_write_time_us":3731,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":12,"peak_mem_usage":605478,"reinsert_count":0,"thread_start_us":16092,"threads_started":2,"update_count":391}
I20260709 13:01:29.919610  1490 maintenance_manager.cc:419] P de45a76180d64c6884c212bcc9eaa1c0: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:01:29.940464  1489 maintenance_manager.cc:643] P de45a76180d64c6884c212bcc9eaa1c0: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:01:30.132004  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 46157.6us
W20260709 13:01:30.285022  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bbe0e89474f14ac0be0bd7343e0f4601: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:01:30.287210  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 134054us
I20260709 13:01:30.368063 10067 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:30.369666 10067 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:30.373215 10067 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:30.383814  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 76114.2us
W20260709 13:01:30.390239  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 62963.6us
I20260709 13:01:30.407050  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
W20260709 13:01:30.500768  1715 connection.cc:769] client connection to 127.0.107.193:37007 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:01:30.502311  2279 connection.cc:769] client connection to 127.0.107.193:37007 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:01:30.520254  1715 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:01:30.520988  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:30.523941 10063 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:30.546716 10018 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:30.547431 10018 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:30.550034 10018 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:30.545406 10067 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:30.550990 10067 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:30.553282 10067 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:30.564617  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1a40ab12c220464db732562e88c32c11" is_pre_election: true
I20260709 13:01:30.566255  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:30.567106  1747 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
W20260709 13:01:30.580034  1549 auto_rebalancer.cc:629] Failed to schedule move for tablet fcd92efcb3084fe59e6f16a5467bcd9e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:30.583141  1715 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:30.583966  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:30.585034 10056 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:30.586849  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:30.587225  1672 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 32.18, Last appended by leader: 18, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:30.593803 10071 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:30.594537 10071 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:30.595309 10071 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:30.607481 10071 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:30.610067 10071 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:30.641603  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:30.664179 10071 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:30.664952 10071 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:30.667522 10071 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:30.674717  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:30.679491  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:30.680348  1752 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:30.683164  1641 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:30.687932  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:30.689040  1747 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 19.
I20260709 13:01:30.690750  1752 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 21.
W20260709 13:01:30.697386  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:30.701400  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:30.702494 10071 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:30.703055 10071 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 693257b3078444e0bd26d3e82159d452)
I20260709 13:01:30.703583 10071 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:30.702626  1747 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 32 index: 18. Preceding OpId from leader: term: 32 index: 19. (index mismatch)
I20260709 13:01:30.717861  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:30.719071 10018 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:30.719789 10018 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:30.720806 10018 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:30.723807  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:30.727442 10010 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:01:30.745535 10071 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:30.748265 10071 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:31.169351  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 443352us
W20260709 13:01:31.171279  1641 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:31.222705  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd92efcb3084fe59e6f16a5467bcd9e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739"
I20260709 13:01:31.223474  1744 raft_consensus.cc:3060] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:31.231906  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88f288076c934a55b8d0dfe7855d4db9. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.233022  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.272521  1744 raft_consensus.cc:2468] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a40ab12c220464db732562e88c32c11 in term 20.
I20260709 13:01:31.310395  1501 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 20 to 21, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.320616  1747 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
W20260709 13:01:31.353796  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bbe0e89474f14ac0be0bd7343e0f4601: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:31.357195  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:31.358500  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.359254  1641 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:31.380586  1641 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:31.384966  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:31.389472  1641 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:31.390666 10010 raft_consensus.cc:2804] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:31.391353 10010 raft_consensus.cc:697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Becoming Leader. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:31.392467 10010 consensus_queue.cc:237] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:31.393244  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.394151  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:31.406333 10064 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:31.411221 10083 raft_consensus.cc:2955] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 LEADER]: Committing config change with OpId 32.19: config changed from index -1 to 19, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:31.429689  1747 raft_consensus.cc:2955] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Committing config change with OpId 32.19: config changed from index -1 to 19, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:31.442575  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.449828  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.477260  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.483959  1641 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.474421  1677 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:01:31.525051  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.528090   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1624)
I20260709 13:01:31.527151  1501 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 19, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 32 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:31.536418  1747 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:31.540840 10064 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:01:31.543929  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba83bc04fcfb4e669bf8c3f0dd49a8a8. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.563760  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.570645  1497 catalog_manager.cc:5697] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 reported cstate change: term changed from 19 to 20, leader changed from 693257b3078444e0bd26d3e82159d452 (127.0.107.193) to 1a40ab12c220464db732562e88c32c11 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:31.577705  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.646771  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.656144  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:31.838976  1715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111) [suppressed 422 similar messages]
W20260709 13:01:31.841066  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.850749  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:31.868028 10066 raft_consensus.cc:2955] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:31.902402  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.904156  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.912410  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.913054  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.924536  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:31.925163  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:31.930380  1672 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:31.981820  1750 raft_consensus.cc:2955] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:32.003518   436 debug-util.cc:398] Leaking SignalData structure 0x7b08002d10a0 after lost signal to thread 1641
I20260709 13:01:32.007316  1747 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:01:32.001159  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index -1 to 15, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.019078 10018 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:32.037788  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:32.038714  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.043532  1747 raft_consensus.cc:1275] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:01:32.056007 10110 ts_tablet_manager.cc:933] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:32.076978 10018 consensus_queue.cc:1048] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:32.081017 10110 tablet_copy_client.cc:323] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
W20260709 13:01:32.082804  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.084712  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.085210  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.086812  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:32.087666  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:32.088516  1641 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.097430 10112 ts_tablet_manager.cc:933] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:32.103415  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.115276  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 88f288076c934a55b8d0dfe7855d4db9 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:01:32.116070  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 88f288076c934a55b8d0dfe7855d4db9 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-88f288076c934a55b8d0dfe7855d4db9
W20260709 13:01:32.118433  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.122655 10104 raft_consensus.cc:2955] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Committing config change with OpId 21.10: config changed from index -1 to 10, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:32.138979  1750 raft_consensus.cc:2955] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Committing config change with OpId 21.10: config changed from index -1 to 10, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
I20260709 13:01:32.148900  1688 tablet_copy_source_session.cc:215] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:01:32.154783  1641 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 -> Peer 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919): Couldn't send request to peer 570958eb733a4af7ae16ae020998c8b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e60b8714c5d46e8a8676914b0595721. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.159448  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.174206 10110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f288076c934a55b8d0dfe7855d4db9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:32.190909  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2ac0 after lost signal to thread 434
W20260709 13:01:32.192543  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa360 after lost signal to thread 1535
W20260709 13:01:32.194850  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6500 after lost signal to thread 1702
I20260709 13:01:32.194103  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 reported cstate change: config changed from index -1 to 10, NON_VOTER 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } }
W20260709 13:01:32.197899  2338 debug-util.cc:398] Leaking SignalData structure 0x7b08002dde00 after lost signal to thread 1776
W20260709 13:01:32.199836  2338 debug-util.cc:398] Leaking SignalData structure 0x7b0800358300 after lost signal to thread 2341
W20260709 13:01:32.231148  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.244333 10110 tablet_copy_client.cc:806] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:32.245400 10110 tablet_copy_client.cc:670] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:32.252435 10110 tablet_copy_client.cc:538] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:32.252465 10112 tablet_copy_client.cc:323] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:01:32.254716  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:01:32.255654  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-ba83bc04fcfb4e669bf8c3f0dd49a8a8
I20260709 13:01:32.266824  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45654
I20260709 13:01:32.267957  1675 raft_consensus.cc:606] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Received request to transfer leadership
I20260709 13:01:32.279230 10110 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
I20260709 13:01:32.287961  1688 tablet_copy_source_session.cc:215] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:32.292085 10112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:32.296782  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45654
I20260709 13:01:32.297662  1675 raft_consensus.cc:606] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Received request to transfer leadership
I20260709 13:01:32.304826  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "1a40ab12c220464db732562e88c32c11"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45654
I20260709 13:01:32.305554  1675 raft_consensus.cc:606] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Received request to transfer leadership
W20260709 13:01:32.311457  1549 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:32.312003  1549 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5e60b8714c5d46e8a8676914b0595721 already in progress
W20260709 13:01:32.312335  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5e60b8714c5d46e8a8676914b0595721 already in progress
W20260709 13:01:32.416069  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.416410  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:32.454644  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:32.459609 10112 tablet_copy_client.cc:806] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:32.460386 10112 tablet_copy_client.cc:670] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:32.476373  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.476738 10112 tablet_copy_client.cc:538] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:32.477609  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 50954.8us
W20260709 13:01:32.478521  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.487915  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.512854 10119 ts_tablet_manager.cc:933] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: Initiating tablet copy from peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:32.523860  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.527046  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:32.529261   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1624)
I20260709 13:01:32.534998 10119 tablet_copy_client.cc:323] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39729
I20260709 13:01:32.540377  1688 tablet_copy_service.cc:140] P 1a40ab12c220464db732562e88c32c11: Received BeginTabletCopySession request for tablet 5e60b8714c5d46e8a8676914b0595721 from peer 570958eb733a4af7ae16ae020998c8b4 ({username='slave'} at 127.0.0.1:38702)
I20260709 13:01:32.541136  1688 tablet_copy_service.cc:161] P 1a40ab12c220464db732562e88c32c11: Beginning new tablet copy session on tablet 5e60b8714c5d46e8a8676914b0595721 from peer 570958eb733a4af7ae16ae020998c8b4 at {username='slave'} at 127.0.0.1:38702: session id = 570958eb733a4af7ae16ae020998c8b4-5e60b8714c5d46e8a8676914b0595721
I20260709 13:01:32.533108 10112 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
W20260709 13:01:32.560292  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:32.571733  1688 tablet_copy_source_session.cc:215] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:01:32.572621  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:32.583524 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b8714c5d46e8a8676914b0595721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:32.617457 10119 tablet_copy_client.cc:806] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:32.618302 10119 tablet_copy_client.cc:670] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:32.621258 10106 raft_consensus.cc:993] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: : Instructing follower fab19506de7242869c29d70c9fffb739 to start an election
I20260709 13:01:32.621896 10106 raft_consensus.cc:1081] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Signalling peer fab19506de7242869c29d70c9fffb739 to start an election
I20260709 13:01:32.623239 10119 tablet_copy_client.cc:538] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:32.628609  1750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721"
dest_uuid: "fab19506de7242869c29d70c9fffb739"
 from {username='slave'} at 127.0.0.1:48454
I20260709 13:01:32.629565  1750 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.630008  1750 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:32.641192 10119 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap starting.
W20260709 13:01:32.649089  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.677074  1750 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:32.681162  1750 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Requested vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:32.693046  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "1a40ab12c220464db732562e88c32c11"
I20260709 13:01:32.694242  1672 raft_consensus.cc:3055] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:32.694751  1672 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1a40ab12c220464db732562e88c32c11, State: Running, Role: LEADER
I20260709 13:01:32.696156  1672 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:32.698623  1672 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:32.731061  1715 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:32.802708  1672 raft_consensus.cc:2468] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:32.819938 10119 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.821213 10119 tablet_bootstrap.cc:492] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:01:32.822062 10119 ts_tablet_manager.cc:1403] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.181s	user 0.070s	sys 0.009s
I20260709 13:01:32.831670 10110 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=21 overwritten=2 applied=19 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.832834 10110 tablet_bootstrap.cc:492] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:01:32.833674 10110 ts_tablet_manager.cc:1403] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.555s	user 0.073s	sys 0.013s
I20260709 13:01:32.837473  1715 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739; no voters: 693257b3078444e0bd26d3e82159d452
I20260709 13:01:32.849442 10081 raft_consensus.cc:2804] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:32.850222 10081 raft_consensus.cc:697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:32.851352 10081 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:32.873989 10110 raft_consensus.cc:359] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:32.875185 10110 raft_consensus.cc:740] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:01:32.876170 10110 consensus_queue.cc:260] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 32.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:01:32.886396  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49061.2us
I20260709 13:01:32.895466 10110 ts_tablet_manager.cc:1434] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.005s
I20260709 13:01:32.895582 10119 raft_consensus.cc:359] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
W20260709 13:01:32.897523  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:32.897543 10119 raft_consensus.cc:740] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:01:32.898727 10119 consensus_queue.cc:260] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:32.913728  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-88f288076c934a55b8d0dfe7855d4db9 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:01:32.914266  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-88f288076c934a55b8d0dfe7855d4db9 on tablet 88f288076c934a55b8d0dfe7855d4db9 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:32.926239 10119 ts_tablet_manager.cc:1434] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.003s
I20260709 13:01:32.936257  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 21 to 22, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.943401  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-5e60b8714c5d46e8a8676914b0595721 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:01:32.944063  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-5e60b8714c5d46e8a8676914b0595721 on tablet 5e60b8714c5d46e8a8676914b0595721 with peer 570958eb733a4af7ae16ae020998c8b4
I20260709 13:01:33.030361 10112 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:33.060276 10112 tablet_bootstrap.cc:492] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: Bootstrap complete.
I20260709 13:01:33.061327 10112 ts_tablet_manager.cc:1403] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: Time spent bootstrapping tablet: real 0.529s	user 0.068s	sys 0.010s
I20260709 13:01:33.087158 10112 raft_consensus.cc:359] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:33.088449 10112 raft_consensus.cc:740] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 570958eb733a4af7ae16ae020998c8b4, State: Initialized, Role: LEARNER
I20260709 13:01:33.089311 10112 consensus_queue.cc:260] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } }
I20260709 13:01:33.134495 10112 ts_tablet_manager.cc:1434] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.001s
I20260709 13:01:33.152842  2317 raft_consensus.cc:1217] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 13:01:33.157176  1688 tablet_copy_service.cc:342] P 1a40ab12c220464db732562e88c32c11: Request end of tablet copy session 570958eb733a4af7ae16ae020998c8b4-ba83bc04fcfb4e669bf8c3f0dd49a8a8 received from {username='slave'} at 127.0.0.1:38702
I20260709 13:01:33.157749  1688 tablet_copy_service.cc:434] P 1a40ab12c220464db732562e88c32c11: ending tablet copy session 570958eb733a4af7ae16ae020998c8b4-ba83bc04fcfb4e669bf8c3f0dd49a8a8 on tablet ba83bc04fcfb4e669bf8c3f0dd49a8a8 with peer 570958eb733a4af7ae16ae020998c8b4
W20260709 13:01:33.172290  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:33.203735  2317 raft_consensus.cc:1217] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 LEARNER]: Deduplicated request from leader. Original: 32.18->[32.19-32.19]   Dedup: 32.19->[]
W20260709 13:01:33.284751  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:33.312953  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:33.322089  2317 raft_consensus.cc:3060] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEARNER]: Advancing to term 22
W20260709 13:01:33.325918  1485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 107787us
W20260709 13:01:33.332051  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c468e528ecc447f9d2154d473a93b16: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:33.337325  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.341081  2317 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:01:33.386894 10081 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:33.406452  1675 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:01:33.468734 10056 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:01:33.479753  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:33.532181  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 65291.5us
W20260709 13:01:33.535928   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:33.599413  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:33.676060 10118 raft_consensus.cc:1064] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:33.696499 10118 consensus_queue.cc:237] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 10, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:33.699065 10106 raft_consensus.cc:1064] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:33.703750 10106 consensus_queue.cc:237] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:33.757230  1670 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:33.774422  2309 raft_consensus.cc:1275] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:33.776979 10118 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:33.807492  1752 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:33.809142  2317 raft_consensus.cc:1275] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:33.811625 10066 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:33.813681 10066 consensus_queue.cc:1048] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:01:33.820205  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.822060 10127 raft_consensus.cc:1064] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: attempting to promote NON_VOTER 570958eb733a4af7ae16ae020998c8b4 to VOTER
I20260709 13:01:33.829252 10127 consensus_queue.cc:237] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.19, Last appended by leader: 18, Current term: 32, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:33.831024 10056 consensus_queue.cc:1048] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:33.844398  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.883129  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:33.898656 10118 raft_consensus.cc:2955] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Committing config change with OpId 22.12: config changed from index 10 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:33.902877  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:33.924157  2309 raft_consensus.cc:2955] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 10 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:33.932497 10127 raft_consensus.cc:2955] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:33.948482  1670 raft_consensus.cc:2955] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 10 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:33.951287  1752 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 32 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 13:01:33.957305  2309 raft_consensus.cc:1275] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 LEARNER]: Refusing update from remote peer 1a40ab12c220464db732562e88c32c11: Log matching property violated. Preceding OpId in replica: term: 32 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 13:01:33.961449  1752 raft_consensus.cc:2955] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:33.994377  1497 catalog_manager.cc:5697] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 10 to 12, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:34.019953 10066 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:01:34.076130  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 53073.4us
I20260709 13:01:34.084254 10127 consensus_queue.cc:1048] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.003s
W20260709 13:01:34.088364  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.092170  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.096381  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.096988  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.095368  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:34.100308  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:34.101852  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.103971  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.116110  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:34.135484  2317 raft_consensus.cc:2955] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:34.206596  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.208145  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:34.251121  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:34.248749 10127 raft_consensus.cc:2955] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 LEADER]: Committing config change with OpId 32.20: config changed from index 19 to 20, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:34.275857  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 112013us
W20260709 13:01:34.328706  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.329721  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.330418  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:34.346628  1752 raft_consensus.cc:2955] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Committing config change with OpId 32.20: config changed from index 19 to 20, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:34.357210  2317 raft_consensus.cc:2955] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Committing config change with OpId 32.20: config changed from index 19 to 20, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
I20260709 13:01:34.395423  1497 catalog_manager.cc:5697] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 reported cstate change: config changed from index 15 to 16, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } } }
W20260709 13:01:34.404510  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:34.442989  1501 catalog_manager.cc:5697] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 reported cstate change: config changed from index 19 to 20, 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 32 leader_uuid: "1a40ab12c220464db732562e88c32c11" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:34.450443  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.483834  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.493901  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:34.536736   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:34.540302  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.541210  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:34.599632  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.613029  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:34.625715  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.664970  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.713174  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.775866  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.798085  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.836179  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.893432  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.909704  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:34.910321  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:35.036082  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.042662  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:35.143807  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.434846  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.537446   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:35.543706  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 59251.3us
W20260709 13:01:35.558151  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.559084  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.576884  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.607188  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:35.624678  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.637665  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:35.823596  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:35.913159  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.983726  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.052505  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.169641  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:36.298480  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.316299  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.331427  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.365381  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.458103  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 62584.6us
W20260709 13:01:36.464020  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 68265.4us
W20260709 13:01:36.522323  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.533334  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:36.538080   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:36.568387  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.601718  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:36.602451  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:36.630165  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.665135  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.668107  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:36.701586  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.721657  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.725255  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.770735  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.847641  1715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111) [suppressed 503 similar messages]
W20260709 13:01:36.852160  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.889492  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:36.946557  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:36.985261  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.036542  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.088284  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.089766  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.173986  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.201699  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.225770  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.229399  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.273399  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.282415  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.316807  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.335889  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.349072  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.395817  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.460081  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.506212  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c468e528ecc447f9d2154d473a93b16: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:37.533293  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.538733   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:37.601922  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.690986  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.799134  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.808733  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.816633  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.838006  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:37.874892  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:37.977224  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:38.027616  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:38.160266  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43001, user_credentials={real_user=slave}} blocked reactor thread for 45344.8us
W20260709 13:01:38.201238  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:38.269656  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:38.539327   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:38.565601  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:38.574837  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:38.606006  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:38.662775  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:38.843743  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:38.941459  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.017290  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.074982  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:39.076053  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:39.141140  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.141793  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.177026  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:39.186455  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.187309  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.187881  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.243783  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.245720  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:39.255295  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.268903  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.324528  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.364984  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:39.386412  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.395612  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.445513  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.540602   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:39.545326  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.634161  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.650055  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.650928  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.700421  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.726951  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.738656  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.811560  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.835938  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:39.887979  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39729, user_credentials={real_user=slave}} blocked reactor thread for 49756.7us
W20260709 13:01:39.904956  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.936410  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:39.942548  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.968516  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:39.998531  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:40.011900  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.044313  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:40.295431  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.320737  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.371140  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:40.389102  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.504879  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.515697  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.541167   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:40.542287  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.660554  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.747557  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:40.824031  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:40.912431  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:40.989426  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.190017  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.193172  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.315478  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.341498  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:41.401166  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:41.412182  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.411831  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.438983  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.498071  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.513530  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.528079  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.541786   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:41.582168  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:41.583128  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.783856  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.837908  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.864244  1641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111) [suppressed 495 similar messages]
W20260709 13:01:41.867362  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:41.936483  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:41.949364  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:41.974042  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.004528  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:42.033139  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.085223  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.097711  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.161427  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.197330  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.259155  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.353740  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:42.398232  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.411774  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.529594  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.542374   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1624)
W20260709 13:01:42.542269  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.551221  2279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 51675.7us
W20260709 13:01:42.617441  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:42.636849  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:42.675086  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.679369  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:42.721799  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.724617  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.762905  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:42.797108  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:42.893771  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.046101  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:43.046814  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.066526  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.122788  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:43.198764  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:43.216202  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:43.259032  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.259918  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.384509  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:43.496757  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.589119  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.722575  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.731429  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.734279  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:43.819772  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.928795  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:43.929819  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.001477  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:44.082365  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.387065  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.422531  1641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 49987.9us
W20260709 13:01:44.427117  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:44.442817  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:44.542048  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.543279  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.544368  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.550863  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:44.592254  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.608109  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.609454  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.634042  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.669770  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.670694  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.675297  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.684571  1641 consensus_peers.cc:597] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:44.697479  1641 consensus_peers.cc:597] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.730196  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:44.777402  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:44.882712  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:44.955127  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.001312  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.063232  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.084930  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.097450  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.103902  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800364780 after lost signal to thread 434
W20260709 13:01:45.105859  1532 debug-util.cc:398] Leaking SignalData structure 0x7b08002aba40 after lost signal to thread 1535
W20260709 13:01:45.108282  1532 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4b60 after lost signal to thread 1702
W20260709 13:01:45.110116  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800064020 after lost signal to thread 1776
W20260709 13:01:45.112247  1532 debug-util.cc:398] Leaking SignalData structure 0x7b0800372ec0 after lost signal to thread 2341
W20260709 13:01:45.113153  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.206198  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.229151  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.248135  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.268533  1641 consensus_peers.cc:597] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.340464  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.381376  1641 consensus_peers.cc:597] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.440310  1641 consensus_peers.cc:597] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.447674  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.593393  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:45.628842  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:45.701812   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:45.747525  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.804989  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c468e528ecc447f9d2154d473a93b16: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:45.855273  1641 consensus_peers.cc:597] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.856210  1641 consensus_peers.cc:597] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:45.980553  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.037923  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.038937  1641 consensus_peers.cc:597] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.043488  1641 consensus_peers.cc:597] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:46.124358  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:46.159864   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:46.235858  2279 consensus_peers.cc:597] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.236434  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.236835  2279 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.292018  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.306143  2279 consensus_peers.cc:597] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.326134  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.334872  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.346926  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.358690  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.364044  1641 consensus_peers.cc:597] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:46.376928  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.403077  1715 consensus_peers.cc:597] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.404381  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.411993  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.425571  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.428591  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.429339  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.429894  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.426302  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.452662  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.471503  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.462282  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.482524  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.483479  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.495409  2279 consensus_peers.cc:597] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.501662   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:46.509963   431 tablet_replica.cc:333] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.511270   431 raft_consensus.cc:2243] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.513099   431 raft_consensus.cc:2272] T bbe0e89474f14ac0be0bd7343e0f4601 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.522293   431 tablet_replica.cc:333] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
W20260709 13:01:46.524657  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.530480  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.537281  2279 consensus_peers.cc:597] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.529302  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.546644  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.539775   431 raft_consensus.cc:2243] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.548699   431 raft_consensus.cc:2272] T 077713cf7fff4fb39be348e99943d26f P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:46.553508  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.557752  1715 consensus_peers.cc:597] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.556094  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.571353  2279 consensus_peers.cc:597] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.573834   431 tablet_replica.cc:333] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.576458   431 raft_consensus.cc:2243] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.577468   431 raft_consensus.cc:2272] T 813e209bb7f848ca8067e613c9ef43a1 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.586110   431 tablet_replica.cc:333] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
W20260709 13:01:46.588119  1641 consensus_peers.cc:597] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:46.588660   431 raft_consensus.cc:2243] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:46.580813  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.592407  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:46.589553   431 raft_consensus.cc:2272] T a9a24b102b5d4949a5dd73c9f7d069ad P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.605158   431 tablet_replica.cc:333] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.617588   431 raft_consensus.cc:2243] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.618796   431 raft_consensus.cc:2272] T 852e1e3fa7a448bf924920b2d2b47558 P 1a40ab12c220464db732562e88c32c11 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:46.616231  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:46.630960   431 tablet_replica.cc:333] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
W20260709 13:01:46.640103  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.645164  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.652331  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:46.653316   431 raft_consensus.cc:2243] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.657604   431 raft_consensus.cc:2272] T 60a0f19eac6047fdb1fd191d07ab7355 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.687206   431 tablet_replica.cc:333] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
W20260709 13:01:46.741577  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.755100  1641 consensus_peers.cc:597] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:46.756194   431 raft_consensus.cc:2243] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.757572   431 raft_consensus.cc:2272] T 0193c6e20d1c4a33997d268895b8c083 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.777172   431 tablet_replica.cc:333] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.778309   431 raft_consensus.cc:2243] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.779160   431 raft_consensus.cc:2272] T caa550f278b34a45a3bc714fdc04e95c P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.823120   431 tablet_replica.cc:333] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.846925   431 raft_consensus.cc:2243] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.857003   431 raft_consensus.cc:2272] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:46.867835  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:46.868631  1715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111) [suppressed 535 similar messages]
W20260709 13:01:46.870853  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.871711  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.884202   431 tablet_replica.cc:333] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.885205   431 raft_consensus.cc:2243] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.885845   431 raft_consensus.cc:2272] T 24407d61d8d743c58663bb69b069d26e P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.891356   431 tablet_replica.cc:333] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.892479   431 raft_consensus.cc:2243] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.893390   431 raft_consensus.cc:2272] T 8507985adb5b47a187ad9f20a3c73870 P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.910319   431 tablet_replica.cc:333] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.911480   431 raft_consensus.cc:2243] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.912734   431 raft_consensus.cc:2272] T 15c13780577e4e7f939bed39d7e72045 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.930964   431 tablet_replica.cc:333] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.938369   431 raft_consensus.cc:2243] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.940100   431 raft_consensus.cc:2272] T 57f6af13b3ef4faca52c6c12ac945d51 P 1a40ab12c220464db732562e88c32c11 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.945971   431 tablet_replica.cc:333] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.953305   431 raft_consensus.cc:2243] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.954883   431 raft_consensus.cc:2272] T 8f356989b6064ce99355e7583b2314ec P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.967514   431 tablet_replica.cc:333] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.969952   431 raft_consensus.cc:2243] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.970759   431 raft_consensus.cc:2272] T 6a3690a974c249a88aaacf8c89e51b93 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.981797   431 tablet_replica.cc:333] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.982856   431 raft_consensus.cc:2243] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.983801   431 raft_consensus.cc:2272] T 51d41e7558f84fa1b99e709cb935e448 P 1a40ab12c220464db732562e88c32c11 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.986967   431 tablet_replica.cc:333] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:46.997308   431 raft_consensus.cc:2243] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.998840   431 raft_consensus.cc:2272] T ff5b3fd375a24b8cbcadef3f01d01da0 P 1a40ab12c220464db732562e88c32c11 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.002143   431 tablet_replica.cc:333] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.010389   431 raft_consensus.cc:2243] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.012315   431 raft_consensus.cc:2272] T 2eac534aa8b349bc923752022b0b9ab6 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.037238  1641 consensus_peers.cc:597] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:47.039414   431 tablet_replica.cc:333] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.040946   431 raft_consensus.cc:2243] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.041783   431 raft_consensus.cc:2272] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P 1a40ab12c220464db732562e88c32c11 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.067890  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.068513  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.104514   431 tablet_replica.cc:333] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.105549   431 raft_consensus.cc:2243] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.106391   431 raft_consensus.cc:2272] T 86ec86569a4e46149249e63cfbd61fa4 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.115641  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.116457  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.116904  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.131990 10207 raft_consensus.cc:493] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.132975 10207 raft_consensus.cc:515] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.137176   431 tablet_replica.cc:333] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.138391   431 raft_consensus.cc:2243] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.139791   431 raft_consensus.cc:2272] T 27da507a1bb04525952847c678820e4e P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.143198   431 tablet_replica.cc:333] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
W20260709 13:01:47.144928  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.145634  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.145840 10207 leader_election.cc:290] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.146729  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.149361  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c468e528ecc447f9d2154d473a93b16" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.152149  1641 leader_election.cc:304] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.154371 10207 raft_consensus.cc:2749] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:47.169186   431 raft_consensus.cc:2243] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.180991   431 raft_consensus.cc:2272] T 5f4a777ed30740c3a60219dad4a4a6ad P 1a40ab12c220464db732562e88c32c11 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.194120  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.197518 10181 raft_consensus.cc:493] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.198223 10181 raft_consensus.cc:515] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:47.200798 10181 leader_election.cc:290] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:47.206967  1641 consensus_peers.cc:597] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:47.207224  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1cbc949b954ba587e016d3b0db3715" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:47.207887  1641 leader_election.cc:336] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.209777  1641 leader_election.cc:304] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.199100   431 tablet_replica.cc:333] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.216360   431 raft_consensus.cc:2243] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.218925   431 raft_consensus.cc:2272] T 583de7d6884c4f96b1f47ff7066c2da9 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.224171   431 tablet_replica.cc:333] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.225312   431 raft_consensus.cc:2243] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.227317   431 raft_consensus.cc:2272] T e88aab1e8ec54d79b537a6d2dfbacdac P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.234697 10207 raft_consensus.cc:2749] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:47.268371   431 tablet_replica.cc:333] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.278942   431 raft_consensus.cc:2243] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.283377   431 raft_consensus.cc:2272] T 69370730433544db93e2c777aba2b9b2 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.271036  1641 consensus_peers.cc:597] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:47.296728   431 tablet_replica.cc:333] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.301021   431 raft_consensus.cc:2243] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.304490   431 raft_consensus.cc:2272] T 3d7ba20be4524b828e4259656531c103 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.308339   431 tablet_replica.cc:333] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.309640   431 raft_consensus.cc:2243] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.311477   431 raft_consensus.cc:2272] T c3c15f4148e94b83a318e5a513f2f769 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.333249   431 tablet_replica.cc:333] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.337147 10207 raft_consensus.cc:493] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.369356 10207 raft_consensus.cc:515] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.338948 10191 raft_consensus.cc:493] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.372639 10191 raft_consensus.cc:515] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.339359 10181 raft_consensus.cc:493] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.376361 10181 raft_consensus.cc:515] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:47.470893 10207 leader_election.cc:290] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.474432 10181 leader_election.cc:290] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:47.476191 10181 raft_consensus.cc:493] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.477378 10181 raft_consensus.cc:515] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.480234 10191 leader_election.cc:290] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.484599   431 raft_consensus.cc:2243] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.491001   431 raft_consensus.cc:2272] T acc3d6e391b54e51aa1381c0d66b3edb P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.495625  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.493572  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22178ca5cca34225bf0682753c951fb7" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.496079  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e0c6a13bf4ad685049c44899c240e" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.491636 10191 raft_consensus.cc:493] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.498824  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.498903 10191 raft_consensus.cc:515] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
W20260709 13:01:47.500639  1641 leader_election.cc:336] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.501215 10191 leader_election.cc:290] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.501760 10191 raft_consensus.cc:493] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.502209 10191 raft_consensus.cc:515] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:47.499336 10207 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.503324  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22373089b38b498393c2161e53b5f016" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.503974 10207 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.504848  1641 leader_election.cc:304] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.506699 10181 leader_election.cc:290] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.507336 10181 raft_consensus.cc:493] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.507936  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:47.509580  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.508231 10207 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.510707  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.511390 10207 raft_consensus.cc:2749] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:47.511267  1641 leader_election.cc:304] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.513352  1641 leader_election.cc:304] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.513841  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c68d760d04910b7ffad46dd2ec819" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.515321 10211 raft_consensus.cc:2749] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.515772  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46080b3c17204e34b7cfa66296431876" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.516196 10211 raft_consensus.cc:2749] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.517292  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:47.519562  1641 consensus_peers.cc:597] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:47.520859  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37007, user_credentials={real_user=slave}} blocked reactor thread for 152305us
I20260709 13:01:47.523450  1641 leader_election.cc:304] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.526019  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b8714c5d46e8a8676914b0595721" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.527033  1641 leader_election.cc:304] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.512012   431 tablet_replica.cc:333] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.531656 10207 raft_consensus.cc:2749] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.533123 10207 raft_consensus.cc:2749] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:47.533378   431 raft_consensus.cc:2243] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:01:47.533286  1641 leader_election.cc:336] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:47.534619  1641 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.534811   431 raft_consensus.cc:2272] T 03d13a42db4a4920828af42492055735 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.535127  1641 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.535913 10211 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:47.537295  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eaa544af67a451a8d99cb7cc0f7e452" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.538803 10211 raft_consensus.cc:493] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.539343 10211 raft_consensus.cc:515] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.507918 10181 raft_consensus.cc:515] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.541502 10211 leader_election.cc:290] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.542488 10181 leader_election.cc:290] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.531183 10191 leader_election.cc:290] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:47.553351  1641 leader_election.cc:336] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.554405  1641 leader_election.cc:304] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.555930  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f3320caa9849f893ce5125d17a0d48" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.556325 10209 raft_consensus.cc:2749] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:47.560345  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:47.566577  1641 leader_election.cc:336] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.567189  1641 leader_election.cc:304] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:47.587621 10209 raft_consensus.cc:2749] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:47.588739 10209 raft_consensus.cc:493] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.589252 10209 raft_consensus.cc:515] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:47.591854 10209 leader_election.cc:290] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:47.597460   431 tablet_replica.cc:333] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.598532   431 raft_consensus.cc:2243] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.599907   431 raft_consensus.cc:2272] T 8a8238df60414b3d8b25f82937649e9a P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.603277 10208 raft_consensus.cc:493] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.604533 10208 raft_consensus.cc:515] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.607456 10208 leader_election.cc:290] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.622684   431 tablet_replica.cc:333] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.628775   431 raft_consensus.cc:2243] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.629566   431 raft_consensus.cc:2272] T 6f7e0c6a13bf4ad685049c44899c240e P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.632684   431 tablet_replica.cc:333] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.633811   431 raft_consensus.cc:2243] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.634687   431 raft_consensus.cc:2272] T 22373089b38b498393c2161e53b5f016 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.638326   431 tablet_replica.cc:333] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.639230   431 raft_consensus.cc:2243] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.640089   431 raft_consensus.cc:2272] T 1c1cbc949b954ba587e016d3b0db3715 P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.643010   431 tablet_replica.cc:333] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.643944   431 raft_consensus.cc:2243] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.645533   431 raft_consensus.cc:2272] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.649534   431 tablet_replica.cc:333] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.650430   431 raft_consensus.cc:2243] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.651623   431 raft_consensus.cc:2272] T 46080b3c17204e34b7cfa66296431876 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.656888   431 tablet_replica.cc:333] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.657829   431 raft_consensus.cc:2243] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.658488  2317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ce4edad7b14292b8c162db2d204922" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.658947   431 raft_consensus.cc:2272] T 22178ca5cca34225bf0682753c951fb7 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.664081   431 tablet_replica.cc:333] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.665007   431 raft_consensus.cc:2243] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.667232   431 raft_consensus.cc:2272] T 33f3320caa9849f893ce5125d17a0d48 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.676126   431 tablet_replica.cc:333] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.678898   431 raft_consensus.cc:2243] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.685701 10208 raft_consensus.cc:493] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.692050 10208 raft_consensus.cc:515] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:47.692481   431 raft_consensus.cc:2272] T d05c68d760d04910b7ffad46dd2ec819 P 1a40ab12c220464db732562e88c32c11 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.683230 10191 raft_consensus.cc:493] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:47.697212 10191 raft_consensus.cc:515] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:47.685977 10209 raft_consensus.cc:493] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 570958eb733a4af7ae16ae020998c8b4)
I20260709 13:01:47.700608 10209 raft_consensus.cc:515] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.712024 10208 leader_election.cc:290] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:47.718155   431 tablet_replica.cc:333] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.719952   431 raft_consensus.cc:2243] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.756989   431 raft_consensus.cc:2272] T 88f288076c934a55b8d0dfe7855d4db9 P 1a40ab12c220464db732562e88c32c11 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.765508 10209 leader_election.cc:290] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:47.772069  1641 leader_election.cc:336] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:47.772817  1641 leader_election.cc:336] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.773243  1641 leader_election.cc:304] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:47.774673  1641 consensus_peers.cc:597] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:47.775087 10189 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:47.776600  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b0503746074acbb6bd55ef700df0ae" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.775810 10189 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.780010 10189 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:47.780267 10191 leader_election.cc:290] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:47.781560  1641 leader_election.cc:336] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.781680  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:47.782274  1641 leader_election.cc:336] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:47.782858  1641 leader_election.cc:336] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:47.781015 10191 raft_consensus.cc:2749] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:47.786006  1744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a3fe9094ec43a1a21a897a8aa2513d" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.787703  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922046ac7c0490f8b70ef22b66bfc6b" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:47.798578  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.799304  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:47.802465  1641 leader_election.cc:304] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.803934 10209 raft_consensus.cc:2749] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.806530   431 tablet_replica.cc:333] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.807587   431 raft_consensus.cc:2243] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.808564   431 raft_consensus.cc:2272] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.813844  1641 leader_election.cc:304] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.815191 10209 raft_consensus.cc:2749] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:47.818990  1641 leader_election.cc:304] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
W20260709 13:01:47.820237  1641 raft_consensus.cc:2686] T 32a3fe9094ec43a1a21a897a8aa2513d P 1a40ab12c220464db732562e88c32c11: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:01:47.829490  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979e85778d254fc7a74198c589e12967" candidate_uuid: "1a40ab12c220464db732562e88c32c11" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:47.821391  1641 leader_election.cc:304] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.832870 10209 raft_consensus.cc:2749] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:01:47.834160  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:47.842964   431 tablet_replica.cc:333] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.846278   431 raft_consensus.cc:2243] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.853922   431 raft_consensus.cc:2272] T d53e959bd0a14b21aa72696bbf6d090d P 1a40ab12c220464db732562e88c32c11 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.871631  1641 leader_election.cc:304] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a40ab12c220464db732562e88c32c11; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:47.872712 10209 raft_consensus.cc:2749] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.885342   431 tablet_replica.cc:333] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.893571   431 raft_consensus.cc:2243] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.895234   431 raft_consensus.cc:2272] T a5eeee076cc0489bb6f13e55dbc52d06 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.899006   431 tablet_replica.cc:333] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
W20260709 13:01:47.892398  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.900650  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:47.890745  2279 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:47.905174  2279 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, fab19506de7242869c29d70c9fffb739
I20260709 13:01:47.906388 10210 raft_consensus.cc:2749] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:47.911054  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.927614   431 raft_consensus.cc:2243] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.929208   431 raft_consensus.cc:2272] T 19b0503746074acbb6bd55ef700df0ae P 1a40ab12c220464db732562e88c32c11 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.944756  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.946988 10203 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:47.950654   431 tablet_replica.cc:333] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.954627 10203 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:47.959401 10203 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:47.961618   431 raft_consensus.cc:2243] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.965483   431 raft_consensus.cc:2272] T 3c468e528ecc447f9d2154d473a93b16 P 1a40ab12c220464db732562e88c32c11 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:47.954133  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:47.994542   431 tablet_replica.cc:333] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:47.997507   431 raft_consensus.cc:2243] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.004257   431 raft_consensus.cc:2272] T c8ce4edad7b14292b8c162db2d204922 P 1a40ab12c220464db732562e88c32c11 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.012557  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:48.018411   431 tablet_replica.cc:333] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.013185  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
I20260709 13:01:48.020797  2309 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 22.
I20260709 13:01:48.020275   431 raft_consensus.cc:2243] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.030771   431 raft_consensus.cc:2272] T 979e85778d254fc7a74198c589e12967 P 1a40ab12c220464db732562e88c32c11 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.035903   431 tablet_replica.cc:333] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.048249   431 raft_consensus.cc:2243] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.052811   431 raft_consensus.cc:2272] T e922046ac7c0490f8b70ef22b66bfc6b P 1a40ab12c220464db732562e88c32c11 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.062232  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 
I20260709 13:01:48.063843 10203 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:48.064396 10203 raft_consensus.cc:493] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.064807 10203 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:48.083384   431 tablet_replica.cc:333] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.090029 10203 raft_consensus.cc:515] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:48.091168   431 raft_consensus.cc:2243] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.093583   431 raft_consensus.cc:2272] T 3eaa544af67a451a8d99cb7cc0f7e452 P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.097440   431 tablet_replica.cc:333] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.098798   431 raft_consensus.cc:2243] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.100414   431 raft_consensus.cc:2272] T 5e60b8714c5d46e8a8676914b0595721 P 1a40ab12c220464db732562e88c32c11 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.097501 10203 leader_election.cc:290] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Requested vote from peers 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:48.101847  1715 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.104434   431 tablet_replica.cc:333] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.128249   431 raft_consensus.cc:2243] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.134016   431 raft_consensus.cc:2272] T c1c6eb4be18b446b8252b29274f2b941 P 1a40ab12c220464db732562e88c32c11 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.140691   431 tablet_replica.cc:333] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.144958  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe0e89474f14ac0be0bd7343e0f4601" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4"
I20260709 13:01:48.153607  2309 raft_consensus.cc:3060] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:48.154233   431 raft_consensus.cc:2243] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.155886   431 raft_consensus.cc:2272] T fcd92efcb3084fe59e6f16a5467bcd9e P 1a40ab12c220464db732562e88c32c11 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.159202   431 tablet_replica.cc:333] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11: stopping tablet replica
I20260709 13:01:48.160095   431 raft_consensus.cc:2243] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.167874   431 raft_consensus.cc:2272] T ae709ecc740b452bbba5c6360b053347 P 1a40ab12c220464db732562e88c32c11 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.170817  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:48.171969  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:48.172986  2309 raft_consensus.cc:2468] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab19506de7242869c29d70c9fffb739 in term 23.
W20260709 13:01:48.174635  1715 leader_election.cc:336] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.177594  1715 leader_election.cc:304] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11
I20260709 13:01:48.188102 10203 raft_consensus.cc:2804] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:48.188870 10203 raft_consensus.cc:697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Becoming Leader. State: Replica: fab19506de7242869c29d70c9fffb739, State: Running, Role: LEADER
I20260709 13:01:48.190006 10203 consensus_queue.cc:237] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:48.233351  1501 catalog_manager.cc:5697] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 reported cstate change: term changed from 22 to 23, leader changed from 1a40ab12c220464db732562e88c32c11 (127.0.107.194) to fab19506de7242869c29d70c9fffb739 (127.0.107.195). New cstate: current_term: 23 leader_uuid: "fab19506de7242869c29d70c9fffb739" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:48.253014 10213 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.253788 10213 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.261391 10213 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:48.269001 10213 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.271270 10213 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.277264 10213 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.295210  1715 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:48.302542  1715 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.306070  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.308568 10213 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:48.309405 10203 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.310053 10203 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:48.310679  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.312577 10203 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:48.312731 10213 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.313249 10213 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.316660 10213 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.311363  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.319585  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.320544 10213 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:48.344007 10203 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.344714 10203 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.347318 10203 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:48.355489 10203 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.356971 10203 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.360000 10203 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.364521  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:48.368012  1715 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:48.371750  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.372434  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.378595 10203 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:48.380662  1715 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.381279  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.382627 10213 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:01:48.410742  1715 leader_election.cc:336] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:48.415246  1715 leader_election.cc:336] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.415987  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.419080 10203 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:48.429930 10213 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.430644 10213 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.436877 10213 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.449759  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:48.461632  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:48.463863  1715 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:48.486737  1715 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.487660  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.488729 10213 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:48.532039  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:48.537186  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.543826  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.545529 10203 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:48.596982  1773 debug-util.cc:398] Leaking SignalData structure 0x7b0800341f60 after lost signal to thread 434
W20260709 13:01:48.598542  1773 debug-util.cc:398] Leaking SignalData structure 0x7b080034dbe0 after lost signal to thread 1535
W20260709 13:01:48.599277  1773 debug-util.cc:398] Leaking SignalData structure 0x7b0800367480 after lost signal to thread 1702
W20260709 13:01:48.601150  1773 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6300 after lost signal to thread 1776
W20260709 13:01:48.614938  1773 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8dc0 after lost signal to thread 2341
W20260709 13:01:48.611092  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.659868  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:48.663815 10213 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.664613 10213 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:48.666257 10206 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.666960 10206 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.669343 10206 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.670460  2279 consensus_peers.cc:597] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:48.686688 10206 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.687382 10206 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.689394 10213 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
I20260709 13:01:48.689752 10206 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.697758  1715 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.701536  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:48.709982  1715 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.710557  1715 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:48.714284  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:48.718918 10206 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 13:01:48.733016  2279 consensus_peers.cc:597] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.743475  1715 consensus_peers.cc:597] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.746946 10206 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:01:48.749686  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:48.754033  1715 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.754583  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
W20260709 13:01:48.756233  1715 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:48.756939 10197 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:48.752782 10206 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:48.760633 10206 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), 570958eb733a4af7ae16ae020998c8b4 (127.0.107.196:35919)
W20260709 13:01:48.760739  1715 connection.cc:769] client connection to 127.0.107.194:39729 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:01:48.761422  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:01:48.765542 10198 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.766278 10198 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.768913 10198 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:48.771375  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "fab19506de7242869c29d70c9fffb739" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "570958eb733a4af7ae16ae020998c8b4" is_pre_election: true
W20260709 13:01:48.771960  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.772589  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.774729 10206 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:48.782912  2279 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.783027  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.791236  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:48.791896  1715 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.792344  1715 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 570958eb733a4af7ae16ae020998c8b4, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.795281 10189 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.793286 10206 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:48.796075 10189 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:48.799923 10189 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:48.810180  1715 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:48.811331  1715 leader_election.cc:336] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:48.818399  1715 leader_election.cc:336] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.818809  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:48.818989  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.819665  1746 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
W20260709 13:01:48.821693  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:48.825246 10206 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:48.828359 10206 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:48.828994 10206 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:48.830766  2309 raft_consensus.cc:1275] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Refusing update from remote peer fab19506de7242869c29d70c9fffb739: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:01:48.832486 10206 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:48.832834  2279 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:48.843386  2279 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:48.845209 10206 consensus_queue.cc:1048] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:01:48.846287  2279 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.847132 10189 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:48.866333  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.867050  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:48.868383  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:48.870693  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:48.871650 10206 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:48.898854  1715 consensus_peers.cc:597] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.899513  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:48.911037  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.950680  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.967028  2279 consensus_peers.cc:597] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.975085  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.981349  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.985909  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.994371  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.995056  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.995601  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.004226  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:49.006419 10189 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:49.007194 10189 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:49.010218 10189 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:49.016922  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f288076c934a55b8d0dfe7855d4db9" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
I20260709 13:01:49.017740  1746 raft_consensus.cc:2468] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 32.
W20260709 13:01:49.022946  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.041600  2279 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:49.049708  2279 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:49.050276  2279 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4, fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:49.051369 10189 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 13:01:49.063237  2279 consensus_peers.cc:597] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.071394  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.077234  1715 consensus_peers.cc:597] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.091082  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.099282  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.130532  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.140538  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.166829  2279 consensus_peers.cc:597] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.188431  1715 consensus_peers.cc:597] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.197068  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.215430  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.230304  1715 consensus_peers.cc:597] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.251801  1715 consensus_peers.cc:597] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.259330  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.275018  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:49.286434 10206 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:49.287161 10206 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:49.289445 10206 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:49.292260 10213 raft_consensus.cc:493] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:49.292948 10213 raft_consensus.cc:515] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:49.295324 10213 leader_election.cc:290] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:49.302495  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.324535  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:49.325309  1715 leader_election.cc:336] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:49.325969  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.327598  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:49.334403  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:49.335443 10206 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:49.335656  1715 leader_election.cc:336] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:49.336282  1715 leader_election.cc:304] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:49.339043 10206 raft_consensus.cc:2749] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:49.352854  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.366820  1715 consensus_peers.cc:597] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:49.368149 10206 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
W20260709 13:01:49.371236  1715 consensus_peers.cc:597] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:49.370990 10206 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
W20260709 13:01:49.372047  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:49.373654 10206 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:49.396939  1715 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:49.406164  1715 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:49.406817  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:49.407789 10206 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:49.440814  1715 consensus_peers.cc:597] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.465827  1715 consensus_peers.cc:597] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.477969  1715 consensus_peers.cc:597] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.558379  1715 consensus_peers.cc:597] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.560413  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:49.565642 10206 raft_consensus.cc:493] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:49.566352 10206 raft_consensus.cc:515] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } }
I20260709 13:01:49.568971 10206 leader_election.cc:290] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:49.577795  1715 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:49.579090  1715 leader_election.cc:336] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:49.579669  1715 leader_election.cc:304] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:49.580556 10206 raft_consensus.cc:2749] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:49.637620  1715 consensus_peers.cc:597] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.657227  1715 consensus_peers.cc:597] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.687911  1715 consensus_peers.cc:597] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.867336  1715 consensus_peers.cc:597] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:49.934028  1715 consensus_peers.cc:597] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:50.018625 10206 raft_consensus.cc:493] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.019279 10206 raft_consensus.cc:515] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.022614 10206 leader_election.cc:290] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.034152  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:50.047447 10206 raft_consensus.cc:493] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.048108 10206 raft_consensus.cc:515] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.051091 10206 leader_election.cc:290] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.085937  1715 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:50.089390  1715 leader_election.cc:336] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.091984  1715 leader_election.cc:304] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.097048 10206 raft_consensus.cc:2749] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:50.118384  1715 leader_election.cc:336] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.125018 10206 raft_consensus.cc:493] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.127465 10206 raft_consensus.cc:515] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.129945 10206 leader_election.cc:290] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.138625  1715 leader_election.cc:336] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.141525  1715 leader_election.cc:304] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.145437 10206 raft_consensus.cc:2749] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:50.150993  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:50.182331  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:50.190955  1715 leader_election.cc:336] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.191694  1715 leader_election.cc:304] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.192710 10206 raft_consensus.cc:2749] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:50.198354 10206 raft_consensus.cc:493] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.199060 10206 raft_consensus.cc:515] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.201422 10206 leader_election.cc:290] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.207875  1715 consensus_peers.cc:597] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:50.218755  1715 consensus_peers.cc:597] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:50.224471  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:50.226703  1715 leader_election.cc:336] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.227370  1715 leader_election.cc:304] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.228260 10206 raft_consensus.cc:2749] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:50.253722  1715 consensus_peers.cc:597] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:50.336702  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:50.372676 10213 raft_consensus.cc:493] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.373451 10213 raft_consensus.cc:515] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.376051 10213 leader_election.cc:290] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:50.403533 10213 raft_consensus.cc:493] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.404367 10213 raft_consensus.cc:515] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.409953 10213 leader_election.cc:290] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.420869  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:01:50.432312 10213 raft_consensus.cc:493] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.433162 10213 raft_consensus.cc:515] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.437947 10213 leader_election.cc:290] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.441495  1715 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:50.463667  1715 leader_election.cc:336] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.466914  1715 leader_election.cc:304] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.467885 10213 raft_consensus.cc:2749] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:50.471117  1715 leader_election.cc:336] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.488072 10213 raft_consensus.cc:493] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.488830 10213 raft_consensus.cc:515] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.491328 10213 leader_election.cc:290] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:50.510689 10206 raft_consensus.cc:493] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.511317 10206 raft_consensus.cc:515] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.513556 10206 leader_election.cc:290] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.516459  1715 leader_election.cc:336] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.524381  1715 leader_election.cc:304] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.528396 10213 raft_consensus.cc:2749] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:50.530074  1715 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:50.538586  1715 leader_election.cc:336] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.539263  1715 leader_election.cc:304] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.540192 10213 raft_consensus.cc:2749] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:01:50.545936  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:50.547745  1715 consensus_peers.cc:597] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:50.548308  1715 leader_election.cc:336] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.548764  1715 leader_election.cc:304] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.549556 10213 raft_consensus.cc:2749] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:50.611069  1715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:35919, user_credentials={real_user=slave}} blocked reactor thread for 58551.3us
W20260709 13:01:50.635352  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:50.646545  1715 leader_election.cc:336] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.647140  1715 leader_election.cc:304] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.649503 10228 raft_consensus.cc:2749] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:01:50.688983  1715 consensus_peers.cc:597] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:50.697178 10228 raft_consensus.cc:493] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.697963 10228 raft_consensus.cc:515] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.700485 10228 leader_election.cc:290] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.711277  1715 consensus_peers.cc:597] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:50.719846  1715 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:50.721058  1715 leader_election.cc:336] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.721603  1715 leader_election.cc:304] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.723852 10228 raft_consensus.cc:2749] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:50.771579   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:50.772384  1715 consensus_peers.cc:597] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:50.818725 10228 raft_consensus.cc:493] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.819479 10228 raft_consensus.cc:515] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.822113 10228 leader_election.cc:290] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.836109  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:50.837880  1715 leader_election.cc:336] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.838467  1715 leader_election.cc:304] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.839363 10213 raft_consensus.cc:2749] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:50.842763 10227 raft_consensus.cc:493] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.843587 10227 raft_consensus.cc:515] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:50.847239 10227 leader_election.cc:290] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:50.856858  2279 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.852429  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba83bc04fcfb4e669bf8c3f0dd49a8a8" candidate_uuid: "570958eb733a4af7ae16ae020998c8b4" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fab19506de7242869c29d70c9fffb739" is_pre_election: true
W20260709 13:01:50.858029  2279 leader_election.cc:336] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:50.858289  1746 raft_consensus.cc:2468] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570958eb733a4af7ae16ae020998c8b4 in term 22.
I20260709 13:01:50.858510  2279 leader_election.cc:304] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.859658 10227 raft_consensus.cc:2749] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:50.868572 10213 raft_consensus.cc:493] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:50.869251 10213 raft_consensus.cc:515] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:50.872195 10213 leader_election.cc:290] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
W20260709 13:01:50.891726  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
W20260709 13:01:50.894990  1715 leader_election.cc:336] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:50.895742  1715 leader_election.cc:304] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:50.896664 10213 raft_consensus.cc:2749] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:50.934221  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:01:50.939327   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:50.945300  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:01:50.967206  2279 consensus_peers.cc:597] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.038385  2279 consensus_peers.cc:597] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.045156  2279 consensus_peers.cc:597] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.045987  2279 consensus_peers.cc:597] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.048352  2279 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:51.053973   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:51.055222   431 tablet_replica.cc:333] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.056303   431 raft_consensus.cc:2243] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.058221   431 raft_consensus.cc:2272] T bbe0e89474f14ac0be0bd7343e0f4601 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.063596   431 tablet_replica.cc:333] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.064762   431 raft_consensus.cc:2243] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:01:51.064953  1715 consensus_peers.cc:597] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:51.066223   431 raft_consensus.cc:2272] T 813e209bb7f848ca8067e613c9ef43a1 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.069434   431 tablet_replica.cc:333] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.070472   431 raft_consensus.cc:2243] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.072119   431 raft_consensus.cc:2272] T 077713cf7fff4fb39be348e99943d26f P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.075320   431 tablet_replica.cc:333] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.076414   431 raft_consensus.cc:2243] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.077293   431 raft_consensus.cc:2272] T 60a0f19eac6047fdb1fd191d07ab7355 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.080729   431 tablet_replica.cc:333] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.081859   431 raft_consensus.cc:2243] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.083765   431 raft_consensus.cc:2272] T 516703d5c9f14537854665616191b5aa P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.087384   431 tablet_replica.cc:333] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.088495   431 raft_consensus.cc:2243] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:51.089311  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:01:51.089874   431 raft_consensus.cc:2272] T e85f5002455b4bc4bc385d3b81511511 P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.095830   431 tablet_replica.cc:333] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.096761   431 raft_consensus.cc:2243] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:01:51.096828  2279 consensus_peers.cc:597] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.099054   431 raft_consensus.cc:2272] T 8507985adb5b47a187ad9f20a3c73870 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.102651   431 tablet_replica.cc:333] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.103786   431 raft_consensus.cc:2243] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.104586   431 raft_consensus.cc:2272] T 22373089b38b498393c2161e53b5f016 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.107739   431 tablet_replica.cc:333] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
W20260709 13:01:51.107674  2279 consensus_peers.cc:597] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.109234   431 raft_consensus.cc:2243] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:01:51.109911  2279 consensus_peers.cc:597] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:51.110046 10227 raft_consensus.cc:493] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:51.110790   431 raft_consensus.cc:2272] T 6cd71f19da3340e6aae32a3f83215159 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.110810 10228 raft_consensus.cc:493] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1a40ab12c220464db732562e88c32c11)
I20260709 13:01:51.110702 10227 raft_consensus.cc:515] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } attrs { replace: true } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:51.111752 10228 raft_consensus.cc:515] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } }
I20260709 13:01:51.114213   431 tablet_replica.cc:333] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.114147 10227 leader_election.cc:290] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:51.115484   431 raft_consensus.cc:2243] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.116969   431 raft_consensus.cc:2272] T 24407d61d8d743c58663bb69b069d26e P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.118297 10228 leader_election.cc:290] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729)
I20260709 13:01:51.120165   431 tablet_replica.cc:333] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.121213   431 raft_consensus.cc:2243] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.122852   431 raft_consensus.cc:2272] T caa550f278b34a45a3bc714fdc04e95c P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.125358  2279 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:51.126225   431 tablet_replica.cc:333] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
W20260709 13:01:51.126273  2279 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:51.127427   431 raft_consensus.cc:2243] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.126955  2279 leader_election.cc:304] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:51.128206   431 raft_consensus.cc:2272] T 8ca72d2d43264fe99a56d5f4c01ed5f1 P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.128473 10227 raft_consensus.cc:2749] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 13:01:51.131031  2279 leader_election.cc:336] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:51.131498   431 tablet_replica.cc:333] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.132668   431 raft_consensus.cc:2243] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:01:51.133951  1715 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:51.134616   431 raft_consensus.cc:2272] T 5e60b8714c5d46e8a8676914b0595721 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.134857  1715 leader_election.cc:336] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:51.135345  1715 leader_election.cc:304] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fab19506de7242869c29d70c9fffb739; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:51.136111 10228 raft_consensus.cc:2749] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:51.138132   431 tablet_replica.cc:333] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.139266   431 raft_consensus.cc:2243] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.140671   431 raft_consensus.cc:2272] T 3eaa544af67a451a8d99cb7cc0f7e452 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.143997   431 tablet_replica.cc:333] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.155718   431 raft_consensus.cc:2243] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.156821   431 raft_consensus.cc:2272] T 8f356989b6064ce99355e7583b2314ec P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.160617   431 tablet_replica.cc:333] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.162521   431 raft_consensus.cc:2243] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.164119   431 raft_consensus.cc:2272] T 6a3690a974c249a88aaacf8c89e51b93 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.167459   431 tablet_replica.cc:333] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.168478   431 raft_consensus.cc:2243] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.169256   431 raft_consensus.cc:2272] T ff5b3fd375a24b8cbcadef3f01d01da0 P fab19506de7242869c29d70c9fffb739 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.172224   431 tablet_replica.cc:333] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.173173   431 raft_consensus.cc:2243] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.174587   431 raft_consensus.cc:2272] T 15c13780577e4e7f939bed39d7e72045 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.177945   431 tablet_replica.cc:333] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.178889   431 raft_consensus.cc:2243] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.179910   431 raft_consensus.cc:2272] T 57f6af13b3ef4faca52c6c12ac945d51 P fab19506de7242869c29d70c9fffb739 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.183735   431 tablet_replica.cc:333] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.184818   431 raft_consensus.cc:2243] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.185746   431 raft_consensus.cc:2272] T a5eeee076cc0489bb6f13e55dbc52d06 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.188941   431 tablet_replica.cc:333] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.189904   431 raft_consensus.cc:2243] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.191658   431 raft_consensus.cc:2272] T 86ec86569a4e46149249e63cfbd61fa4 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.195194   431 tablet_replica.cc:333] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.196208   431 raft_consensus.cc:2243] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.197448   431 raft_consensus.cc:2272] T 22178ca5cca34225bf0682753c951fb7 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.200563   431 tablet_replica.cc:333] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.201429   431 raft_consensus.cc:2243] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.202205   431 raft_consensus.cc:2272] T 3f8de6698b474b218d672997f3c708e3 P fab19506de7242869c29d70c9fffb739 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.205513   431 tablet_replica.cc:333] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.206400   431 raft_consensus.cc:2243] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.207912   431 raft_consensus.cc:2272] T 7ed6b8afa01f4aeaacc7cf39d3bdffeb P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.211189   431 tablet_replica.cc:333] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.212251   431 raft_consensus.cc:2243] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.213182   431 raft_consensus.cc:2272] T 2eac534aa8b349bc923752022b0b9ab6 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.215220  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.216414   431 tablet_replica.cc:333] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.217537   431 raft_consensus.cc:2243] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.218793   431 raft_consensus.cc:2272] T c3c15f4148e94b83a318e5a513f2f769 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.221978   431 tablet_replica.cc:333] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.222892   431 raft_consensus.cc:2243] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.224568   431 raft_consensus.cc:2272] T 46080b3c17204e34b7cfa66296431876 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.227643   431 tablet_replica.cc:333] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.228533   431 raft_consensus.cc:2243] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.229773   431 raft_consensus.cc:2272] T 3d7ba20be4524b828e4259656531c103 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.232820   431 tablet_replica.cc:333] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.233763   431 raft_consensus.cc:2243] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.235059   431 raft_consensus.cc:2272] T 69370730433544db93e2c777aba2b9b2 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.238221   431 tablet_replica.cc:333] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.239804   431 raft_consensus.cc:2243] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.240666   431 raft_consensus.cc:2272] T e88aab1e8ec54d79b537a6d2dfbacdac P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.244374   431 tablet_replica.cc:333] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.245342   431 raft_consensus.cc:2243] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:51.245704  2279 consensus_peers.cc:597] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:51.246148   431 raft_consensus.cc:2272] T acc3d6e391b54e51aa1381c0d66b3edb P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.249317   431 tablet_replica.cc:333] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.250231   431 raft_consensus.cc:2243] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.251027   431 raft_consensus.cc:2272] T 03d13a42db4a4920828af42492055735 P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.251027  2279 consensus_peers.cc:597] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:01:51.254101   431 tablet_replica.cc:333] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.255070   431 raft_consensus.cc:2243] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.255851   431 raft_consensus.cc:2272] T 8a8238df60414b3d8b25f82937649e9a P fab19506de7242869c29d70c9fffb739 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.261288   431 tablet_replica.cc:333] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.262331   431 raft_consensus.cc:2243] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.263113   431 raft_consensus.cc:2272] T bc29da50f1424c238eee239d451aab3c P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.266176   431 tablet_replica.cc:333] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.267040   431 raft_consensus.cc:2243] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.268329   431 raft_consensus.cc:2272] T a60f7d5f008b4c6f8ee8b707a5916f7d P fab19506de7242869c29d70c9fffb739 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.271210   431 tablet_replica.cc:333] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.272132   431 raft_consensus.cc:2243] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.273355   431 raft_consensus.cc:2272] T fcd92efcb3084fe59e6f16a5467bcd9e P fab19506de7242869c29d70c9fffb739 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.276770   431 tablet_replica.cc:333] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.277720   431 raft_consensus.cc:2243] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.279179   431 raft_consensus.cc:2272] T 6f7e0c6a13bf4ad685049c44899c240e P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.282709   431 tablet_replica.cc:333] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.283732   431 raft_consensus.cc:2243] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.285223   431 raft_consensus.cc:2272] T 1c1cbc949b954ba587e016d3b0db3715 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.288774   431 tablet_replica.cc:333] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.289672   431 raft_consensus.cc:2243] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.290874   431 raft_consensus.cc:2272] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P fab19506de7242869c29d70c9fffb739 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.294067   431 tablet_replica.cc:333] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.295235   431 raft_consensus.cc:2243] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.296274   431 raft_consensus.cc:2272] T 27da507a1bb04525952847c678820e4e P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.299726   431 tablet_replica.cc:333] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.300685   431 raft_consensus.cc:2243] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.301347   431 raft_consensus.cc:2272] T 5f4a777ed30740c3a60219dad4a4a6ad P fab19506de7242869c29d70c9fffb739 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.304277   431 tablet_replica.cc:333] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.305142   431 raft_consensus.cc:2243] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.305873   431 raft_consensus.cc:2272] T 583de7d6884c4f96b1f47ff7066c2da9 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.308259  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:01:51.308708   431 tablet_replica.cc:333] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.309669   431 raft_consensus.cc:2243] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.310338   431 raft_consensus.cc:2272] T c1c6eb4be18b446b8252b29274f2b941 P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.313228   431 tablet_replica.cc:333] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.314077   431 raft_consensus.cc:2243] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.315289   431 raft_consensus.cc:2272] T 32a3fe9094ec43a1a21a897a8aa2513d P fab19506de7242869c29d70c9fffb739 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.318019   431 tablet_replica.cc:333] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.318835   431 raft_consensus.cc:2243] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.320220   431 raft_consensus.cc:2272] T d53e959bd0a14b21aa72696bbf6d090d P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.323478   431 tablet_replica.cc:333] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.324359   431 raft_consensus.cc:2243] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.325117   431 raft_consensus.cc:2272] T d05c68d760d04910b7ffad46dd2ec819 P fab19506de7242869c29d70c9fffb739 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.325610  2279 consensus_peers.cc:597] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.327625  2279 consensus_peers.cc:597] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.327986   431 tablet_replica.cc:333] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.328912   431 raft_consensus.cc:2243] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.329872   431 raft_consensus.cc:2272] T 88f288076c934a55b8d0dfe7855d4db9 P fab19506de7242869c29d70c9fffb739 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.333015   431 tablet_replica.cc:333] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.333886   431 raft_consensus.cc:2243] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.335136   431 raft_consensus.cc:2272] T 3c468e528ecc447f9d2154d473a93b16 P fab19506de7242869c29d70c9fffb739 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.335588  2279 consensus_peers.cc:597] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.338037   431 tablet_replica.cc:333] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.339017   431 raft_consensus.cc:2243] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 28 LEADER]: Raft consensus shutting down.
W20260709 13:01:51.339958  2279 consensus_peers.cc:597] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.340420   431 raft_consensus.cc:2272] T e922046ac7c0490f8b70ef22b66bfc6b P fab19506de7242869c29d70c9fffb739 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.342873  2279 consensus_peers.cc:597] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:51.343441   431 tablet_replica.cc:333] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.344286   431 raft_consensus.cc:2243] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.345079   431 raft_consensus.cc:2272] T 19b0503746074acbb6bd55ef700df0ae P fab19506de7242869c29d70c9fffb739 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.348260   431 tablet_replica.cc:333] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.349097   431 raft_consensus.cc:2243] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.349776   431 raft_consensus.cc:2272] T ae709ecc740b452bbba5c6360b053347 P fab19506de7242869c29d70c9fffb739 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.350018  2279 consensus_peers.cc:597] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:51.352932   431 tablet_replica.cc:333] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739: stopping tablet replica
I20260709 13:01:51.353754   431 raft_consensus.cc:2243] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.354406   431 raft_consensus.cc:2272] T 75dc4812cc534228899ce2b7b14d2237 P fab19506de7242869c29d70c9fffb739 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.422816  2279 consensus_peers.cc:597] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 -> Peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Couldn't send request to peer fab19506de7242869c29d70c9fffb739. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.467585  2279 consensus_peers.cc:597] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.504181  2279 consensus_peers.cc:597] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.520068  2279 consensus_peers.cc:597] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.529217  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.618305  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:01:51.781855  2279 consensus_peers.cc:597] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.879007  2279 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111) [suppressed 733 similar messages]
W20260709 13:01:52.000128  2279 consensus_peers.cc:597] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Couldn't send request to peer 693257b3078444e0bd26d3e82159d452. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:01:52.029065   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:52.060060  2279 consensus_peers.cc:597] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 -> Peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Couldn't send request to peer 1a40ab12c220464db732562e88c32c11. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:52.163932   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:01:52.175083 10231 raft_consensus.cc:493] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:52.175832 10231 raft_consensus.cc:515] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } attrs { replace: true } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:52.179361 10231 leader_election.cc:290] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:52.188827  2279 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:52.189743  2279 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1a40ab12c220464db732562e88c32c11 (127.0.107.194:39729): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39729: connect: Connection refused (error 111)
I20260709 13:01:52.190191  2279 leader_election.cc:304] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 1a40ab12c220464db732562e88c32c11, 693257b3078444e0bd26d3e82159d452
I20260709 13:01:52.191383 10231 raft_consensus.cc:2749] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:52.193288  2279 leader_election.cc:336] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43001: connect: Connection refused (error 111)
I20260709 13:01:52.207935 10231 raft_consensus.cc:493] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:52.208825 10231 raft_consensus.cc:515] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:52.211419 10231 leader_election.cc:290] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
W20260709 13:01:52.222968  2279 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
W20260709 13:01:52.225487  2279 leader_election.cc:336] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43001: connect: Connection refused (error 111)
I20260709 13:01:52.226482  2279 leader_election.cc:304] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:52.227284 10231 raft_consensus.cc:2749] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:52.242164   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:52.243248   431 tablet_replica.cc:333] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.244518   431 raft_consensus.cc:2243] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.245306   431 raft_consensus.cc:2272] T bbe0e89474f14ac0be0bd7343e0f4601 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.248265   431 tablet_replica.cc:333] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.249190   431 raft_consensus.cc:2243] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.250370   431 raft_consensus.cc:2272] T c3c15f4148e94b83a318e5a513f2f769 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.254220   431 tablet_replica.cc:333] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.255355   431 raft_consensus.cc:2243] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEARNER]: Raft consensus shutting down.
I20260709 13:01:52.255924   431 pending_rounds.cc:70] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Trying to abort 2 pending ops.
I20260709 13:01:52.256167   431 pending_rounds.cc:77] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7305634075844431872 op_type: NO_OP noop_request { }
I20260709 13:01:52.256618   431 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:52.256891   431 pending_rounds.cc:77] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305634043631239168 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d53e959bd0a14b21aa72696bbf6d090d" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } attrs { replace: true } } peers { permanent_uuid: "1a40ab12c220464db732562e88c32c11" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39729 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: true } } } }
I20260709 13:01:52.257637   431 raft_consensus.cc:2917] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEARNER]: Aborting config change with OpId 22.13: Aborted: Op aborted
I20260709 13:01:52.257993   431 raft_consensus.cc:2889] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:01:52.258320   431 raft_consensus.cc:2272] T d53e959bd0a14b21aa72696bbf6d090d P 570958eb733a4af7ae16ae020998c8b4 [term 24 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:01:52.261368   431 tablet_replica.cc:333] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.262059   431 raft_consensus.cc:2243] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.263144   431 raft_consensus.cc:2272] T a9a24b102b5d4949a5dd73c9f7d069ad P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.265760   431 tablet_replica.cc:333] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.266453   431 raft_consensus.cc:2243] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.267447   431 raft_consensus.cc:2272] T e85f5002455b4bc4bc385d3b81511511 P 570958eb733a4af7ae16ae020998c8b4 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.270298   431 tablet_replica.cc:333] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.271023   431 raft_consensus.cc:2243] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.272070   431 raft_consensus.cc:2272] T 852e1e3fa7a448bf924920b2d2b47558 P 570958eb733a4af7ae16ae020998c8b4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.274601   431 tablet_replica.cc:333] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.275269   431 raft_consensus.cc:2243] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.276351   431 raft_consensus.cc:2272] T 0193c6e20d1c4a33997d268895b8c083 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.279338   431 tablet_replica.cc:333] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.280227   431 raft_consensus.cc:2243] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.281261   431 raft_consensus.cc:2272] T 60a0f19eac6047fdb1fd191d07ab7355 P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.284363   431 tablet_replica.cc:333] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.285295   431 raft_consensus.cc:2243] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.286429   431 raft_consensus.cc:2272] T 75dc4812cc534228899ce2b7b14d2237 P 570958eb733a4af7ae16ae020998c8b4 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.289994   431 tablet_replica.cc:333] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.290639   431 raft_consensus.cc:2243] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.291855   431 raft_consensus.cc:2272] T 979e85778d254fc7a74198c589e12967 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.294370   431 tablet_replica.cc:333] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.295099   431 raft_consensus.cc:2243] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.296159   431 raft_consensus.cc:2272] T 3c468e528ecc447f9d2154d473a93b16 P 570958eb733a4af7ae16ae020998c8b4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.299160   431 tablet_replica.cc:333] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.299971   431 raft_consensus.cc:2243] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.301414   431 raft_consensus.cc:2272] T ba83bc04fcfb4e669bf8c3f0dd49a8a8 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.304626   431 tablet_replica.cc:333] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.305601   431 raft_consensus.cc:2243] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.306852   431 raft_consensus.cc:2272] T 22373089b38b498393c2161e53b5f016 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.309345   431 tablet_replica.cc:333] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.310048   431 raft_consensus.cc:2243] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.311065   431 raft_consensus.cc:2272] T 51d41e7558f84fa1b99e709cb935e448 P 570958eb733a4af7ae16ae020998c8b4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.313531   431 tablet_replica.cc:333] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.314209   431 raft_consensus.cc:2243] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.314811   431 raft_consensus.cc:2272] T 88f288076c934a55b8d0dfe7855d4db9 P 570958eb733a4af7ae16ae020998c8b4 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.317456   431 tablet_replica.cc:333] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.318303   431 raft_consensus.cc:2243] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.319355   431 raft_consensus.cc:2272] T 33f3320caa9849f893ce5125d17a0d48 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.322278   431 tablet_replica.cc:333] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.323004   431 raft_consensus.cc:2243] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.323642   431 raft_consensus.cc:2272] T 516703d5c9f14537854665616191b5aa P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.326081   431 tablet_replica.cc:333] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.326756   431 raft_consensus.cc:2243] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.327455   431 raft_consensus.cc:2272] T 5e60b8714c5d46e8a8676914b0595721 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.330277   431 tablet_replica.cc:333] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.330935   431 raft_consensus.cc:2243] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.332050   431 raft_consensus.cc:2272] T 3f8de6698b474b218d672997f3c708e3 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.334444   431 tablet_replica.cc:333] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.335076   431 raft_consensus.cc:2243] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.336133   431 raft_consensus.cc:2272] T 19b0503746074acbb6bd55ef700df0ae P 570958eb733a4af7ae16ae020998c8b4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.338389   431 tablet_replica.cc:333] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.339110   431 raft_consensus.cc:2243] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.339720   431 raft_consensus.cc:2272] T a60f7d5f008b4c6f8ee8b707a5916f7d P 570958eb733a4af7ae16ae020998c8b4 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.342100   431 tablet_replica.cc:333] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.342674   431 raft_consensus.cc:2243] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.343771   431 raft_consensus.cc:2272] T bc29da50f1424c238eee239d451aab3c P 570958eb733a4af7ae16ae020998c8b4 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.344478 10231 raft_consensus.cc:493] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fab19506de7242869c29d70c9fffb739)
I20260709 13:01:52.345050 10231 raft_consensus.cc:515] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "693257b3078444e0bd26d3e82159d452" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37007 } } peers { permanent_uuid: "fab19506de7242869c29d70c9fffb739" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43001 } } peers { permanent_uuid: "570958eb733a4af7ae16ae020998c8b4" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 35919 } attrs { promote: false } }
I20260709 13:01:52.347133   431 tablet_replica.cc:333] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.347748 10231 leader_election.cc:290] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007), fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001)
I20260709 13:01:52.348191   431 raft_consensus.cc:2243] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.349009   431 raft_consensus.cc:2272] T 22178ca5cca34225bf0682753c951fb7 P 570958eb733a4af7ae16ae020998c8b4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.352556   431 tablet_replica.cc:333] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.353453   431 raft_consensus.cc:2243] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:01:52.353839  2279 leader_election.cc:336] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:01:52.354570   431 raft_consensus.cc:2272] T 2eac534aa8b349bc923752022b0b9ab6 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:52.354597  2279 leader_election.cc:336] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fab19506de7242869c29d70c9fffb739 (127.0.107.195:43001): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43001: connect: Connection refused (error 111)
I20260709 13:01:52.355162  2279 leader_election.cc:304] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570958eb733a4af7ae16ae020998c8b4; no voters: 693257b3078444e0bd26d3e82159d452, fab19506de7242869c29d70c9fffb739
I20260709 13:01:52.356081 10231 raft_consensus.cc:2749] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.357563   431 tablet_replica.cc:333] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.358297   431 raft_consensus.cc:2243] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.359026   431 raft_consensus.cc:2272] T 46080b3c17204e34b7cfa66296431876 P 570958eb733a4af7ae16ae020998c8b4 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.362704   431 tablet_replica.cc:333] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.363353   431 raft_consensus.cc:2243] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.364383   431 raft_consensus.cc:2272] T c8ce4edad7b14292b8c162db2d204922 P 570958eb733a4af7ae16ae020998c8b4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.366791   431 tablet_replica.cc:333] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.367359   431 raft_consensus.cc:2243] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.367959   431 raft_consensus.cc:2272] T 6cd71f19da3340e6aae32a3f83215159 P 570958eb733a4af7ae16ae020998c8b4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.370651   431 tablet_replica.cc:333] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4: stopping tablet replica
I20260709 13:01:52.371609   431 raft_consensus.cc:2243] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.372676   431 raft_consensus.cc:2272] T d05c68d760d04910b7ffad46dd2ec819 P 570958eb733a4af7ae16ae020998c8b4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.777886   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:52.846382   431 master.cc:562] Master@127.0.107.254:44561 shutting down...
W20260709 13:01:52.895249  1549 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:01:52.895659  1549 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:52.895900  1549 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:02:02.235939  1485 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111) [suppressed 36 similar messages]
W20260709 13:02:02.240909  1485 catalog_manager.cc:4755] TS 693257b3078444e0bd26d3e82159d452 (127.0.107.193:37007): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bbe0e89474f14ac0be0bd7343e0f4601: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37007: connect: Connection refused (error 111)
I20260709 13:02:03.800005   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:03.801291   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:03.801740   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P de45a76180d64c6884c212bcc9eaa1c0: stopping tablet replica
I20260709 13:02:04.005811   431 master.cc:584] Master@127.0.107.254:44561 shutdown complete.
I20260709 13:02:04.069856   431 test_util.cc:182] -----------------------------------------------
I20260709 13:02:04.070240   431 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601818739156-431-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (278713 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:02:04.075290   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46067
I20260709 13:02:04.076758   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:04.084075 10238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.084218 10237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.085088 10240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:04.085788   431 server_base.cc:1061] running on GCE node
I20260709 13:02:04.091329   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:04.091718   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:04.091926   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602124091902 us; error 0 us; skew 500 ppm
I20260709 13:02:04.092530   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:04.095604   431 webserver.cc:533] Webserver started at http://127.0.107.254:41103/ using document root <none> and password file <none>
I20260709 13:02:04.096194   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:04.096432   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:04.096745   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:04.098361   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "aa260d0b25dc48cdb34631970851f914"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.103797   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:02:04.107968 10245 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.109294   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:02:04.109691   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "aa260d0b25dc48cdb34631970851f914"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.110042   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:04.152279   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:04.154103   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:04.208390   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46067
I20260709 13:02:04.208511 10296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46067 every 8 connection(s)
I20260709 13:02:04.213558 10297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.228107 10297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914: Bootstrap starting.
I20260709 13:02:04.234917 10297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.240680 10297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914: No bootstrap required, opened a new log
I20260709 13:02:04.243690 10297 raft_consensus.cc:359] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa260d0b25dc48cdb34631970851f914" member_type: VOTER }
I20260709 13:02:04.244266 10297 raft_consensus.cc:385] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.244575 10297 raft_consensus.cc:740] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa260d0b25dc48cdb34631970851f914, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.245359 10297 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa260d0b25dc48cdb34631970851f914" member_type: VOTER }
I20260709 13:02:04.246205 10297 raft_consensus.cc:399] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:04.246750 10297 raft_consensus.cc:493] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:04.247125 10297 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.253093 10297 raft_consensus.cc:515] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa260d0b25dc48cdb34631970851f914" member_type: VOTER }
I20260709 13:02:04.253804 10297 leader_election.cc:304] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa260d0b25dc48cdb34631970851f914; no voters: 
I20260709 13:02:04.255223 10297 leader_election.cc:290] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:04.255667 10300 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.257308 10300 raft_consensus.cc:697] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 1 LEADER]: Becoming Leader. State: Replica: aa260d0b25dc48cdb34631970851f914, State: Running, Role: LEADER
I20260709 13:02:04.258330 10300 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa260d0b25dc48cdb34631970851f914" member_type: VOTER }
I20260709 13:02:04.258980 10297 sys_catalog.cc:565] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:04.267655 10302 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa260d0b25dc48cdb34631970851f914. Latest consensus state: current_term: 1 leader_uuid: "aa260d0b25dc48cdb34631970851f914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa260d0b25dc48cdb34631970851f914" member_type: VOTER } }
I20260709 13:02:04.267926 10301 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa260d0b25dc48cdb34631970851f914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa260d0b25dc48cdb34631970851f914" member_type: VOTER } }
I20260709 13:02:04.268632 10302 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:04.268893 10301 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:04.271129 10310 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:04.277401 10310 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:04.278682   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:04.289340 10310 catalog_manager.cc:1383] Generated new cluster ID: 36b340a608094463afbcef2988ac0f1e
I20260709 13:02:04.289781 10310 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:04.319813 10310 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:04.321429 10310 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:04.338330 10310 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914: Generated new TSK 0
I20260709 13:02:04.339170 10310 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:04.346930   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:04.356086 10318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.357069 10319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.358651 10321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:04.361583   431 server_base.cc:1061] running on GCE node
I20260709 13:02:04.364300   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:04.364564   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:04.364769   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602124364750 us; error 0 us; skew 500 ppm
I20260709 13:02:04.365430   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:04.368597   431 webserver.cc:533] Webserver started at http://127.0.107.193:35353/ using document root <none> and password file <none>
I20260709 13:02:04.369228   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:04.369453   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:04.369836   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:04.371996   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "b4af86c3867e41659d5499027b08b924"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.378031   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:04.382853 10326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.384034   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:04.384508   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "b4af86c3867e41659d5499027b08b924"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.384931   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:04.400385   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:04.401997   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:04.403828   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:04.406819   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:04.407070   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.407383   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:04.407646   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:04.463356   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41529
I20260709 13:02:04.463474 10388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41529 every 8 connection(s)
I20260709 13:02:04.469595   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:04.479470 10393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.481369 10394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.484434 10396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:04.486395   431 server_base.cc:1061] running on GCE node
I20260709 13:02:04.489799   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:04.490172   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:04.490383   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602124490366 us; error 0 us; skew 500 ppm
I20260709 13:02:04.491349   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:04.491671 10389 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46067
I20260709 13:02:04.492238 10389 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:04.493461 10389 heartbeater.cc:507] Master 127.0.107.254:46067 requested a full tablet report, sending...
I20260709 13:02:04.494692   431 webserver.cc:533] Webserver started at http://127.0.107.194:39507/ using document root <none> and password file <none>
I20260709 13:02:04.495473   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:04.495774   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:04.496136   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:04.496366 10262 ts_manager.cc:194] Registered new tserver with Master: b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:04.498275   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "2fde7d06ee724b9bb005a69743b50211"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.499498 10262 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42960
I20260709 13:02:04.504835   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:04.509300 10401 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.510282   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:02:04.510751   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "2fde7d06ee724b9bb005a69743b50211"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.511102   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:04.562608   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:04.564915   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:04.566967   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:04.570418   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:04.570904   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.571277   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:04.571482   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.629539   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36833
I20260709 13:02:04.629778 10464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36833 every 8 connection(s)
I20260709 13:02:04.637951   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:04.649748 10468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.650786 10469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:04.654376   431 server_base.cc:1061] running on GCE node
W20260709 13:02:04.654397 10471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:04.656272   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:04.656669   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:04.657138   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602124657105 us; error 0 us; skew 500 ppm
I20260709 13:02:04.657323 10465 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46067
I20260709 13:02:04.657816 10465 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:04.658107   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:04.659067 10465 heartbeater.cc:507] Master 127.0.107.254:46067 requested a full tablet report, sending...
I20260709 13:02:04.663479   431 webserver.cc:533] Webserver started at http://127.0.107.195:35295/ using document root <none> and password file <none>
I20260709 13:02:04.663949 10262 ts_manager.cc:194] Registered new tserver with Master: 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:04.664529   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:04.664913   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:04.665380   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:04.666919 10262 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42966
I20260709 13:02:04.667984   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "ed955e6936204882a741c58f33790c5d"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.674974   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:04.679677 10476 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.680753   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:02:04.681123   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "ed955e6936204882a741c58f33790c5d"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.681432   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:04.696605   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:04.698114   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:04.700058   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:04.702768   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:04.703070   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.703377   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:04.703544   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.760144   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41119
I20260709 13:02:04.760258 10538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41119 every 8 connection(s)
I20260709 13:02:04.766984   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:04.776906 10542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.777383 10543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:04.784996 10545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:04.786258 10539 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46067
I20260709 13:02:04.786388   431 server_base.cc:1061] running on GCE node
I20260709 13:02:04.787034 10539 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:04.787812   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:04.788168   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:04.788300 10539 heartbeater.cc:507] Master 127.0.107.254:46067 requested a full tablet report, sending...
I20260709 13:02:04.788393   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602124788369 us; error 0 us; skew 500 ppm
I20260709 13:02:04.789880   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:04.791358 10262 ts_manager.cc:194] Registered new tserver with Master: ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:04.793394   431 webserver.cc:533] Webserver started at http://127.0.107.196:46219/ using document root <none> and password file <none>
I20260709 13:02:04.793411 10262 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42982
I20260709 13:02:04.794305   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:04.794636   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:04.795045   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:04.796710   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-3-root/instance:
uuid: "40a50bcbfe194a288c6b3333e6556a88"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.802455   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:02:04.806927 10550 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.808256   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:04.808698   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-3-root
uuid: "40a50bcbfe194a288c6b3333e6556a88"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:04.809053   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:04.837224   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:04.838847   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:04.840407   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:04.843595   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:04.843900   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.844194   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:04.844395   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:04.899384   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:37525
I20260709 13:02:04.899850 10612 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:37525 every 8 connection(s)
I20260709 13:02:04.918645 10613 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46067
I20260709 13:02:04.919075 10613 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:04.920049 10613 heartbeater.cc:507] Master 127.0.107.254:46067 requested a full tablet report, sending...
I20260709 13:02:04.922740 10262 ts_manager.cc:194] Registered new tserver with Master: 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:04.923202   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01920014s
I20260709 13:02:04.925315 10262 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42984
I20260709 13:02:04.958896 10262 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42988:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:02:05.227213 10354 tablet_service.cc:1511] Processing CreateTablet for tablet c547c7ecd9274a4fa127dcf61445590a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:05.227715 10353 tablet_service.cc:1511] Processing CreateTablet for tablet 6301e11540ca4c42bddb309293400170 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:05.232842 10352 tablet_service.cc:1511] Processing CreateTablet for tablet 37a9031573e34c528ad0e50e5bde3015 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:05.235217 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c547c7ecd9274a4fa127dcf61445590a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.237848 10351 tablet_service.cc:1511] Processing CreateTablet for tablet 36a8d77410064b2298c3e33291b7ea3b (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:05.242610 10351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a8d77410064b2298c3e33291b7ea3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.245870 10350 tablet_service.cc:1511] Processing CreateTablet for tablet 381f75d00c3144139bbb5c22358f074c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:05.248786 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6301e11540ca4c42bddb309293400170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.252956 10350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381f75d00c3144139bbb5c22358f074c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.256211 10349 tablet_service.cc:1511] Processing CreateTablet for tablet 72a5e078776b4a799080a281d489ff87 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:05.258616 10349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a5e078776b4a799080a281d489ff87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.260016 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a9031573e34c528ad0e50e5bde3015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.264148 10348 tablet_service.cc:1511] Processing CreateTablet for tablet ed55aa25a52d4bfe80269832e6be5f47 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:05.267608 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 581df3f2a4a94df5adb7fc58515064fb (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
W20260709 13:02:05.272670 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:05.269474 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581df3f2a4a94df5adb7fc58515064fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.281195 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5fd742ea894da9b9667696dc71cf12 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:05.281909 10348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed55aa25a52d4bfe80269832e6be5f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.285593 10345 tablet_service.cc:1511] Processing CreateTablet for tablet 132b7f2c040940b0898fde87b644800c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:05.287566 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5fd742ea894da9b9667696dc71cf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.293022 10345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132b7f2c040940b0898fde87b644800c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.298460 10578 tablet_service.cc:1511] Processing CreateTablet for tablet c547c7ecd9274a4fa127dcf61445590a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:05.300882 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c547c7ecd9274a4fa127dcf61445590a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.314276 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 37a9031573e34c528ad0e50e5bde3015 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:05.317628 10576 tablet_service.cc:1511] Processing CreateTablet for tablet bd989738e393402cbf22e78c22cde23d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:05.320725 10575 tablet_service.cc:1511] Processing CreateTablet for tablet 381f75d00c3144139bbb5c22358f074c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:05.323890 10574 tablet_service.cc:1511] Processing CreateTablet for tablet 72a5e078776b4a799080a281d489ff87 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:05.323985 10573 tablet_service.cc:1511] Processing CreateTablet for tablet e35e1c88c6584293ac3dcd5eafc80a3e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:05.329814 10572 tablet_service.cc:1511] Processing CreateTablet for tablet 581df3f2a4a94df5adb7fc58515064fb (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:05.332578 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a9031573e34c528ad0e50e5bde3015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.333287 10571 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5fd742ea894da9b9667696dc71cf12 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:05.335099 10571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5fd742ea894da9b9667696dc71cf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.344920 10572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581df3f2a4a94df5adb7fc58515064fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.346900 10575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381f75d00c3144139bbb5c22358f074c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.349839 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35e1c88c6584293ac3dcd5eafc80a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.352566 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a5e078776b4a799080a281d489ff87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.354523 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd989738e393402cbf22e78c22cde23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.354035 10570 tablet_service.cc:1511] Processing CreateTablet for tablet d50fb1dd837e4c39b8f6f5fa40e3002d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:05.356396 10570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50fb1dd837e4c39b8f6f5fa40e3002d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.365734 10569 tablet_service.cc:1511] Processing CreateTablet for tablet 6866a2c25fa64b6987b969ccaf9ce324 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:05.367988 10569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6866a2c25fa64b6987b969ccaf9ce324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.378607 10504 tablet_service.cc:1511] Processing CreateTablet for tablet 6301e11540ca4c42bddb309293400170 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:05.380636 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6301e11540ca4c42bddb309293400170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.396592 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 37a9031573e34c528ad0e50e5bde3015 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:05.398653 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a9031573e34c528ad0e50e5bde3015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.398622 10502 tablet_service.cc:1511] Processing CreateTablet for tablet bd989738e393402cbf22e78c22cde23d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:05.401225 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 6866a2c25fa64b6987b969ccaf9ce324 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:05.402882 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6866a2c25fa64b6987b969ccaf9ce324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.407807 10502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd989738e393402cbf22e78c22cde23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.407914 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 36a8d77410064b2298c3e33291b7ea3b (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:05.409817 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a8d77410064b2298c3e33291b7ea3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.407425 10352 tablet_service.cc:1511] Processing CreateTablet for tablet 118b0cf2ac56453abf589a611a7d9c7d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:05.416730 10500 tablet_service.cc:1511] Processing CreateTablet for tablet 72a5e078776b4a799080a281d489ff87 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:05.418836 10499 tablet_service.cc:1511] Processing CreateTablet for tablet e35e1c88c6584293ac3dcd5eafc80a3e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:05.419942 10500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a5e078776b4a799080a281d489ff87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.419955 10498 tablet_service.cc:1511] Processing CreateTablet for tablet ed55aa25a52d4bfe80269832e6be5f47 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:05.420855 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35e1c88c6584293ac3dcd5eafc80a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.421729 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed55aa25a52d4bfe80269832e6be5f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.424973 10497 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5fd742ea894da9b9667696dc71cf12 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:05.426468 10632 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:05.426815 10497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5fd742ea894da9b9667696dc71cf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.403637 10345 tablet_service.cc:1511] Processing CreateTablet for tablet 4db3331e816f4156a1d2bca954a3254a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:05.401225 10354 tablet_service.cc:1511] Processing CreateTablet for tablet 864793e789784a5dac120669f112203e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:05.437114 10496 tablet_service.cc:1511] Processing CreateTablet for tablet d50fb1dd837e4c39b8f6f5fa40e3002d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:05.438802 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50fb1dd837e4c39b8f6f5fa40e3002d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.440471 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118b0cf2ac56453abf589a611a7d9c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.446166 10430 tablet_service.cc:1511] Processing CreateTablet for tablet c547c7ecd9274a4fa127dcf61445590a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:05.454806 10427 tablet_service.cc:1511] Processing CreateTablet for tablet 36a8d77410064b2298c3e33291b7ea3b (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:05.455406 10429 tablet_service.cc:1511] Processing CreateTablet for tablet 6301e11540ca4c42bddb309293400170 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:05.456542 10427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a8d77410064b2298c3e33291b7ea3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.459419 10426 tablet_service.cc:1511] Processing CreateTablet for tablet 381f75d00c3144139bbb5c22358f074c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:05.460999 10426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381f75d00c3144139bbb5c22358f074c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.463001 10345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db3331e816f4156a1d2bca954a3254a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.465448 10425 tablet_service.cc:1511] Processing CreateTablet for tablet e35e1c88c6584293ac3dcd5eafc80a3e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:05.467173 10421 tablet_service.cc:1511] Processing CreateTablet for tablet 132b7f2c040940b0898fde87b644800c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:05.468465 10428 tablet_service.cc:1511] Processing CreateTablet for tablet bd989738e393402cbf22e78c22cde23d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:05.468979 10424 tablet_service.cc:1511] Processing CreateTablet for tablet ed55aa25a52d4bfe80269832e6be5f47 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:05.472091 10423 tablet_service.cc:1511] Processing CreateTablet for tablet 581df3f2a4a94df5adb7fc58515064fb (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:05.475823 10422 tablet_service.cc:1511] Processing CreateTablet for tablet d50fb1dd837e4c39b8f6f5fa40e3002d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:05.467293 10425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35e1c88c6584293ac3dcd5eafc80a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.478534 10421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132b7f2c040940b0898fde87b644800c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.479358 10424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed55aa25a52d4bfe80269832e6be5f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.481366 10422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50fb1dd837e4c39b8f6f5fa40e3002d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.484014 10428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd989738e393402cbf22e78c22cde23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.486248 10430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c547c7ecd9274a4fa127dcf61445590a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.488062 10423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581df3f2a4a94df5adb7fc58515064fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.492028 10429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6301e11540ca4c42bddb309293400170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.492703 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864793e789784a5dac120669f112203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.496052 10495 tablet_service.cc:1511] Processing CreateTablet for tablet 132b7f2c040940b0898fde87b644800c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:05.497687 10495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132b7f2c040940b0898fde87b644800c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.503661 10389 heartbeater.cc:499] Master 127.0.107.254:46067 was elected leader, sending a full tablet report...
I20260709 13:02:05.505190 10353 tablet_service.cc:1511] Processing CreateTablet for tablet 99a9b8a588f84978934f47ceffea9d2a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:05.506263 10346 tablet_service.cc:1511] Processing CreateTablet for tablet c8a410e026f642eb97377be90f0dc9ab (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:05.508941 10348 tablet_service.cc:1511] Processing CreateTablet for tablet ae1f28de88884353873810960e00d35c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:05.519650 10349 tablet_service.cc:1511] Processing CreateTablet for tablet 631a548ad91f4394897a0ef36cea3bdf (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:05.525466 10633 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:05.543467 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 864793e789784a5dac120669f112203e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:05.556740 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a410e026f642eb97377be90f0dc9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.564250 10502 tablet_service.cc:1511] Processing CreateTablet for tablet b2456423bc7e4fd4988ce285a04ee8a1 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:05.567818 10351 tablet_service.cc:1511] Processing CreateTablet for tablet 50b9587e02da4951a1c992d06ee8006d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:05.574024 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a9b8a588f84978934f47ceffea9d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.584435 10504 tablet_service.cc:1511] Processing CreateTablet for tablet f4eaf8c0162a428796c30899aa6e302a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:05.620602 10634 tablet_bootstrap.cc:492] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:05.591403 10350 tablet_service.cc:1511] Processing CreateTablet for tablet c89b77affa074e7a82bc912e20e383b0 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:05.624341 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4eaf8c0162a428796c30899aa6e302a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.628387 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864793e789784a5dac120669f112203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.593212 10421 tablet_service.cc:1511] Processing CreateTablet for tablet c89b77affa074e7a82bc912e20e383b0 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:05.631394 10348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f28de88884353873810960e00d35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.630929 10570 tablet_service.cc:1511] Processing CreateTablet for tablet f4eaf8c0162a428796c30899aa6e302a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:05.632278 10351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b9587e02da4951a1c992d06ee8006d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.632750 10570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4eaf8c0162a428796c30899aa6e302a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.632278 10421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89b77affa074e7a82bc912e20e383b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.636270 10349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631a548ad91f4394897a0ef36cea3bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.642364 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 4db3331e816f4156a1d2bca954a3254a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:05.644177 10350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89b77affa074e7a82bc912e20e383b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.591007 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 864793e789784a5dac120669f112203e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:05.659067 10633 tablet_bootstrap.cc:654] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.663098 10571 tablet_service.cc:1511] Processing CreateTablet for tablet 118b0cf2ac56453abf589a611a7d9c7d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:05.676940 10571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118b0cf2ac56453abf589a611a7d9c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.670778 10465 heartbeater.cc:499] Master 127.0.107.254:46067 was elected leader, sending a full tablet report...
I20260709 13:02:05.607365 10347 tablet_service.cc:1511] Processing CreateTablet for tablet b2456423bc7e4fd4988ce285a04ee8a1 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:05.682952 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2456423bc7e4fd4988ce285a04ee8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.668680 10635 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:05.643844 10426 tablet_service.cc:1511] Processing CreateTablet for tablet f4eaf8c0162a428796c30899aa6e302a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:05.678501 10423 tablet_service.cc:1511] Processing CreateTablet for tablet 6866a2c25fa64b6987b969ccaf9ce324 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:05.700891 10502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2456423bc7e4fd4988ce285a04ee8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.707823 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 99a9b8a588f84978934f47ceffea9d2a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:05.712265 10352 tablet_service.cc:1511] Processing CreateTablet for tablet 83813c5ebc124df1a2eac0d37f2e6393 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:05.714251 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83813c5ebc124df1a2eac0d37f2e6393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.720597 10426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4eaf8c0162a428796c30899aa6e302a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.723904 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db3331e816f4156a1d2bca954a3254a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.725660 10499 tablet_service.cc:1511] Processing CreateTablet for tablet c7974ab2c9b84e089e68b0dbd4927373 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:05.726675 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864793e789784a5dac120669f112203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.734409 10428 tablet_service.cc:1511] Processing CreateTablet for tablet 4db3331e816f4156a1d2bca954a3254a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:05.741153 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 99a9b8a588f84978934f47ceffea9d2a (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:05.742712 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a9b8a588f84978934f47ceffea9d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.732333 10634 tablet_bootstrap.cc:654] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.753032 10635 tablet_bootstrap.cc:654] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.744352 10428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db3331e816f4156a1d2bca954a3254a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.761683 10632 tablet_bootstrap.cc:654] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.744890 10424 tablet_service.cc:1511] Processing CreateTablet for tablet 118b0cf2ac56453abf589a611a7d9c7d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:05.726845 10577 tablet_service.cc:1511] Processing CreateTablet for tablet c7974ab2c9b84e089e68b0dbd4927373 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:05.772831 10497 tablet_service.cc:1511] Processing CreateTablet for tablet c8a410e026f642eb97377be90f0dc9ab (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:05.774550 10424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118b0cf2ac56453abf589a611a7d9c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.770876 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7974ab2c9b84e089e68b0dbd4927373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.798331 10539 heartbeater.cc:499] Master 127.0.107.254:46067 was elected leader, sending a full tablet report...
I20260709 13:02:05.799715 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4ae9839c944dbaa83cf17b5a5d5170 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:05.801460 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4ae9839c944dbaa83cf17b5a5d5170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.796689 10423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6866a2c25fa64b6987b969ccaf9ce324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.808753 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a9b8a588f84978934f47ceffea9d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.796689 10569 tablet_service.cc:1511] Processing CreateTablet for tablet 631a548ad91f4394897a0ef36cea3bdf (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:05.813829 10497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a410e026f642eb97377be90f0dc9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.826650 10425 tablet_service.cc:1511] Processing CreateTablet for tablet c8a410e026f642eb97377be90f0dc9ab (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:05.814090 10572 tablet_service.cc:1511] Processing CreateTablet for tablet ae1f28de88884353873810960e00d35c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:05.827253 10348 tablet_service.cc:1511] Processing CreateTablet for tablet e0d3e1641b72401f95b94e0484eb0aa2 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:05.829219 10496 tablet_service.cc:1511] Processing CreateTablet for tablet 631a548ad91f4394897a0ef36cea3bdf (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:05.830008 10348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d3e1641b72401f95b94e0484eb0aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.830838 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631a548ad91f4394897a0ef36cea3bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.841856 10495 tablet_service.cc:1511] Processing CreateTablet for tablet c37a3271e472433d9feb62b8343643e7 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:05.856993 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 50b9587e02da4951a1c992d06ee8006d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:05.862443 10430 tablet_service.cc:1511] Processing CreateTablet for tablet ae1f28de88884353873810960e00d35c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:05.865983 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7974ab2c9b84e089e68b0dbd4927373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.867103 10573 tablet_service.cc:1511] Processing CreateTablet for tablet c37a3271e472433d9feb62b8343643e7 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:05.867103 10504 tablet_service.cc:1511] Processing CreateTablet for tablet 9860e256ccdf41ad8f40aee782e8dac8 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:05.873737 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37a3271e472433d9feb62b8343643e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.873124 10575 tablet_service.cc:1511] Processing CreateTablet for tablet c89b77affa074e7a82bc912e20e383b0 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:05.876173 10569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631a548ad91f4394897a0ef36cea3bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.881440 10572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f28de88884353873810960e00d35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.873124 10422 tablet_service.cc:1511] Processing CreateTablet for tablet c7974ab2c9b84e089e68b0dbd4927373 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:05.886344 10575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89b77affa074e7a82bc912e20e383b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.843477 10495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37a3271e472433d9feb62b8343643e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.903630 10574 tablet_service.cc:1511] Processing CreateTablet for tablet b2456423bc7e4fd4988ce285a04ee8a1 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:05.905377 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2456423bc7e4fd4988ce285a04ee8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.913712 10353 tablet_service.cc:1511] Processing CreateTablet for tablet f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:05.898733 10426 tablet_service.cc:1511] Processing CreateTablet for tablet 50b9587e02da4951a1c992d06ee8006d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:05.900053 10422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7974ab2c9b84e089e68b0dbd4927373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.922456 10426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b9587e02da4951a1c992d06ee8006d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.867612 10427 tablet_service.cc:1511] Processing CreateTablet for tablet c37a3271e472433d9feb62b8343643e7 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:05.926399 10427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37a3271e472433d9feb62b8343643e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.929703 10613 heartbeater.cc:499] Master 127.0.107.254:46067 was elected leader, sending a full tablet report...
I20260709 13:02:05.932394 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b9587e02da4951a1c992d06ee8006d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.937898 10429 tablet_service.cc:1511] Processing CreateTablet for tablet 9860e256ccdf41ad8f40aee782e8dac8 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:05.958220 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9860e256ccdf41ad8f40aee782e8dac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.958165 10430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f28de88884353873810960e00d35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.976814 10571 tablet_service.cc:1511] Processing CreateTablet for tablet 9860e256ccdf41ad8f40aee782e8dac8 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:05.978641 10571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9860e256ccdf41ad8f40aee782e8dac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.983892 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d5c2fee8bc4c7cb4ec2dceb9b5ca36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.988766 10429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9860e256ccdf41ad8f40aee782e8dac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.020718 10633 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:06.021407 10633 ts_tablet_manager.cc:1403] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.496s	user 0.026s	sys 0.014s
I20260709 13:02:06.023070 10635 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:06.023732 10635 ts_tablet_manager.cc:1403] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.356s	user 0.021s	sys 0.016s
I20260709 13:02:06.024693 10425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a410e026f642eb97377be90f0dc9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.025321 10633 raft_consensus.cc:359] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:06.026794 10633 raft_consensus.cc:385] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.027185 10633 raft_consensus.cc:740] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.028481 10633 consensus_queue.cc:260] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:06.035307 10428 tablet_service.cc:1511] Processing CreateTablet for tablet 83813c5ebc124df1a2eac0d37f2e6393 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:06.040544 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4ae9839c944dbaa83cf17b5a5d5170 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:06.041486 10497 tablet_service.cc:1511] Processing CreateTablet for tablet 83813c5ebc124df1a2eac0d37f2e6393 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:06.045748 10634 tablet_bootstrap.cc:492] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:06.087539 10634 ts_tablet_manager.cc:1403] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.467s	user 0.023s	sys 0.000s
I20260709 13:02:06.057531 10497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83813c5ebc124df1a2eac0d37f2e6393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.058501 10498 tablet_service.cc:1511] Processing CreateTablet for tablet e0d3e1641b72401f95b94e0484eb0aa2 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:06.062638 10570 tablet_service.cc:1511] Processing CreateTablet for tablet e0d3e1641b72401f95b94e0484eb0aa2 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:06.068289 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4ae9839c944dbaa83cf17b5a5d5170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.068054 10635 raft_consensus.cc:359] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:06.052030 10249 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 53773.4us
I20260709 13:02:06.077837 10500 tablet_service.cc:1511] Processing CreateTablet for tablet 57e71410999946be9e5e39330a0b5d55 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:06.079205 10632 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:06.083041 10428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83813c5ebc124df1a2eac0d37f2e6393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.085500 10421 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4ae9839c944dbaa83cf17b5a5d5170 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:06.105763 10632 ts_tablet_manager.cc:1403] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.679s	user 0.028s	sys 0.054s
I20260709 13:02:06.098848 10635 raft_consensus.cc:385] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.108028 10635 raft_consensus.cc:740] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.108470 10578 tablet_service.cc:1511] Processing CreateTablet for tablet deea6823d2534b959728fc210dd07642 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:06.109261 10635 consensus_queue.cc:260] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:06.104527 10573 tablet_service.cc:1511] Processing CreateTablet for tablet 57e71410999946be9e5e39330a0b5d55 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:06.112689 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deea6823d2534b959728fc210dd07642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.116036 10570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d3e1641b72401f95b94e0484eb0aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.117045 10632 raft_consensus.cc:359] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:06.118000 10632 raft_consensus.cc:385] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.118338 10632 raft_consensus.cc:740] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.124399 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e71410999946be9e5e39330a0b5d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.137063 10633 ts_tablet_manager.cc:1434] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.006s
I20260709 13:02:06.143530 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d3e1641b72401f95b94e0484eb0aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.152084 10500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e71410999946be9e5e39330a0b5d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.154907 10577 tablet_service.cc:1511] Processing CreateTablet for tablet d8efb10cd18e427c897514fa94979888 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:06.156620 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8efb10cd18e427c897514fa94979888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.156826 10352 tablet_service.cc:1511] Processing CreateTablet for tablet deea6823d2534b959728fc210dd07642 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:06.158469 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deea6823d2534b959728fc210dd07642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.160625 10633 tablet_bootstrap.cc:492] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:06.167949 10632 consensus_queue.cc:260] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:06.174674 10635 ts_tablet_manager.cc:1434] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.150s	user 0.009s	sys 0.003s
I20260709 13:02:06.176594 10421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4ae9839c944dbaa83cf17b5a5d5170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.185211 10424 tablet_service.cc:1511] Processing CreateTablet for tablet 57e71410999946be9e5e39330a0b5d55 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:06.186695 10424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e71410999946be9e5e39330a0b5d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.188382 10423 tablet_service.cc:1511] Processing CreateTablet for tablet deea6823d2534b959728fc210dd07642 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:06.192966 10634 raft_consensus.cc:359] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.193801 10634 raft_consensus.cc:385] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.193804 10423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deea6823d2534b959728fc210dd07642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.194182 10634 raft_consensus.cc:740] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.195981 10496 tablet_service.cc:1511] Processing CreateTablet for tablet f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:06.189544 10635 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:06.197580 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d5c2fee8bc4c7cb4ec2dceb9b5ca36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.190312 10422 tablet_service.cc:1511] Processing CreateTablet for tablet f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:06.220446 10422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d5c2fee8bc4c7cb4ec2dceb9b5ca36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.195010 10634 consensus_queue.cc:260] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.224419 10503 tablet_service.cc:1511] Processing CreateTablet for tablet d8efb10cd18e427c897514fa94979888 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:06.226042 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8efb10cd18e427c897514fa94979888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.227201 10640 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.227946 10640 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:06.257088 10575 tablet_service.cc:1511] Processing CreateTablet for tablet 8888b8a7dea849eeb0d1a87c9a347e9c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:06.258061 10353 tablet_service.cc:1511] Processing CreateTablet for tablet ade59aed1b7f49f2ae404b4f1f714521 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:06.258688 10575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8888b8a7dea849eeb0d1a87c9a347e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.264813 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade59aed1b7f49f2ae404b4f1f714521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.236243 10640 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:06.278048 10540 tablet.cc:2406] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:06.280707 10633 tablet_bootstrap.cc:654] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.243904 10346 tablet_service.cc:1511] Processing CreateTablet for tablet d8efb10cd18e427c897514fa94979888 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:06.302393 10635 tablet_bootstrap.cc:654] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.302935 10643 raft_consensus.cc:493] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.312247 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8efb10cd18e427c897514fa94979888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:06.315220 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:06.331712 10643 raft_consensus.cc:515] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:06.349352 10643 leader_election.cc:290] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:06.373871 10632 ts_tablet_manager.cc:1434] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.267s	user 0.032s	sys 0.013s
I20260709 13:02:06.373363 10504 tablet_service.cc:1511] Processing CreateTablet for tablet 8888b8a7dea849eeb0d1a87c9a347e9c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:06.375923 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8888b8a7dea849eeb0d1a87c9a347e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.378180 10633 tablet_bootstrap.cc:492] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:06.378921 10633 ts_tablet_manager.cc:1403] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.010s
I20260709 13:02:06.381071 10501 tablet_service.cc:1511] Processing CreateTablet for tablet ade59aed1b7f49f2ae404b4f1f714521 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:06.382702 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade59aed1b7f49f2ae404b4f1f714521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.390775 10633 raft_consensus.cc:359] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.397140 10633 raft_consensus.cc:385] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.402982 10633 raft_consensus.cc:740] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.404464 10641 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.405508 10641 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:06.369236 10429 tablet_service.cc:1511] Processing CreateTablet for tablet 8888b8a7dea849eeb0d1a87c9a347e9c (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:06.392679 10632 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:06.404170 10634 ts_tablet_manager.cc:1434] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.316s	user 0.008s	sys 0.008s
I20260709 13:02:06.432736 10429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8888b8a7dea849eeb0d1a87c9a347e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.445071 10644 raft_consensus.cc:493] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.446025 10644 raft_consensus.cc:515] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.412216 10641 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:06.449483 10644 leader_election.cc:290] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:06.478904 10634 tablet_bootstrap.cc:492] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:06.427974 10633 consensus_queue.cc:260] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.484754 10350 tablet_service.cc:1511] Processing CreateTablet for tablet 02a30d488569446dbc9a32630b2e3094 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:06.443616 10423 tablet_service.cc:1511] Processing CreateTablet for tablet ade59aed1b7f49f2ae404b4f1f714521 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:06.496104 10635 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:06.503078 10350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a30d488569446dbc9a32630b2e3094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.506690 10573 tablet_service.cc:1511] Processing CreateTablet for tablet 02a30d488569446dbc9a32630b2e3094 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:06.508242 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a30d488569446dbc9a32630b2e3094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.504127 10635 ts_tablet_manager.cc:1403] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.313s	user 0.027s	sys 0.034s
I20260709 13:02:06.516093 10495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42130 (request call id 17) took 1013 ms. Trace:
I20260709 13:02:06.516778 10495 rpcz_store.cc:276] 0709 13:02:05.502396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.840710 (+338314us) service_pool.cc:224] Handling call
0709 13:02:05.842900 (+  2190us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:05.843016 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:06.134706 (+291690us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:06.511380 (+376674us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:06.516008 (+  4628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:06.511732 10633 ts_tablet_manager.cc:1434] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.132s	user 0.006s	sys 0.004s
I20260709 13:02:06.530790 10633 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:06.562866 10634 tablet_bootstrap.cc:654] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.571187 10426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35928 (request call id 18) took 1093 ms. Trace:
I20260709 13:02:06.571960 10426 rpcz_store.cc:276] 0709 13:02:05.477345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.897360 (+420015us) service_pool.cc:224] Handling call
0709 13:02:05.921859 (+ 24499us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:05.921981 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:06.194743 (+272762us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:06.570282 (+375539us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:06.571110 (+   828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:06.552129 10423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade59aed1b7f49f2ae404b4f1f714521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.597081 10424 tablet_service.cc:1511] Processing CreateTablet for tablet 02a30d488569446dbc9a32630b2e3094 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:06.602753 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6aa222767c4a49a4e9bf41a65e1c30 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:06.604899 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6aa222767c4a49a4e9bf41a65e1c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.608116 10426 tablet_service.cc:1511] Processing CreateTablet for tablet 674a2e3712f54be4898228175becf617 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:06.610613 10632 tablet_bootstrap.cc:654] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.616706 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:06.619560 10403 leader_election.cc:343] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.625108 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6aa222767c4a49a4e9bf41a65e1c30 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:06.633713 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6aa222767c4a49a4e9bf41a65e1c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.623420 10635 raft_consensus.cc:359] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:06.599462 10424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a30d488569446dbc9a32630b2e3094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.648200 10635 raft_consensus.cc:385] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.670054 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6aa222767c4a49a4e9bf41a65e1c30 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:06.672189 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6aa222767c4a49a4e9bf41a65e1c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.672333 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:06.673979 10426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674a2e3712f54be4898228175becf617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.674726 10570 tablet_service.cc:1511] Processing CreateTablet for tablet 674a2e3712f54be4898228175becf617 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:06.676263 10570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674a2e3712f54be4898228175becf617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.676313 10504 tablet_service.cc:1511] Processing CreateTablet for tablet 674a2e3712f54be4898228175becf617 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:06.677958 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674a2e3712f54be4898228175becf617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.681128 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:06.682986 10478 leader_election.cc:343] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.682822 10640 raft_consensus.cc:493] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.665968 10633 tablet_bootstrap.cc:654] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.688092 10640 raft_consensus.cc:515] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.716143 10569 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb87559b16a496fba5bb8b6fb3248a5 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:06.717908 10569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb87559b16a496fba5bb8b6fb3248a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.718487 10640 leader_election.cc:290] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:06.691183 10350 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc89042adb84e11abc2a012b5c30358 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:06.720630 10350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc89042adb84e11abc2a012b5c30358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.694840 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed66d8d97d2426a851e3fcccde152e5 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:06.724747 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed66d8d97d2426a851e3fcccde152e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.697479 10429 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc89042adb84e11abc2a012b5c30358 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:06.728730 10429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc89042adb84e11abc2a012b5c30358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.731845 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a9031573e34c528ad0e50e5bde3015" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:06.732918 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:06.698678 10480 leader_election.cc:343] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.702019 10353 tablet_service.cc:1511] Processing CreateTablet for tablet 9895e4e5d09f4753aa274460cf68c95d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:06.703979 10352 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed66d8d97d2426a851e3fcccde152e5 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:06.738448 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9895e4e5d09f4753aa274460cf68c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.739586 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed66d8d97d2426a851e3fcccde152e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.739169 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce1ab0a022b49e09aa7b7a686bff66b (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:06.740667 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce1ab0a022b49e09aa7b7a686bff66b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:06.740898 10554 leader_election.cc:343] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.744789 10422 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb87559b16a496fba5bb8b6fb3248a5 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:06.746461 10422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb87559b16a496fba5bb8b6fb3248a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.747188 10345 tablet_service.cc:1511] Processing CreateTablet for tablet c1de15bd8c8446e5a4a1ead763021708 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:06.705065 10351 tablet_service.cc:1511] Processing CreateTablet for tablet dcee36daa5d94e96826a33c6f6bc52b9 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:06.708772 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 9895e4e5d09f4753aa274460cf68c95d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:06.711387 10421 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed66d8d97d2426a851e3fcccde152e5 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 13:02:06.749604 10330 leader_election.cc:343] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.714080 10634 tablet_bootstrap.cc:492] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:06.750222 10349 tablet_service.cc:1511] Processing CreateTablet for tablet 0a946d8672ce4315b453f1d418d5f197 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:06.750864 10634 ts_tablet_manager.cc:1403] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.286s	user 0.015s	sys 0.006s
I20260709 13:02:06.754616 10634 raft_consensus.cc:359] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.661880 10635 raft_consensus.cc:740] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.745033 10354 tablet_service.cc:1511] Processing CreateTablet for tablet 1787e8259fbe45eca97480c9dacb51ff (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:06.756016 10421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed66d8d97d2426a851e3fcccde152e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.715407 10348 tablet_service.cc:1511] Processing CreateTablet for tablet 011d181df5e24eca9a3124fa9442fe94 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:06.758564 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9895e4e5d09f4753aa274460cf68c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.765230 10345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1de15bd8c8446e5a4a1ead763021708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.766163 10351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcee36daa5d94e96826a33c6f6bc52b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.766865 10348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d181df5e24eca9a3124fa9442fe94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.770931 10349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a946d8672ce4315b453f1d418d5f197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.773646 10430 tablet_service.cc:1511] Processing CreateTablet for tablet dcee36daa5d94e96826a33c6f6bc52b9 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:06.775260 10430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcee36daa5d94e96826a33c6f6bc52b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.776139 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1787e8259fbe45eca97480c9dacb51ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.755458 10634 raft_consensus.cc:385] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.784049 10634 raft_consensus.cc:740] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.785914 10480 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:06.758982 10635 consensus_queue.cc:260] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:06.786979 10640 raft_consensus.cc:2749] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:06.788080 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 89626.8us
I20260709 13:02:06.790009 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd989738e393402cbf22e78c22cde23d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:06.791865 10635 ts_tablet_manager.cc:1434] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.279s	user 0.012s	sys 0.000s
I20260709 13:02:06.785023 10634 consensus_queue.cc:260] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.818775 10426 tablet_service.cc:1511] Processing CreateTablet for tablet 011d181df5e24eca9a3124fa9442fe94 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:06.820762 10426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d181df5e24eca9a3124fa9442fe94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.822815 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a9031573e34c528ad0e50e5bde3015" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:06.825026 10330 leader_election.cc:343] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.825742 10330 leader_election.cc:304] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:06.827242 10643 raft_consensus.cc:2749] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.829538 10425 tablet_service.cc:1511] Processing CreateTablet for tablet 56f8cd4bda3c413c90061d4f6488adc4 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:06.831094 10635 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:06.830749 10573 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce1ab0a022b49e09aa7b7a686bff66b (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:06.831463 10425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f8cd4bda3c413c90061d4f6488adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.833088 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce1ab0a022b49e09aa7b7a686bff66b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.856992 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc89042adb84e11abc2a012b5c30358 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:06.859584 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc89042adb84e11abc2a012b5c30358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.824888 10575 tablet_service.cc:1511] Processing CreateTablet for tablet 011d181df5e24eca9a3124fa9442fe94 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:06.883796 10644 raft_consensus.cc:493] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.884690 10644 raft_consensus.cc:515] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:06.897421 10634 ts_tablet_manager.cc:1434] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.008s
I20260709 13:02:06.897261 10572 tablet_service.cc:1511] Processing CreateTablet for tablet 56f8cd4bda3c413c90061d4f6488adc4 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:06.916325 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:06.918983 10554 leader_election.cc:343] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.924050 10571 tablet_service.cc:1511] Processing CreateTablet for tablet 0a946d8672ce4315b453f1d418d5f197 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:06.924396 10554 leader_election.cc:304] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:06.927335 10632 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:06.926923 10574 tablet_service.cc:1511] Processing CreateTablet for tablet c2b0a40341f84bbc9d3356b9cf50f1fc (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:06.927973 10632 ts_tablet_manager.cc:1403] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.536s	user 0.009s	sys 0.017s
I20260709 13:02:06.920945 10428 tablet_service.cc:1511] Processing CreateTablet for tablet 1787e8259fbe45eca97480c9dacb51ff (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:06.930298 10428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1787e8259fbe45eca97480c9dacb51ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.932549 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb87559b16a496fba5bb8b6fb3248a5 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:06.934325 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb87559b16a496fba5bb8b6fb3248a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.936481 10644 leader_election.cc:290] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:06.937253 10644 raft_consensus.cc:2749] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:06.917179 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 92252.1us
I20260709 13:02:06.922844 10427 tablet_service.cc:1511] Processing CreateTablet for tablet c1de15bd8c8446e5a4a1ead763021708 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:06.940788 10496 tablet_service.cc:1511] Processing CreateTablet for tablet dcee36daa5d94e96826a33c6f6bc52b9 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:06.942497 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcee36daa5d94e96826a33c6f6bc52b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.944029 10427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1de15bd8c8446e5a4a1ead763021708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.953227 10502 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce1ab0a022b49e09aa7b7a686bff66b (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:06.954766 10502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce1ab0a022b49e09aa7b7a686bff66b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.956893 10634 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:06.983151 10635 tablet_bootstrap.cc:654] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:06.983282 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 64361.1us
I20260709 13:02:06.985817 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd989738e393402cbf22e78c22cde23d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:06.989243 10554 leader_election.cc:343] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.003033 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd989738e393402cbf22e78c22cde23d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:07.004040 10514 raft_consensus.cc:2468] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:07.005426 10554 leader_election.cc:304] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:06.979862 10575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d181df5e24eca9a3124fa9442fe94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.015357 10666 raft_consensus.cc:2804] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.015798 10666 raft_consensus.cc:493] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.016137 10666 raft_consensus.cc:3060] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.024549 10570 tablet_service.cc:1511] Processing CreateTablet for tablet c1de15bd8c8446e5a4a1ead763021708 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:07.026324 10570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1de15bd8c8446e5a4a1ead763021708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.004516 10424 tablet_service.cc:1511] Processing CreateTablet for tablet 9420094312cb4ae390240a2dafe35479 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:07.036707 10424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9420094312cb4ae390240a2dafe35479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.036428 10504 tablet_service.cc:1511] Processing CreateTablet for tablet 56f8cd4bda3c413c90061d4f6488adc4 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:07.045063 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f8cd4bda3c413c90061d4f6488adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.035902 10352 tablet_service.cc:1511] Processing CreateTablet for tablet 9420094312cb4ae390240a2dafe35479 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:07.050228 10500 tablet_service.cc:1511] Processing CreateTablet for tablet 1787e8259fbe45eca97480c9dacb51ff (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:07.052129 10500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1787e8259fbe45eca97480c9dacb51ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.054864 10354 tablet_service.cc:1511] Processing CreateTablet for tablet d9a096302f134e2bbd562968364f8d15 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:07.059670 10495 tablet_service.cc:1511] Processing CreateTablet for tablet 0a946d8672ce4315b453f1d418d5f197 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:07.060043 10497 tablet_service.cc:1511] Processing CreateTablet for tablet c2b0a40341f84bbc9d3356b9cf50f1fc (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:07.060621 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 293161fc043b46428f5b233850c4215e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:07.061395 10495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a946d8672ce4315b453f1d418d5f197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.062079 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293161fc043b46428f5b233850c4215e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.062534 10497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b0a40341f84bbc9d3356b9cf50f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.067203 10569 tablet_service.cc:1511] Processing CreateTablet for tablet d9a096302f134e2bbd562968364f8d15 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:07.068665 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:07.070802 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 293161fc043b46428f5b233850c4215e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:07.072250 10641 raft_consensus.cc:493] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.072765 10641 raft_consensus.cc:515] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.072821 10422 tablet_service.cc:1511] Processing CreateTablet for tablet d9a096302f134e2bbd562968364f8d15 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:07.074548 10422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a096302f134e2bbd562968364f8d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.984707 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 9895e4e5d09f4753aa274460cf68c95d (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:07.076730 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f75d00c3144139bbb5c22358f074c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:07.078567 10403 leader_election.cc:343] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.081105 10423 tablet_service.cc:1511] Processing CreateTablet for tablet c2b0a40341f84bbc9d3356b9cf50f1fc (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:07.075248 10641 leader_election.cc:290] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:07.051522 10666 raft_consensus.cc:515] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.088682 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9420094312cb4ae390240a2dafe35479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.090451 10666 leader_election.cc:290] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:07.091310 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd989738e393402cbf22e78c22cde23d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:07.093338 10554 leader_election.cc:343] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.093690 10635 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:07.094053 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd989738e393402cbf22e78c22cde23d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:07.094317 10635 ts_tablet_manager.cc:1403] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.264s	user 0.016s	sys 0.004s
I20260709 13:02:07.094651 10514 raft_consensus.cc:3060] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.099156 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f75d00c3144139bbb5c22358f074c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:07.100950 10405 leader_election.cc:343] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.101467 10405 leader_election.cc:304] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:07.104207 10641 raft_consensus.cc:2749] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.102514 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9895e4e5d09f4753aa274460cf68c95d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:07.083349 10480 leader_election.cc:343] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.108153 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a096302f134e2bbd562968364f8d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.109658 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd989738e393402cbf22e78c22cde23d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:07.110539 10588 raft_consensus.cc:2393] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:07.113796 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 9420094312cb4ae390240a2dafe35479 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 13:02:07.114120 10405 leader_election.cc:343] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.114899 10405 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:07.115483 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9420094312cb4ae390240a2dafe35479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.116303 10641 raft_consensus.cc:2749] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.118474 10349 tablet_service.cc:1511] Processing CreateTablet for tablet 55bc1796a9a64f4ba15df6480a21b893 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:07.120004 10349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bc1796a9a64f4ba15df6480a21b893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.113848 10480 leader_election.cc:304] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:07.125954 10353 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfbdc170b3548d0bf43c26db2aa84d0 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:07.127111 10429 tablet_service.cc:1511] Processing CreateTablet for tablet 32ab34f9dee040f1a9711e01915f2048 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:07.082924 10423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b0a40341f84bbc9d3356b9cf50f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.103283 10632 raft_consensus.cc:359] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.130249 10572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f8cd4bda3c413c90061d4f6488adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.156176 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293161fc043b46428f5b233850c4215e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.157184 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 87f93f10ffda421f83d5b217d03a8288 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:07.158883 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f93f10ffda421f83d5b217d03a8288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.160030 10571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a946d8672ce4315b453f1d418d5f197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.136122 10573 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfbdc170b3548d0bf43c26db2aa84d0 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:07.138311 10635 raft_consensus.cc:359] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.169618 10635 raft_consensus.cc:385] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.170190 10635 raft_consensus.cc:740] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.141645 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 32ab34f9dee040f1a9711e01915f2048 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:07.135478 10632 raft_consensus.cc:385] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.171720 10632 raft_consensus.cc:740] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.146751 10514 raft_consensus.cc:2468] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:07.153206 10633 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:07.136606 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfbdc170b3548d0bf43c26db2aa84d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.168032 10569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a096302f134e2bbd562968364f8d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.177022 10640 raft_consensus.cc:2749] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.178117 10635 consensus_queue.cc:260] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.182873 10554 leader_election.cc:304] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:07.184163 10666 raft_consensus.cc:2804] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.184674 10666 raft_consensus.cc:697] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:07.185567 10666 consensus_queue.cc:237] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.187419 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ab34f9dee040f1a9711e01915f2048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.188198 10496 tablet_service.cc:1511] Processing CreateTablet for tablet 32ab34f9dee040f1a9711e01915f2048 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:07.189808 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ab34f9dee040f1a9711e01915f2048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.193037 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfbdc170b3548d0bf43c26db2aa84d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.210640 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b0a40341f84bbc9d3356b9cf50f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.178170 10429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ab34f9dee040f1a9711e01915f2048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.215716 10635 ts_tablet_manager.cc:1434] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.121s	user 0.003s	sys 0.010s
I20260709 13:02:07.217361 10635 tablet_bootstrap.cc:492] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:07.221460 10427 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfbdc170b3548d0bf43c26db2aa84d0 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:07.223269 10427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfbdc170b3548d0bf43c26db2aa84d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.230413 10641 raft_consensus.cc:493] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.214877 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 55bc1796a9a64f4ba15df6480a21b893 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:07.203920 10633 ts_tablet_manager.cc:1403] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.673s	user 0.024s	sys 0.037s
I20260709 13:02:07.239851 10641 raft_consensus.cc:515] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.242594 10641 leader_election.cc:290] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:07.243716 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:07.254418 10405 leader_election.cc:343] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.246297 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:07.195788 10632 consensus_queue.cc:260] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.281914 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bc1796a9a64f4ba15df6480a21b893. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:07.287957 10403 leader_election.cc:343] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.288655 10403 leader_election.cc:304] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:07.293283 10261 catalog_manager.cc:5697] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.295650 10345 tablet_service.cc:1511] Processing CreateTablet for tablet 87f93f10ffda421f83d5b217d03a8288 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:07.302965 10641 raft_consensus.cc:2749] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.312268 10635 tablet_bootstrap.cc:654] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.312927 10430 tablet_service.cc:1511] Processing CreateTablet for tablet 55bc1796a9a64f4ba15df6480a21b893 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:07.316699 10502 tablet_service.cc:1511] Processing CreateTablet for tablet 87f93f10ffda421f83d5b217d03a8288 (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:07.317444 10632 ts_tablet_manager.cc:1434] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.389s	user 0.013s	sys 0.000s
I20260709 13:02:07.318475 10502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f93f10ffda421f83d5b217d03a8288. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:07.328867 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:07.354868 10345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f93f10ffda421f83d5b217d03a8288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.356602 10632 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:07.359984 10430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bc1796a9a64f4ba15df6480a21b893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.372563 10504 tablet_service.cc:1511] Processing CreateTablet for tablet 293161fc043b46428f5b233850c4215e (DEFAULT_TABLE table=test-workload [id=6350a237f0804dbebea7160261bf3cc2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:07.392611 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293161fc043b46428f5b233850c4215e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:07.378384 10634 tablet_bootstrap.cc:654] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.353313 10633 raft_consensus.cc:359] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.412643 10633 raft_consensus.cc:385] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.413407 10633 raft_consensus.cc:740] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.414809 10633 consensus_queue.cc:260] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.417862 10633 ts_tablet_manager.cc:1434] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.169s	user 0.006s	sys 0.002s
I20260709 13:02:07.423269 10633 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:07.432881 10632 tablet_bootstrap.cc:654] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.497597 10634 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:07.498258 10634 ts_tablet_manager.cc:1403] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.542s	user 0.021s	sys 0.005s
I20260709 13:02:07.514537 10635 tablet_bootstrap.cc:492] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:07.515319 10635 ts_tablet_manager.cc:1403] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.298s	user 0.060s	sys 0.073s
I20260709 13:02:07.519120 10635 raft_consensus.cc:359] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.519990 10635 raft_consensus.cc:385] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.520303 10635 raft_consensus.cc:740] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.521620 10633 tablet_bootstrap.cc:654] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.521556 10635 consensus_queue.cc:260] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.526794 10634 raft_consensus.cc:359] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.527801 10634 raft_consensus.cc:385] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.528124 10634 raft_consensus.cc:740] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.529431 10634 consensus_queue.cc:260] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.533744 10632 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:07.534281 10634 ts_tablet_manager.cc:1434] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 13:02:07.534513 10632 ts_tablet_manager.cc:1403] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.001s
I20260709 13:02:07.535637 10634 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:07.538132 10632 raft_consensus.cc:359] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.539033 10632 raft_consensus.cc:385] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.539368 10632 raft_consensus.cc:740] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.540467 10632 consensus_queue.cc:260] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.543249 10632 ts_tablet_manager.cc:1434] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:07.544543 10632 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:07.548835 10634 tablet_bootstrap.cc:654] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.556982 10635 ts_tablet_manager.cc:1434] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 13:02:07.558457 10635 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:07.567577 10635 tablet_bootstrap.cc:654] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.567857 10632 tablet_bootstrap.cc:654] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.572240 10633 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:07.573158 10633 ts_tablet_manager.cc:1403] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.150s	user 0.028s	sys 0.013s
I20260709 13:02:07.574885 10643 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.575836 10643 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.579517 10633 raft_consensus.cc:359] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.580502 10633 raft_consensus.cc:385] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.580875 10633 raft_consensus.cc:740] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.581610 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:07.582222 10643 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:07.580976 10635 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:07.582255 10633 consensus_queue.cc:260] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.582959 10588 raft_consensus.cc:2468] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:07.583434 10635 ts_tablet_manager.cc:1403] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:02:07.585873 10633 ts_tablet_manager.cc:1434] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:07.587522 10633 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:07.595070 10634 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:07.597931 10635 raft_consensus.cc:359] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.599237 10635 raft_consensus.cc:385] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.599749 10635 raft_consensus.cc:740] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.600692 10634 ts_tablet_manager.cc:1403] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.065s	user 0.035s	sys 0.016s
I20260709 13:02:07.601271 10635 consensus_queue.cc:260] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.606352 10632 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:07.607012 10632 ts_tablet_manager.cc:1403] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.013s
I20260709 13:02:07.609735 10635 ts_tablet_manager.cc:1434] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:02:07.611225 10635 tablet_bootstrap.cc:492] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:07.612859 10330 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:07.612954 10634 raft_consensus.cc:359] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.615599 10643 raft_consensus.cc:2804] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.616567 10643 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.616950 10643 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.610975 10666 consensus_queue.cc:1048] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:07.624982 10643 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.626468 10634 raft_consensus.cc:385] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.626868 10634 raft_consensus.cc:740] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.627693 10634 consensus_queue.cc:260] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.632961 10643 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:07.634639 10632 raft_consensus.cc:359] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.635097 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:07.636000 10588 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.637787 10634 ts_tablet_manager.cc:1434] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:02:07.639151 10634 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:07.639991 10635 tablet_bootstrap.cc:654] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.646838 10632 raft_consensus.cc:385] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.647218 10634 tablet_bootstrap.cc:654] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.647300 10633 tablet_bootstrap.cc:654] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.650691 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:07.661619 10330 leader_election.cc:343] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.651976 10588 raft_consensus.cc:2468] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:07.672768 10330 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:07.654193 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:07.674304 10643 raft_consensus.cc:2804] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:02:07.675225 10330 leader_election.cc:343] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.677727 10643 raft_consensus.cc:697] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:07.679069 10643 consensus_queue.cc:237] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.662565 10632 raft_consensus.cc:740] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.685156 10632 consensus_queue.cc:260] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.689627 10632 ts_tablet_manager.cc:1434] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:02:07.691946 10632 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:07.699231 10633 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:07.700117 10633 ts_tablet_manager.cc:1403] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.005s
I20260709 13:02:07.700688 10634 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:07.701414 10634 ts_tablet_manager.cc:1403] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.029s
I20260709 13:02:07.703533 10635 tablet_bootstrap.cc:492] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:07.704267 10635 ts_tablet_manager.cc:1403] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.026s
I20260709 13:02:07.705127 10632 tablet_bootstrap.cc:654] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.705754 10634 raft_consensus.cc:359] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.706827 10634 raft_consensus.cc:385] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.706960 10439 raft_consensus.cc:3060] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.707299 10634 raft_consensus.cc:740] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.707451 10635 raft_consensus.cc:359] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.708339 10635 raft_consensus.cc:385] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.708700 10635 raft_consensus.cc:740] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.708495 10634 consensus_queue.cc:260] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.712841 10634 ts_tablet_manager.cc:1434] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.008s
I20260709 13:02:07.714643 10634 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:07.703672 10633 raft_consensus.cc:359] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.719619 10633 raft_consensus.cc:385] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.719885 10666 consensus_queue.cc:1048] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.720499 10633 raft_consensus.cc:740] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.722258 10633 consensus_queue.cc:260] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.729384 10633 ts_tablet_manager.cc:1434] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:02:07.730799 10633 tablet_bootstrap.cc:492] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:07.709722 10635 consensus_queue.cc:260] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.739470 10633 tablet_bootstrap.cc:654] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.740154 10635 ts_tablet_manager.cc:1434] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.006s
I20260709 13:02:07.741211 10644 raft_consensus.cc:493] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.741816 10644 raft_consensus.cc:515] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.744517 10644 leader_election.cc:290] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:07.745874 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a9031573e34c528ad0e50e5bde3015" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:07.746628 10514 raft_consensus.cc:2468] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:07.748453 10554 leader_election.cc:304] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:07.749588 10644 raft_consensus.cc:2804] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.750214 10644 raft_consensus.cc:493] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.750730 10644 raft_consensus.cc:3060] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.752820 10634 tablet_bootstrap.cc:654] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.756982 10262 catalog_manager.cc:5697] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.761255 10635 tablet_bootstrap.cc:492] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:07.774884 10632 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:07.775885 10632 ts_tablet_manager.cc:1403] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.084s	user 0.029s	sys 0.005s
I20260709 13:02:07.791532 10640 raft_consensus.cc:493] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.792647 10633 tablet_bootstrap.cc:492] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:07.794137 10633 ts_tablet_manager.cc:1403] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.035s
I20260709 13:02:07.796533 10644 raft_consensus.cc:515] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.797474 10633 raft_consensus.cc:359] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.798282 10633 raft_consensus.cc:385] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.798646 10633 raft_consensus.cc:740] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.799477 10633 consensus_queue.cc:260] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.797866 10632 raft_consensus.cc:359] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.792296 10666 raft_consensus.cc:493] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.792379 10640 raft_consensus.cc:515] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.803772 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a9031573e34c528ad0e50e5bde3015" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:07.808944 10514 raft_consensus.cc:3060] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.802666 10666 raft_consensus.cc:515] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.815898 10666 leader_election.cc:290] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:07.817281 10514 raft_consensus.cc:2468] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:07.801751 10644 leader_election.cc:290] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:07.801707 10632 raft_consensus.cc:385] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.819330 10641 raft_consensus.cc:493] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.820446 10641 raft_consensus.cc:515] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.820982 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed55aa25a52d4bfe80269832e6be5f47" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:07.822883 10478 leader_election.cc:343] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.826556 10554 leader_election.cc:304] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:07.827522 10644 raft_consensus.cc:2804] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.827219 10633 ts_tablet_manager.cc:1434] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.012s
I20260709 13:02:07.829499 10633 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:07.830592 10363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a9031573e34c528ad0e50e5bde3015" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:07.830842 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5fd742ea894da9b9667696dc71cf12" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:07.831506 10363 raft_consensus.cc:3060] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.828083 10644 raft_consensus.cc:697] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:07.840461 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:07.841085 10552 leader_election.cc:343] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.841635 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:07.842355 10405 leader_election.cc:343] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.842808 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed55aa25a52d4bfe80269832e6be5f47" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:07.824182 10640 leader_election.cc:290] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:07.843662 10440 raft_consensus.cc:2468] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:07.845911 10480 leader_election.cc:304] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:07.847390 10634 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:07.847627 10640 raft_consensus.cc:2804] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.848476 10635 tablet_bootstrap.cc:654] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.848095 10634 ts_tablet_manager.cc:1403] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.012s
I20260709 13:02:07.848630 10640 raft_consensus.cc:493] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.849529 10640 raft_consensus.cc:3060] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.822875 10641 leader_election.cc:290] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:07.840489 10644 consensus_queue.cc:237] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.819378 10632 raft_consensus.cc:740] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.853570 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5fd742ea894da9b9667696dc71cf12" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:07.854043 10632 consensus_queue.cc:260] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:07.857692 10554 leader_election.cc:343] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.858366 10554 leader_election.cc:304] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:07.859596 10697 raft_consensus.cc:2749] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.857760 10632 ts_tablet_manager.cc:1434] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.004s
I20260709 13:02:07.842394 10588 raft_consensus.cc:2468] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:07.841091 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a9031573e34c528ad0e50e5bde3015" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:07.859596 10634 raft_consensus.cc:359] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.862223 10405 leader_election.cc:304] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:07.866276 10632 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:07.866683 10641 raft_consensus.cc:2804] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.867197 10641 raft_consensus.cc:493] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.867669 10641 raft_consensus.cc:3060] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.868130 10633 tablet_bootstrap.cc:654] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.853024 10363 raft_consensus.cc:2468] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:07.872270 10634 raft_consensus.cc:385] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.885275 10634 raft_consensus.cc:740] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.888893 10640 raft_consensus.cc:515] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.891739 10698 raft_consensus.cc:493] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.892340 10698 raft_consensus.cc:515] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.892149 10262 catalog_manager.cc:5697] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.883268 10632 tablet_bootstrap.cc:654] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.894609 10698 leader_election.cc:290] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:07.897145 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:07.898543 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:07.900543 10480 leader_election.cc:343] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:07.901275 10480 leader_election.cc:343] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.890132 10641 raft_consensus.cc:515] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.901695 10480 leader_election.cc:304] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:07.903082 10698 raft_consensus.cc:2749] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.886210 10634 consensus_queue.cc:260] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.905011 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:07.907336 10640 leader_election.cc:290] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:07.908972 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed55aa25a52d4bfe80269832e6be5f47" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:07.909952 10440 raft_consensus.cc:3060] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.910820 10635 tablet_bootstrap.cc:492] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:07.912117 10635 ts_tablet_manager.cc:1403] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.002s
I20260709 13:02:07.914399 10363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed55aa25a52d4bfe80269832e6be5f47" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:07.916191 10634 ts_tablet_manager.cc:1434] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
W20260709 13:02:07.916762 10478 leader_election.cc:343] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.917439 10634 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:07.916838 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:07.919656 10641 leader_election.cc:290] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:07.920236 10588 raft_consensus.cc:3060] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.923640 10440 raft_consensus.cc:2468] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:07.923297 10635 raft_consensus.cc:359] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.924283 10635 raft_consensus.cc:385] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.924615 10635 raft_consensus.cc:740] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.925247 10480 leader_election.cc:304] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
W20260709 13:02:07.925585 10405 leader_election.cc:343] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.926637 10634 tablet_bootstrap.cc:654] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.926822 10635 consensus_queue.cc:260] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.928752 10633 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:07.930310 10640 raft_consensus.cc:2804] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.930931 10640 raft_consensus.cc:697] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:07.932358 10632 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:07.931949 10640 consensus_queue.cc:237] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.932960 10632 ts_tablet_manager.cc:1403] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.002s
I20260709 13:02:07.929379 10633 ts_tablet_manager.cc:1403] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.100s	user 0.026s	sys 0.024s
I20260709 13:02:07.936331 10632 raft_consensus.cc:359] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.937168 10632 raft_consensus.cc:385] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.937664 10632 raft_consensus.cc:740] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.938661 10632 consensus_queue.cc:260] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.942060 10632 ts_tablet_manager.cc:1434] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:02:07.943186 10588 raft_consensus.cc:2468] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:07.943222 10632 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:07.943245 10635 ts_tablet_manager.cc:1434] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:02:07.937392 10633 raft_consensus.cc:359] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.954978 10633 raft_consensus.cc:385] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.955345 10633 raft_consensus.cc:740] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.955857 10635 tablet_bootstrap.cc:492] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:07.956192 10633 consensus_queue.cc:260] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:07.958662 10633 ts_tablet_manager.cc:1434] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:02:07.948700 10405 leader_election.cc:304] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:07.959782 10633 tablet_bootstrap.cc:492] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:07.960594 10641 raft_consensus.cc:2804] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.950678 10634 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:07.962738 10634 ts_tablet_manager.cc:1403] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.004s
I20260709 13:02:07.967290 10635 tablet_bootstrap.cc:654] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.968327 10633 tablet_bootstrap.cc:654] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.952857 10632 tablet_bootstrap.cc:654] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.970543 10260 catalog_manager.cc:5697] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.978217 10634 raft_consensus.cc:359] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.983984 10634 raft_consensus.cc:385] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.985092 10634 raft_consensus.cc:740] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.987397 10634 consensus_queue.cc:260] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:07.991256 10634 ts_tablet_manager.cc:1434] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 13:02:07.992960 10641 raft_consensus.cc:697] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:07.994532 10643 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.994980 10641 consensus_queue.cc:237] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:07.995811 10643 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:07.998337 10643 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:08.000954 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.001170 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.002012 10514 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
W20260709 13:02:08.003206 10330 leader_election.cc:343] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.004330 10330 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:08.006366 10643 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.006904 10643 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.007349 10643 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.007866 10632 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:08.008301 10634 tablet_bootstrap.cc:492] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:08.008535 10632 ts_tablet_manager.cc:1403] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.006s
I20260709 13:02:08.016193 10632 raft_consensus.cc:359] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.017222 10632 raft_consensus.cc:385] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.017395 10634 tablet_bootstrap.cc:654] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.017382 10643 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.018507 10632 raft_consensus.cc:740] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.019729 10705 raft_consensus.cc:493] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.019486 10632 consensus_queue.cc:260] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.020326 10705 raft_consensus.cc:515] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.022351 10632 ts_tablet_manager.cc:1434] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:08.023738 10632 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:08.025137 10705 leader_election.cc:290] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:08.027415 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.028904 10514 raft_consensus.cc:2468] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:08.029254 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:08.032521 10330 leader_election.cc:343] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.033319 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:08.034325 10405 leader_election.cc:304] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:08.036168 10705 raft_consensus.cc:2804] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.036748 10705 raft_consensus.cc:493] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.037153 10705 raft_consensus.cc:3060] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.037602 10633 tablet_bootstrap.cc:492] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:08.038292 10635 tablet_bootstrap.cc:492] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:08.038947 10635 ts_tablet_manager.cc:1403] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.013s
W20260709 13:02:08.041122 10405 leader_election.cc:343] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.038914 10633 ts_tablet_manager.cc:1403] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.005s
I20260709 13:02:08.047610 10633 raft_consensus.cc:359] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.048463 10633 raft_consensus.cc:385] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.048764 10633 raft_consensus.cc:740] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.049482 10633 consensus_queue.cc:260] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.042812 10635 raft_consensus.cc:359] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.051826 10635 raft_consensus.cc:385] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.052217 10635 raft_consensus.cc:740] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.052316 10643 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:08.053097 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:08.054034 10514 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.055470 10705 raft_consensus.cc:515] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.060245 10633 ts_tablet_manager.cc:1434] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:02:08.061995 10633 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:08.053045 10635 consensus_queue.cc:260] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.060052 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:08.065339 10513 raft_consensus.cc:3060] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.065981 10261 catalog_manager.cc:5697] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.072772 10632 tablet_bootstrap.cc:654] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.075412 10633 tablet_bootstrap.cc:654] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.077404 10514 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:08.079283 10643 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.079994 10643 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.082921 10640 raft_consensus.cc:493] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.084646 10635 ts_tablet_manager.cc:1434] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 13:02:08.084097 10640 raft_consensus.cc:515] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.085106 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:08.085846 10635 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:08.090179 10643 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.090467 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5fd742ea894da9b9667696dc71cf12" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:08.091998 10405 leader_election.cc:343] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.092370 10587 raft_consensus.cc:2468] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:08.080014 10330 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:08.094238 10480 leader_election.cc:304] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:08.095774 10698 raft_consensus.cc:2804] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.096339 10698 raft_consensus.cc:493] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.095934 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.096773 10698 raft_consensus.cc:3060] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.085803 10705 leader_election.cc:290] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:08.100337 10363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5fd742ea894da9b9667696dc71cf12" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.100566 10640 leader_election.cc:290] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:08.099946 10688 consensus_queue.cc:1048] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:08.101260 10363 raft_consensus.cc:2468] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
W20260709 13:02:08.100488 10330 leader_election.cc:343] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.095070 10643 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.109928 10643 raft_consensus.cc:697] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:08.110601 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.111083 10643 consensus_queue.cc:237] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.112948 10632 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:08.113555 10632 ts_tablet_manager.cc:1403] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.015s
I20260709 13:02:08.114341 10644 raft_consensus.cc:493] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.114888 10644 raft_consensus.cc:515] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.115581 10635 tablet_bootstrap.cc:654] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.117300 10644 leader_election.cc:290] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.118058 10363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.118796 10634 tablet_bootstrap.cc:492] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:08.119336 10634 ts_tablet_manager.cc:1403] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.009s
I20260709 13:02:08.120914 10698 raft_consensus.cc:515] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.122274 10632 raft_consensus.cc:359] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.123051 10632 raft_consensus.cc:385] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.123379 10632 raft_consensus.cc:740] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.124322 10632 consensus_queue.cc:260] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.125595 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.118819 10363 raft_consensus.cc:2468] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:08.122732 10634 raft_consensus.cc:359] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.125595 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5fd742ea894da9b9667696dc71cf12" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:08.131925 10634 raft_consensus.cc:385] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.132498 10634 raft_consensus.cc:740] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.128196 10552 leader_election.cc:304] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:08.132064 10588 raft_consensus.cc:3060] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.126520 10440 raft_consensus.cc:2468] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:08.149077 10644 raft_consensus.cc:2804] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.149768 10644 raft_consensus.cc:493] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.150146 10644 raft_consensus.cc:3060] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.127480 10632 ts_tablet_manager.cc:1434] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:02:08.153661 10632 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:08.157191 10261 catalog_manager.cc:5697] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.151340 10588 raft_consensus.cc:2468] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:08.161738 10634 consensus_queue.cc:260] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.119345 10514 raft_consensus.cc:2468] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:08.172081 10632 tablet_bootstrap.cc:654] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.173457 10480 leader_election.cc:304] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:08.179363 10644 raft_consensus.cc:515] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.180188 10330 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:08.175380 10640 raft_consensus.cc:2804] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.181890 10643 raft_consensus.cc:2804] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.182466 10643 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.183033 10643 raft_consensus.cc:3060] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.184230 10363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:08.185359 10363 raft_consensus.cc:3060] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.188429 10698 leader_election.cc:290] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:08.193574 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5fd742ea894da9b9667696dc71cf12" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:08.194413 10364 raft_consensus.cc:3060] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.197516 10634 ts_tablet_manager.cc:1434] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.004s
I20260709 13:02:08.199411 10634 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:08.202455 10633 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:08.203045 10633 ts_tablet_manager.cc:1403] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.000s
I20260709 13:02:08.207639 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:08.208550 10440 raft_consensus.cc:3060] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.208695 10513 raft_consensus.cc:2468] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:08.213295 10405 leader_election.cc:304] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
W20260709 13:02:08.215055 10330 consensus_peers.cc:597] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.215111 10705 raft_consensus.cc:2804] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.222446 10705 raft_consensus.cc:697] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:08.222267 10364 raft_consensus.cc:2468] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:08.223658 10705 consensus_queue.cc:237] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.232331 10633 raft_consensus.cc:359] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.233634 10633 raft_consensus.cc:385] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.233994 10633 raft_consensus.cc:740] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.235424 10643 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.238224 10363 raft_consensus.cc:2468] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:08.239686 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:08.240216 10552 leader_election.cc:304] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:08.241428 10643 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.235153 10633 consensus_queue.cc:260] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.241806 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:08.243988 10633 ts_tablet_manager.cc:1434] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.002s
W20260709 13:02:08.244174 10330 leader_election.cc:343] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.244835 10666 raft_consensus.cc:2804] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.245239 10633 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:08.245765 10666 raft_consensus.cc:697] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:08.240825 10513 raft_consensus.cc:3060] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.252113 10666 consensus_queue.cc:237] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.235975 10644 leader_election.cc:290] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.256175 10633 tablet_bootstrap.cc:654] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.263054 10635 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:08.265272 10635 ts_tablet_manager.cc:1403] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.180s	user 0.033s	sys 0.035s
I20260709 13:02:08.271222 10644 consensus_queue.cc:1048] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:08.274556 10632 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:08.275465 10632 ts_tablet_manager.cc:1403] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.024s
I20260709 13:02:08.293030 10644 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.299341 10644 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.300289 10635 raft_consensus.cc:359] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.301230 10635 raft_consensus.cc:385] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.301795 10635 raft_consensus.cc:740] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.303961 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.304873 10644 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.305846 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:08.306605 10552 leader_election.cc:343] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.266629 10640 raft_consensus.cc:697] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:08.307024 10635 consensus_queue.cc:260] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:08.307726 10554 leader_election.cc:343] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.308239 10554 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:08.308545 10640 consensus_queue.cc:237] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.309633 10697 consensus_queue.cc:1048] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.311322 10635 ts_tablet_manager.cc:1434] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.001s
I20260709 13:02:08.311506 10697 raft_consensus.cc:2749] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.270272 10643 raft_consensus.cc:493] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.312542 10643 raft_consensus.cc:515] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.327337 10688 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.328433 10688 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:08.336401 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:08.339874 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.340955 10439 raft_consensus.cc:2468] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:08.342038 10364 raft_consensus.cc:3060] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.342818 10330 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:08.343932 10643 leader_election.cc:290] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:08.344489 10688 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:08.344687 10698 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.344867 10643 raft_consensus.cc:2804] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.345633 10698 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.346611 10632 raft_consensus.cc:359] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.347445 10632 raft_consensus.cc:385] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.347810 10632 raft_consensus.cc:740] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.348691 10632 consensus_queue.cc:260] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.349184 10634 tablet_bootstrap.cc:654] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.350189 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.331372 10440 raft_consensus.cc:2468] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:08.353127 10632 ts_tablet_manager.cc:1434] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.077s	user 0.012s	sys 0.002s
I20260709 13:02:08.355746 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.354395 10698 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.354439 10632 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:08.345745 10643 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.312618 10635 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:08.363426 10440 raft_consensus.cc:2468] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:08.363014 10643 raft_consensus.cc:3060] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.378829 10480 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:08.379755 10633 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:08.380085 10717 raft_consensus.cc:2804] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.380432 10633 ts_tablet_manager.cc:1403] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.135s	user 0.050s	sys 0.054s
I20260709 13:02:08.380647 10717 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.381117 10717 raft_consensus.cc:3060] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.381404 10262 catalog_manager.cc:5697] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.384334 10633 raft_consensus.cc:359] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.385315 10633 raft_consensus.cc:385] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.385697 10633 raft_consensus.cc:740] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.387058 10633 consensus_queue.cc:260] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.363600 10513 raft_consensus.cc:2468] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:08.392261 10633 ts_tablet_manager.cc:1434] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:02:08.394125 10633 tablet_bootstrap.cc:492] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:08.392966 10644 raft_consensus.cc:493] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.398825 10644 raft_consensus.cc:515] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.401859 10644 leader_election.cc:290] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:08.404078 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.405623 10635 tablet_bootstrap.cc:654] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.406744 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.407975 10512 raft_consensus.cc:2393] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
W20260709 13:02:08.391868 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 49184.4us
I20260709 13:02:08.415990 10554 leader_election.cc:304] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:08.418629 10644 raft_consensus.cc:3060] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.417896 10261 catalog_manager.cc:5697] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.421034 10633 tablet_bootstrap.cc:654] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.424590 10632 tablet_bootstrap.cc:654] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.429395 10640 raft_consensus.cc:493] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.450296 10698 consensus_queue.cc:1048] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.469674 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed55aa25a52d4bfe80269832e6be5f47" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.470088 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed55aa25a52d4bfe80269832e6be5f47" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.470888 10634 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:08.471431 10440 raft_consensus.cc:2393] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 1: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:08.471851 10634 ts_tablet_manager.cc:1403] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.273s	user 0.034s	sys 0.000s
I20260709 13:02:08.454813 10640 raft_consensus.cc:515] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.475648 10640 leader_election.cc:290] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:08.476203 10705 raft_consensus.cc:493] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.477481 10262 catalog_manager.cc:5697] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.483952 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:08.485069 10587 raft_consensus.cc:2393] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:08.484905 10330 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:08.486599 10722 raft_consensus.cc:2804] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.487299 10633 tablet_bootstrap.cc:492] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:08.487476 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.487365 10722 raft_consensus.cc:697] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:08.488217 10633 ts_tablet_manager.cc:1403] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.020s
I20260709 13:02:08.480880 10640 raft_consensus.cc:493] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.477100 10705 raft_consensus.cc:515] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.494400 10722 consensus_queue.cc:237] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.494726 10634 raft_consensus.cc:359] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.495597 10634 raft_consensus.cc:385] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.495956 10634 raft_consensus.cc:740] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.497750 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.499248 10633 raft_consensus.cc:359] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.499966 10633 raft_consensus.cc:385] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.500273 10633 raft_consensus.cc:740] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.490864 10330 leader_election.cc:304] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:08.503963 10705 leader_election.cc:290] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:08.509510 10634 consensus_queue.cc:260] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:08.512061 10405 leader_election.cc:343] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.512574 10717 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.514729 10633 consensus_queue.cc:260] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.521426 10635 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:08.522276 10635 ts_tablet_manager.cc:1403] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.210s	user 0.027s	sys 0.020s
I20260709 13:02:08.494318 10640 raft_consensus.cc:515] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.550087 10633 ts_tablet_manager.cc:1434] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:02:08.551582 10634 ts_tablet_manager.cc:1434] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 13:02:08.553258 10633 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:08.543905 10514 raft_consensus.cc:2393] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 1: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:08.535277 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50fb1dd837e4c39b8f6f5fa40e3002d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.556599 10697 raft_consensus.cc:493] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.556032 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:08.576406 10405 leader_election.cc:343] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.579084 10405 leader_election.cc:304] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:08.580516 10705 raft_consensus.cc:2749] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.582540 10632 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:08.583465 10632 ts_tablet_manager.cc:1403] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.229s	user 0.019s	sys 0.008s
I20260709 13:02:08.583595 10688 raft_consensus.cc:2749] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.584470 10688 raft_consensus.cc:493] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.584111 10643 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.585139 10688 raft_consensus.cc:515] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.586544 10362 raft_consensus.cc:2393] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 1: Already voted for candidate b4af86c3867e41659d5499027b08b924 in this term.
I20260709 13:02:08.587168 10512 raft_consensus.cc:3060] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.579661 10635 raft_consensus.cc:359] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.588161 10635 raft_consensus.cc:385] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.588714 10635 raft_consensus.cc:740] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
W20260709 13:02:08.570577 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 79851.3us
I20260709 13:02:08.593008 10640 leader_election.cc:290] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.593386 10717 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.591259 10644 raft_consensus.cc:2749] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.590211 10635 consensus_queue.cc:260] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.591399 10632 raft_consensus.cc:359] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.614408 10632 raft_consensus.cc:385] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.614763 10632 raft_consensus.cc:740] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.590299 10643 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:08.648367 10632 consensus_queue.cc:260] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.595458 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:08.650797 10440 raft_consensus.cc:3060] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.651428 10705 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.652209 10705 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.599215 10697 raft_consensus.cc:515] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.595057 10688 leader_election.cc:290] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:08.655421 10635 ts_tablet_manager.cc:1434] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.133s	user 0.012s	sys 0.000s
I20260709 13:02:08.600510 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:08.597191 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:08.664762 10632 ts_tablet_manager.cc:1434] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:02:08.663057 10635 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:08.598021 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.665540 10641 consensus_queue.cc:1048] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.667121 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:08.599620 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.595690 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:08.671861 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f75d00c3144139bbb5c22358f074c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.672767 10360 raft_consensus.cc:2468] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
W20260709 13:02:08.673689 10330 leader_election.cc:343] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.675597 10438 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.676554 10437 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:08.681595 10478 leader_election.cc:343] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.594851 10480 leader_election.cc:304] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:08.681844 10634 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:08.701954 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:08.702739 10632 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:08.710608 10705 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:08.711866 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:08.691821 10640 raft_consensus.cc:2749] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.714080 10405 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:08.719312 10633 tablet_bootstrap.cc:654] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.725939 10635 tablet_bootstrap.cc:654] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.727414 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f75d00c3144139bbb5c22358f074c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.728384 10439 raft_consensus.cc:2468] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
W20260709 13:02:08.691493 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 96784.9us
I20260709 13:02:08.733680 10480 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:08.734632 10634 tablet_bootstrap.cc:654] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.737840 10736 consensus_queue.cc:1048] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.742506 10632 tablet_bootstrap.cc:654] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.699295 10697 leader_election.cc:290] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:08.736253 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:08.737893 10640 raft_consensus.cc:2749] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.708300 10552 leader_election.cc:304] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:08.756371 10641 consensus_queue.cc:1048] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:08.763681 10640 raft_consensus.cc:493] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.764714 10640 raft_consensus.cc:515] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:08.767419 10640 leader_election.cc:290] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:08.759467 10480 leader_election.cc:343] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.769277 10480 leader_election.cc:304] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:08.770578 10736 raft_consensus.cc:2749] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:08.772657 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 75791.5us
I20260709 13:02:08.774151 10697 raft_consensus.cc:2804] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.774677 10697 raft_consensus.cc:493] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.775074 10697 raft_consensus.cc:3060] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.775193 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:08.776273 10436 raft_consensus.cc:2468] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
W20260709 13:02:08.780144 10330 leader_election.cc:343] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.780737 10330 leader_election.cc:304] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:08.782084 10722 consensus_queue.cc:1048] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.783738 10735 raft_consensus.cc:2749] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.781107 10633 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:08.786213 10633 ts_tablet_manager.cc:1403] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.005s
I20260709 13:02:08.787976 10634 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:08.793797 10634 ts_tablet_manager.cc:1403] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.005s
I20260709 13:02:08.798125 10734 consensus_queue.cc:1048] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:08.803817 10722 consensus_queue.cc:1048] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.804415 10634 raft_consensus.cc:359] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.805364 10634 raft_consensus.cc:385] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.805742 10634 raft_consensus.cc:740] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.811967 10634 consensus_queue.cc:260] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.815788 10635 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:08.816685 10635 ts_tablet_manager.cc:1403] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.155s	user 0.008s	sys 0.016s
I20260709 13:02:08.818580 10440 raft_consensus.cc:2468] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:08.819123 10634 ts_tablet_manager.cc:1434] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:02:08.807101 10480 leader_election.cc:304] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:08.820668 10634 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:08.822649 10633 raft_consensus.cc:359] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.823808 10633 raft_consensus.cc:385] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.824326 10633 raft_consensus.cc:740] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.830045 10633 consensus_queue.cc:260] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.821622 10640 raft_consensus.cc:2804] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.833843 10640 raft_consensus.cc:493] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.834364 10640 raft_consensus.cc:3060] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.836074 10633 ts_tablet_manager.cc:1434] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:02:08.837699 10633 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
W20260709 13:02:08.835479 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 86856.9us
I20260709 13:02:08.840656 10262 catalog_manager.cc:5697] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.844480 10330 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:08.852945 10722 raft_consensus.cc:2804] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.855930 10722 raft_consensus.cc:697] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:08.857048 10722 consensus_queue.cc:237] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:08.896791 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:08.903704 10736 consensus_queue.cc:1048] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:08.904342 10480 leader_election.cc:343] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.911922 10738 consensus_queue.cc:1048] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:02:08.914613 10330 consensus_peers.cc:597] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.904309 10635 raft_consensus.cc:359] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.917373 10635 raft_consensus.cc:385] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.918006 10635 raft_consensus.cc:740] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.928129 10705 raft_consensus.cc:2749] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.931041 10697 raft_consensus.cc:515] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.933724 10736 consensus_queue.cc:1048] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.926816 10635 consensus_queue.cc:260] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:08.954125 10633 tablet_bootstrap.cc:654] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.961210 10634 tablet_bootstrap.cc:654] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.965844 10635 ts_tablet_manager.cc:1434] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.149s	user 0.012s	sys 0.000s
I20260709 13:02:08.966976 10635 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:08.976248 10632 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:08.977061 10632 ts_tablet_manager.cc:1403] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.275s	user 0.025s	sys 0.024s
I20260709 13:02:08.982385 10738 raft_consensus.cc:493] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.983135 10738 raft_consensus.cc:515] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:08.989972 10697 leader_election.cc:290] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.020596 10736 raft_consensus.cc:493] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.022285 10736 raft_consensus.cc:515] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.029521 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a410e026f642eb97377be90f0dc9ab" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:09.031520 10478 leader_election.cc:343] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.032634 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a410e026f642eb97377be90f0dc9ab" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:09.034646 10480 leader_election.cc:343] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.035209 10480 leader_election.cc:304] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.036742 10717 raft_consensus.cc:2749] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.036511 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f75d00c3144139bbb5c22358f074c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:09.012109 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:09.039116 10736 leader_election.cc:290] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.048147 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f75d00c3144139bbb5c22358f074c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:09.049062 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.050208 10361 raft_consensus.cc:2468] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:09.049129 10438 raft_consensus.cc:3060] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.054591 10552 leader_election.cc:304] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:09.040398 10362 raft_consensus.cc:3060] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.059042 10697 raft_consensus.cc:2804] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.059662 10697 raft_consensus.cc:493] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.060405 10697 raft_consensus.cc:3060] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.039407 10738 leader_election.cc:290] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:09.068781 10554 leader_election.cc:343] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.080796 10632 raft_consensus.cc:359] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.081808 10632 raft_consensus.cc:385] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.082113 10632 raft_consensus.cc:740] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.083177 10633 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:09.059110 10640 raft_consensus.cc:515] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.085464 10643 consensus_queue.cc:1048] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.084079 10633 ts_tablet_manager.cc:1403] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.247s	user 0.027s	sys 0.000s
I20260709 13:02:09.088590 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:09.089303 10437 raft_consensus.cc:3060] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.090487 10633 raft_consensus.cc:359] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.091857 10633 raft_consensus.cc:385] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.092212 10633 raft_consensus.cc:740] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.094355 10633 consensus_queue.cc:260] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.082892 10632 consensus_queue.cc:260] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.104954 10633 ts_tablet_manager.cc:1434] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:02:09.106197 10633 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:09.109285 10632 ts_tablet_manager.cc:1434] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.002s
I20260709 13:02:09.110527 10632 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:09.122377 10438 raft_consensus.cc:2468] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
W20260709 13:02:09.126089 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 238593us
I20260709 13:02:09.128286 10635 tablet_bootstrap.cc:654] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.129309 10261 catalog_manager.cc:5697] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.133170 10362 raft_consensus.cc:2468] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:09.136529 10640 leader_election.cc:290] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:09.137143 10552 leader_election.cc:304] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:09.138286 10738 raft_consensus.cc:2804] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.138841 10738 raft_consensus.cc:697] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:09.142117 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:09.141964 10738 consensus_queue.cc:237] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:09.144917 10480 leader_election.cc:343] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.153354 10634 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:09.154256 10634 ts_tablet_manager.cc:1403] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.334s	user 0.008s	sys 0.020s
I20260709 13:02:09.158584 10634 raft_consensus.cc:359] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.139204 10697 raft_consensus.cc:515] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.164129 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:09.164491 10697 leader_election.cc:290] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:09.167147 10554 leader_election.cc:343] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.163609 10634 raft_consensus.cc:385] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.168179 10634 raft_consensus.cc:740] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.171278 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:09.179148 10634 consensus_queue.cc:260] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.180670 10362 raft_consensus.cc:3060] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.178284 10437 raft_consensus.cc:2468] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:09.188467 10755 consensus_queue.cc:1048] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:09.206866 10633 tablet_bootstrap.cc:654] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.206725 10362 raft_consensus.cc:2468] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:09.217594 10634 ts_tablet_manager.cc:1434] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.003s
I20260709 13:02:09.218056 10755 consensus_queue.cc:1048] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.219887 10634 tablet_bootstrap.cc:492] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:09.222708 10552 leader_election.cc:304] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:09.223814 10738 raft_consensus.cc:2804] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.224332 10738 raft_consensus.cc:697] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:09.226142 10738 consensus_queue.cc:237] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.230966 10632 tablet_bootstrap.cc:654] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.231501 10480 leader_election.cc:304] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:09.237927 10736 raft_consensus.cc:2804] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.238675 10736 raft_consensus.cc:697] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:09.240633 10736 consensus_queue.cc:237] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.271242 10635 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:09.272078 10635 ts_tablet_manager.cc:1403] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.305s	user 0.014s	sys 0.009s
I20260709 13:02:09.267620 10755 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.277420 10755 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.313319 10755 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:09.314903 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.318828 10634 tablet_bootstrap.cc:654] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.322913 10735 consensus_queue.cc:1048] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:02:09.296303 10635 raft_consensus.cc:359] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.330931 10635 raft_consensus.cc:385] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.331687 10635 raft_consensus.cc:740] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.333528 10635 consensus_queue.cc:260] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.336274 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:09.339439 10635 ts_tablet_manager.cc:1434] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.067s	user 0.012s	sys 0.001s
I20260709 13:02:09.341102 10405 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:09.342792 10752 raft_consensus.cc:2749] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.350011 10635 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:09.353960 10633 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:09.354696 10633 ts_tablet_manager.cc:1403] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.249s	user 0.028s	sys 0.004s
I20260709 13:02:09.358302 10633 raft_consensus.cc:359] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.359598 10633 raft_consensus.cc:385] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.360298 10633 raft_consensus.cc:740] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.362192 10733 consensus_queue.cc:1048] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.372865 10262 catalog_manager.cc:5697] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.376766 10633 consensus_queue.cc:260] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.381085 10633 ts_tablet_manager.cc:1434] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 13:02:09.382531 10633 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:09.392184 10640 raft_consensus.cc:493] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.393359 10640 raft_consensus.cc:515] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:09.400837 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:09.421838 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:09.424079 10478 leader_election.cc:343] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.427644 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:09.424947 10640 leader_election.cc:290] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:09.430661 10480 leader_election.cc:343] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.431746 10480 leader_election.cc:304] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.434912 10640 raft_consensus.cc:2749] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.444151 10632 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:09.446312 10632 ts_tablet_manager.cc:1403] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.336s	user 0.027s	sys 0.017s
I20260709 13:02:09.463759 10632 raft_consensus.cc:359] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.464610 10632 raft_consensus.cc:385] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.464771 10634 tablet_bootstrap.cc:492] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:09.464931 10632 raft_consensus.cc:740] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.465615 10634 ts_tablet_manager.cc:1403] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.246s	user 0.017s	sys 0.003s
I20260709 13:02:09.467475 10632 consensus_queue.cc:260] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.472311 10632 ts_tablet_manager.cc:1434] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:02:09.472906 10634 raft_consensus.cc:359] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.473768 10634 raft_consensus.cc:385] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.473858 10632 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:09.465302 10259 catalog_manager.cc:5697] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.488554 10635 tablet_bootstrap.cc:654] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.490127 10632 tablet_bootstrap.cc:654] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.491220 10633 tablet_bootstrap.cc:654] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.474108 10634 raft_consensus.cc:740] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.493713 10634 consensus_queue.cc:260] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.497493 10634 ts_tablet_manager.cc:1434] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 13:02:09.499033 10634 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:09.502704 10632 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:09.503401 10632 ts_tablet_manager.cc:1403] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 13:02:09.503309 10640 raft_consensus.cc:493] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.504015 10640 raft_consensus.cc:515] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.508716 10640 leader_election.cc:290] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:09.509909 10633 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:09.510550 10633 ts_tablet_manager.cc:1403] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.002s
I20260709 13:02:09.511401 10755 raft_consensus.cc:493] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.512251 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:09.512043 10755 raft_consensus.cc:515] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.516641 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a5e078776b4a799080a281d489ff87" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.517216 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.517722 10362 raft_consensus.cc:2393] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
W20260709 13:02:09.519089 10403 leader_election.cc:343] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.519313 10632 raft_consensus.cc:359] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.520066 10755 leader_election.cc:290] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:09.520255 10632 raft_consensus.cc:385] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.525568 10437 raft_consensus.cc:3060] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.525812 10632 raft_consensus.cc:740] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.528644 10478 leader_election.cc:304] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.521847 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:09.532791 10514 raft_consensus.cc:2468] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:09.534855 10697 raft_consensus.cc:493] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.535750 10697 raft_consensus.cc:515] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.538172 10640 raft_consensus.cc:3060] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.539283 10735 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.540299 10735 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.548703 10697 leader_election.cc:290] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:09.550403 10735 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.540810 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:09.541216 10632 consensus_queue.cc:260] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.552642 10440 raft_consensus.cc:2393] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:09.534915 10405 leader_election.cc:304] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.552682 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:09.554752 10632 ts_tablet_manager.cc:1434] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:02:09.542297 10633 raft_consensus.cc:359] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.556892 10633 raft_consensus.cc:385] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.556950 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:09.557310 10633 raft_consensus.cc:740] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.557783 10586 raft_consensus.cc:2468] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:09.558383 10633 consensus_queue.cc:260] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.561177 10755 raft_consensus.cc:2804] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.561447 10632 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:09.562095 10635 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
W20260709 13:02:09.560046 10330 leader_election.cc:343] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.561681 10755 raft_consensus.cc:493] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.565917 10635 ts_tablet_manager.cc:1403] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.004s
I20260709 13:02:09.566249 10755 raft_consensus.cc:3060] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.548051 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4eaf8c0162a428796c30899aa6e302a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:09.567644 10633 ts_tablet_manager.cc:1434] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.004s
I20260709 13:02:09.568889 10633 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:09.531822 10258 catalog_manager.cc:5697] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.572623 10554 leader_election.cc:304] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:09.576404 10330 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:09.588617 10755 raft_consensus.cc:515] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.589704 10735 raft_consensus.cc:2804] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.590337 10735 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.591017 10735 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.596922 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
W20260709 13:02:09.598990 10403 leader_election.cc:343] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.598721 10644 consensus_queue.cc:1048] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.580628 10634 tablet_bootstrap.cc:654] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.600356 10755 leader_election.cc:290] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:09.601270 10633 tablet_bootstrap.cc:654] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.582208 10697 raft_consensus.cc:3060] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.582981 10640 raft_consensus.cc:2749] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.605397 10632 tablet_bootstrap.cc:654] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.603188 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:09.608150 10514 raft_consensus.cc:3060] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.573012 10635 raft_consensus.cc:359] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.613862 10635 raft_consensus.cc:385] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.614167 10635 raft_consensus.cc:740] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.618633 10635 consensus_queue.cc:260] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.610877 10735 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.622431 10735 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.623987 10633 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:09.626616 10633 ts_tablet_manager.cc:1403] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.005s
I20260709 13:02:09.628319 10635 ts_tablet_manager.cc:1434] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:02:09.632639 10633 raft_consensus.cc:359] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.633589 10633 raft_consensus.cc:385] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.633931 10633 raft_consensus.cc:740] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.633973 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:09.634948 10633 consensus_queue.cc:260] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:09.636375 10330 leader_election.cc:343] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.641503 10634 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:09.633026 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:09.642658 10634 ts_tablet_manager.cc:1403] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.004s
I20260709 13:02:09.642901 10586 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.651988 10644 raft_consensus.cc:493] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.652738 10644 raft_consensus.cc:515] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.655216 10644 leader_election.cc:290] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.658445 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118b0cf2ac56453abf589a611a7d9c7d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:09.661773 10635 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:09.664577 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118b0cf2ac56453abf589a611a7d9c7d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.666829 10362 raft_consensus.cc:2468] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:09.668785 10552 leader_election.cc:304] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:09.669973 10644 raft_consensus.cc:2804] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:09.670207 10554 leader_election.cc:343] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.670661 10644 raft_consensus.cc:493] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.671248 10644 raft_consensus.cc:3060] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.677420 10633 ts_tablet_manager.cc:1434] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:02:09.663902 10697 raft_consensus.cc:2749] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.678869 10633 tablet_bootstrap.cc:492] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:09.687562 10633 tablet_bootstrap.cc:654] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.697816 10632 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:09.698506 10632 ts_tablet_manager.cc:1403] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.137s	user 0.007s	sys 0.010s
I20260709 13:02:09.703059 10632 raft_consensus.cc:359] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.707379 10632 raft_consensus.cc:385] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.707749 10632 raft_consensus.cc:740] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.705797 10514 raft_consensus.cc:2468] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:09.706722 10635 tablet_bootstrap.cc:654] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.710089 10405 leader_election.cc:304] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.712297 10632 consensus_queue.cc:260] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.714599 10762 raft_consensus.cc:2804] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.715396 10762 raft_consensus.cc:697] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:09.724112 10586 raft_consensus.cc:2468] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:09.724973 10762 consensus_queue.cc:237] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.744624 10330 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:09.746182 10735 raft_consensus.cc:2804] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.728164 10640 consensus_queue.cc:1048] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:02:09.747290 10735 raft_consensus.cc:697] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:09.750221 10735 consensus_queue.cc:237] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.733115 10634 raft_consensus.cc:359] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.753796 10634 raft_consensus.cc:385] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.754105 10634 raft_consensus.cc:740] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.755743 10634 consensus_queue.cc:260] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.734301 10632 ts_tablet_manager.cc:1434] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:02:09.760074 10632 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:09.766592 10736 consensus_queue.cc:1048] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:09.775362 10633 tablet_bootstrap.cc:492] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:09.776131 10633 ts_tablet_manager.cc:1403] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.001s
I20260709 13:02:09.781608 10633 raft_consensus.cc:359] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.788542 10788 consensus_queue.cc:1048] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:09.794270 10635 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:09.794974 10635 ts_tablet_manager.cc:1403] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.133s	user 0.040s	sys 0.019s
I20260709 13:02:09.792585 10633 raft_consensus.cc:385] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.796110 10633 raft_consensus.cc:740] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.797371 10633 consensus_queue.cc:260] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.724937 10697 consensus_queue.cc:1048] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260709 13:02:09.800143 10633 ts_tablet_manager.cc:1434] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 13:02:09.799679 10635 raft_consensus.cc:359] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.800617 10635 raft_consensus.cc:385] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.800956 10635 raft_consensus.cc:740] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.801443 10633 tablet_bootstrap.cc:492] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:09.802170 10762 raft_consensus.cc:493] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.802843 10762 raft_consensus.cc:515] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.742197 10644 raft_consensus.cc:515] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.808599 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:09.810566 10403 leader_election.cc:343] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.812052 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118b0cf2ac56453abf589a611a7d9c7d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:09.812785 10362 raft_consensus.cc:3060] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.811499 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:09.824996 10632 tablet_bootstrap.cc:654] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:09.826092 10405 leader_election.cc:343] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.832614 10762 leader_election.cc:290] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:09.826839 10405 leader_election.cc:304] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.836140 10762 raft_consensus.cc:2749] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.843420 10633 tablet_bootstrap.cc:654] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.845875 10644 leader_election.cc:290] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.847606 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118b0cf2ac56453abf589a611a7d9c7d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:09.843514 10788 consensus_queue.cc:1048] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:09.802145 10635 consensus_queue.cc:260] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.853601 10634 ts_tablet_manager.cc:1434] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.210s	user 0.011s	sys 0.005s
I20260709 13:02:09.867090 10634 tablet_bootstrap.cc:492] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:09.862208 10440 raft_consensus.cc:3060] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.856606 10362 raft_consensus.cc:2468] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:09.880149 10261 catalog_manager.cc:5697] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.888530 10633 tablet_bootstrap.cc:492] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:09.889623 10633 ts_tablet_manager.cc:1403] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.015s
I20260709 13:02:09.885299 10644 raft_consensus.cc:493] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.883416 10552 leader_election.cc:304] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:09.851197 10260 catalog_manager.cc:5697] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.893328 10697 raft_consensus.cc:2804] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.893965 10697 raft_consensus.cc:697] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:09.896739 10717 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.897629 10717 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:09.895143 10697 consensus_queue.cc:237] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:09.900295 10633 raft_consensus.cc:359] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.901407 10633 raft_consensus.cc:385] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.901539 10640 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.902009 10633 raft_consensus.cc:740] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.902231 10640 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.903255 10633 consensus_queue.cc:260] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.904769 10640 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:09.905812 10717 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:09.906921 10634 tablet_bootstrap.cc:654] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.908049 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:09.908272 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:09.910029 10480 leader_election.cc:343] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.912669 10633 ts_tablet_manager.cc:1434] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:02:09.918182 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.906960 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:09.920675 10478 leader_election.cc:343] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.914935 10735 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.928237 10735 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:09.900738 10440 raft_consensus.cc:2468] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
W20260709 13:02:09.937244 10480 leader_election.cc:343] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.937976 10480 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.940465 10635 ts_tablet_manager.cc:1434] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.145s	user 0.013s	sys 0.001s
I20260709 13:02:09.941711 10635 tablet_bootstrap.cc:492] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:09.943768 10640 raft_consensus.cc:2749] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.930636 10644 raft_consensus.cc:515] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:09.951601 10478 leader_election.cc:343] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.957192 10478 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:09.965976 10633 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:09.963574 10717 raft_consensus.cc:2749] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.976207 10634 tablet_bootstrap.cc:492] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:09.980482 10634 ts_tablet_manager.cc:1403] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.008s
I20260709 13:02:09.981645 10640 raft_consensus.cc:493] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.982365 10640 raft_consensus.cc:515] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:09.984961 10640 leader_election.cc:290] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:09.985848 10644 leader_election.cc:290] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:09.982730 10735 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:09.986565 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7974ab2c9b84e089e68b0dbd4927373" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:09.988131 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7974ab2c9b84e089e68b0dbd4927373" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:09.988444 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:09.989377 10362 raft_consensus.cc:2468] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:09.990432 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:09.990999 10552 leader_election.cc:304] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:09.991165 10514 raft_consensus.cc:2468] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
W20260709 13:02:09.989470 10480 leader_election.cc:343] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.991391 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:09.992331 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:09.993019 10644 raft_consensus.cc:2804] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.993628 10644 raft_consensus.cc:493] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.992372 10480 leader_election.cc:343] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.994185 10644 raft_consensus.cc:3060] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.994450 10480 leader_election.cc:304] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
W20260709 13:02:09.996399 10330 leader_election.cc:343] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.997269 10717 raft_consensus.cc:2749] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.000106 10632 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:10.001039 10632 ts_tablet_manager.cc:1403] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.241s	user 0.028s	sys 0.034s
W20260709 13:02:10.000125 10330 leader_election.cc:343] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.005635 10330 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:10.015281 10722 raft_consensus.cc:2749] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.025207 10633 tablet_bootstrap.cc:654] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.029139 10717 raft_consensus.cc:493] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.029861 10717 raft_consensus.cc:515] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.032644 10717 leader_election.cc:290] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.035033 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:10.035665 10634 raft_consensus.cc:359] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.036556 10634 raft_consensus.cc:385] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.036834 10634 raft_consensus.cc:740] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.035033 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:10.037824 10480 leader_election.cc:343] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:10.038691 10480 leader_election.cc:343] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.039500 10480 leader_election.cc:304] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:10.032691 10635 tablet_bootstrap.cc:654] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.040987 10717 raft_consensus.cc:2749] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.047956 10644 raft_consensus.cc:515] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.051458 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:10.052237 10511 raft_consensus.cc:3060] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.052666 10634 consensus_queue.cc:260] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.053684 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:10.055863 10632 raft_consensus.cc:359] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.057509 10632 raft_consensus.cc:385] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.057833 10632 raft_consensus.cc:740] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.055055 10362 raft_consensus.cc:3060] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.054991 10644 leader_election.cc:290] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:10.059340 10632 consensus_queue.cc:260] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.063864 10634 ts_tablet_manager.cc:1434] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:02:10.065249 10634 tablet_bootstrap.cc:492] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:10.078547 10511 raft_consensus.cc:2468] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:10.080891 10554 leader_election.cc:304] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:10.081981 10635 tablet_bootstrap.cc:492] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:10.082052 10644 raft_consensus.cc:2804] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.082814 10635 ts_tablet_manager.cc:1403] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.002s
I20260709 13:02:10.083642 10633 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:10.084283 10633 ts_tablet_manager.cc:1403] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.002s
I20260709 13:02:10.079950 10261 catalog_manager.cc:5697] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.083791 10362 raft_consensus.cc:2468] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:10.083173 10644 raft_consensus.cc:697] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:10.086405 10632 ts_tablet_manager.cc:1434] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 13:02:10.086762 10635 raft_consensus.cc:359] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.088903 10635 raft_consensus.cc:385] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.089233 10635 raft_consensus.cc:740] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.088390 10644 consensus_queue.cc:237] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.091722 10632 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.087344 10633 raft_consensus.cc:359] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.092235 10633 raft_consensus.cc:385] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.092540 10633 raft_consensus.cc:740] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.093405 10633 consensus_queue.cc:260] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.090019 10635 consensus_queue.cc:260] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.097441 10633 ts_tablet_manager.cc:1434] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:02:10.104746 10635 ts_tablet_manager.cc:1434] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:02:10.106140 10635 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.112067 10634 tablet_bootstrap.cc:654] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.121455 10632 tablet_bootstrap.cc:654] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.122124 10635 tablet_bootstrap.cc:654] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.112145 10722 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.122843 10722 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.126160 10722 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.127230 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.127473 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.128583 10511 raft_consensus.cc:2468] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
W20260709 13:02:10.129354 10330 leader_election.cc:343] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.130368 10330 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:10.131373 10735 raft_consensus.cc:2804] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.131852 10633 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:10.131935 10735 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.132556 10735 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.144816 10735 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.156704 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:10.157555 10511 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.169221 10511 raft_consensus.cc:2468] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:10.161384 10632 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:10.170687 10632 ts_tablet_manager.cc:1403] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.012s
I20260709 13:02:10.170917 10330 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:10.172091 10722 raft_consensus.cc:2804] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.173341 10722 raft_consensus.cc:697] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:10.174418 10722 consensus_queue.cc:237] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.175854 10632 raft_consensus.cc:359] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.186269 10632 raft_consensus.cc:385] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.186887 10632 raft_consensus.cc:740] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.188048 10632 consensus_queue.cc:260] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.190569 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
W20260709 13:02:10.194031 10330 leader_election.cc:343] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.194576 10632 ts_tablet_manager.cc:1434] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 13:02:10.195722 10735 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.196354 10632 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.199514 10635 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:10.200294 10635 ts_tablet_manager.cc:1403] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.036s
I20260709 13:02:10.204604 10635 raft_consensus.cc:359] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.205626 10635 raft_consensus.cc:385] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.205964 10635 raft_consensus.cc:740] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.206920 10635 consensus_queue.cc:260] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.211843 10697 raft_consensus.cc:493] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.212852 10697 raft_consensus.cc:515] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:10.213811 10403 consensus_peers.cc:597] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.215737 10632 tablet_bootstrap.cc:654] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.216074 10635 ts_tablet_manager.cc:1434] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:02:10.217676 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37a3271e472433d9feb62b8343643e7" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:10.220445 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37a3271e472433d9feb62b8343643e7" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.221521 10762 consensus_queue.cc:1048] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:10.224007 10554 leader_election.cc:343] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:10.224887 10554 leader_election.cc:343] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.225399 10554 leader_election.cc:304] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:10.226272 10794 raft_consensus.cc:2749] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.228399 10635 tablet_bootstrap.cc:492] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.220227 10697 leader_election.cc:290] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:10.240833 10259 catalog_manager.cc:5697] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.252292 10633 tablet_bootstrap.cc:654] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.266454 10635 tablet_bootstrap.cc:654] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.286837 10634 tablet_bootstrap.cc:492] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:10.287529 10634 ts_tablet_manager.cc:1403] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.013s
I20260709 13:02:10.303179 10697 consensus_queue.cc:1048] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.307621 10755 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.308471 10755 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.291026 10634 raft_consensus.cc:359] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.312912 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.312939 10634 raft_consensus.cc:385] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.313699 10634 raft_consensus.cc:740] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.313896 10588 raft_consensus.cc:2393] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate b4af86c3867e41659d5499027b08b924 in this term.
I20260709 13:02:10.314759 10634 consensus_queue.cc:260] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.315380 10735 consensus_queue.cc:1048] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.317613 10634 ts_tablet_manager.cc:1434] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:02:10.307695 10632 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:10.318842 10634 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:10.319411 10632 ts_tablet_manager.cc:1403] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.123s	user 0.026s	sys 0.014s
I20260709 13:02:10.322543 10635 tablet_bootstrap.cc:492] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:10.323220 10635 ts_tablet_manager.cc:1403] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.095s	user 0.024s	sys 0.011s
I20260709 13:02:10.326612 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:10.326442 10635 raft_consensus.cc:359] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.327713 10788 consensus_queue.cc:1048] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:02:10.328356 10260 catalog_manager.cc:5697] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.328877 10403 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:10.349156 10762 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.327504 10635 raft_consensus.cc:385] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.355217 10635 raft_consensus.cc:740] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.356031 10750 raft_consensus.cc:493] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.356879 10750 raft_consensus.cc:515] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.357559 10635 consensus_queue.cc:260] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.330264 10755 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:10.359483 10750 leader_election.cc:290] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.340691 10634 tablet_bootstrap.cc:654] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.364735 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7974ab2c9b84e089e68b0dbd4927373" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.364735 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7974ab2c9b84e089e68b0dbd4927373" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.329241 10633 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:10.395486 10633 ts_tablet_manager.cc:1403] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.264s	user 0.022s	sys 0.009s
I20260709 13:02:10.399307 10633 raft_consensus.cc:359] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.400633 10633 raft_consensus.cc:385] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.390800 10762 raft_consensus.cc:2749] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.336454 10632 raft_consensus.cc:359] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.401090 10633 raft_consensus.cc:740] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.401404 10632 raft_consensus.cc:385] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.401727 10632 raft_consensus.cc:740] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.402473 10633 consensus_queue.cc:260] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.403115 10632 consensus_queue.cc:260] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.405908 10632 ts_tablet_manager.cc:1434] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:02:10.407348 10632 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.409941 10635 ts_tablet_manager.cc:1434] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.012s
I20260709 13:02:10.411448 10635 tablet_bootstrap.cc:492] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.390700 10588 raft_consensus.cc:2468] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:10.415367 10632 tablet_bootstrap.cc:654] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.414996 10809 consensus_queue.cc:1048] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.418479 10405 leader_election.cc:304] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:10.419768 10762 raft_consensus.cc:2804] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.420269 10762 raft_consensus.cc:493] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.420727 10762 raft_consensus.cc:3060] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.394579 10514 raft_consensus.cc:2468] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
W20260709 13:02:10.391527 10815 log.cc:927] Time spent T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:10.418865 10635 tablet_bootstrap.cc:654] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.433385 10633 ts_tablet_manager.cc:1434] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:02:10.434628 10640 raft_consensus.cc:493] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.436372 10640 raft_consensus.cc:515] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.441375 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:10.443456 10478 leader_election.cc:343] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.445176 10640 leader_election.cc:290] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:10.451532 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.452221 10635 tablet_bootstrap.cc:492] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:10.452975 10635 ts_tablet_manager.cc:1403] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.005s
W20260709 13:02:10.453625 10480 leader_election.cc:343] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.454190 10480 leader_election.cc:304] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:10.456671 10640 raft_consensus.cc:2749] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.461834 10635 raft_consensus.cc:359] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.462749 10635 raft_consensus.cc:385] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.467700 10635 raft_consensus.cc:740] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.468736 10635 consensus_queue.cc:260] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.472211 10635 ts_tablet_manager.cc:1434] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:02:10.473004 10633 tablet_bootstrap.cc:492] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:10.473536 10635 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.489444 10640 raft_consensus.cc:493] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.490384 10640 raft_consensus.cc:515] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.497071 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83813c5ebc124df1a2eac0d37f2e6393" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:10.498219 10818 raft_consensus.cc:493] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.498896 10818 raft_consensus.cc:515] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:10.499940 10478 leader_election.cc:343] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.501600 10818 leader_election.cc:290] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.487350 10635 tablet_bootstrap.cc:654] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.508404 10640 leader_election.cc:290] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:10.508610 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.511924 10514 raft_consensus.cc:2468] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:10.513345 10405 leader_election.cc:304] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:10.509416 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.515336 10818 raft_consensus.cc:2804] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.515820 10818 raft_consensus.cc:493] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.516208 10818 raft_consensus.cc:3060] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:10.515820 10821 log.cc:927] Time spent T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:02:10.516389 10405 leader_election.cc:343] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.510504 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83813c5ebc124df1a2eac0d37f2e6393" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:10.506945 10762 raft_consensus.cc:515] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:10.529867 10480 leader_election.cc:343] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.530027 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7974ab2c9b84e089e68b0dbd4927373" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:10.530493 10480 leader_election.cc:304] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:10.530807 10514 raft_consensus.cc:3060] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.531905 10640 raft_consensus.cc:2749] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.539347 10818 raft_consensus.cc:515] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.542871 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:10.543674 10512 raft_consensus.cc:3060] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.544186 10633 tablet_bootstrap.cc:654] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.561601 10818 leader_election.cc:290] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.561915 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:10.558955 10512 raft_consensus.cc:2468] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:10.545403 10514 raft_consensus.cc:2468] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
W20260709 13:02:10.566167 10405 leader_election.cc:343] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.567086 10405 leader_election.cc:304] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:10.571159 10405 leader_election.cc:304] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:10.567219 10788 consensus_queue.cc:1048] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.574255 10750 raft_consensus.cc:2804] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.574940 10750 raft_consensus.cc:697] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:10.568933 10632 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:10.579598 10762 leader_election.cc:290] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.576437 10755 raft_consensus.cc:2804] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.584374 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7974ab2c9b84e089e68b0dbd4927373" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:10.586772 10632 ts_tablet_manager.cc:1403] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.172s	user 0.045s	sys 0.046s
I20260709 13:02:10.599269 10588 raft_consensus.cc:3060] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.576087 10750 consensus_queue.cc:237] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.588187 10635 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
W20260709 13:02:10.592546 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:10.595224 10697 consensus_queue.cc:1048] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.598453 10755 raft_consensus.cc:697] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:10.604262 10635 ts_tablet_manager.cc:1403] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.131s	user 0.032s	sys 0.008s
I20260709 13:02:10.609942 10755 consensus_queue.cc:237] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.604779 10818 raft_consensus.cc:493] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.611967 10818 raft_consensus.cc:515] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.617383 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37a3271e472433d9feb62b8343643e7" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.618305 10588 raft_consensus.cc:2468] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
W20260709 13:02:10.621165 10405 leader_election.cc:343] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.624287 10635 raft_consensus.cc:359] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.625540 10635 raft_consensus.cc:385] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.625921 10635 raft_consensus.cc:740] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.603310 10632 raft_consensus.cc:359] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.608907 10634 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:10.627844 10632 raft_consensus.cc:385] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.628201 10634 ts_tablet_manager.cc:1403] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.310s	user 0.021s	sys 0.018s
I20260709 13:02:10.628294 10632 raft_consensus.cc:740] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.631516 10632 consensus_queue.cc:260] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.627079 10635 consensus_queue.cc:260] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.652232 10635 ts_tablet_manager.cc:1434] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:02:10.654740 10632 ts_tablet_manager.cc:1434] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:02:10.658632 10634 raft_consensus.cc:359] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.660524 10634 raft_consensus.cc:385] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.661072 10634 raft_consensus.cc:740] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.661613 10632 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.662359 10635 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.661974 10634 consensus_queue.cc:260] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.667449 10818 leader_election.cc:290] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:10.669854 10330 consensus_peers.cc:597] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 -> Peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Couldn't send request to peer 40a50bcbfe194a288c6b3333e6556a88. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.658833 10722 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.670809 10722 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.673405 10722 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:10.673569 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37a3271e472433d9feb62b8343643e7" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.674413 10586 raft_consensus.cc:2468] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:10.676620 10405 leader_election.cc:304] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:10.680241 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:10.681975 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.683409 10825 raft_consensus.cc:2804] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.684129 10825 raft_consensus.cc:493] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.684568 10825 raft_consensus.cc:3060] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:10.687194 10330 leader_election.cc:343] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.689782 10633 tablet_bootstrap.cc:492] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:10.690423 10632 tablet_bootstrap.cc:654] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.698516 10633 ts_tablet_manager.cc:1403] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.238s	user 0.042s	sys 0.053s
I20260709 13:02:10.703027 10260 catalog_manager.cc:5697] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.694114 10635 tablet_bootstrap.cc:654] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.705672 10260 catalog_manager.cc:5697] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.715660 10633 raft_consensus.cc:359] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.716670 10633 raft_consensus.cc:385] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.717681 10633 raft_consensus.cc:740] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.717926 10830 raft_consensus.cc:493] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.718573 10830 raft_consensus.cc:515] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.718856 10633 consensus_queue.cc:260] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.721997 10633 ts_tablet_manager.cc:1434] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:10.723160 10634 ts_tablet_manager.cc:1434] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.001s
I20260709 13:02:10.741577 10830 leader_election.cc:290] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:10.725536 10633 tablet_bootstrap.cc:492] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:10.728889 10722 consensus_queue.cc:1048] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.771759 10633 tablet_bootstrap.cc:654] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.753073 10635 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
W20260709 13:02:10.749361 10330 leader_election.cc:343] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.773348 10635 ts_tablet_manager.cc:1403] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.011s
I20260709 13:02:10.773495 10330 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:10.776834 10722 raft_consensus.cc:2749] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.777901 10635 raft_consensus.cc:359] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.778889 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.779127 10635 raft_consensus.cc:385] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.782310 10825 raft_consensus.cc:515] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.784111 10635 raft_consensus.cc:740] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.784495 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:10.784991 10635 consensus_queue.cc:260] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.786149 10825 leader_election.cc:290] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:10.787122 10635 ts_tablet_manager.cc:1434] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:02:10.783141 10632 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:10.789623 10632 ts_tablet_manager.cc:1403] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.017s
I20260709 13:02:10.790354 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37a3271e472433d9feb62b8343643e7" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:10.791132 10511 raft_consensus.cc:3060] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.795738 10635 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.798574 10633 tablet_bootstrap.cc:492] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:10.799664 10633 ts_tablet_manager.cc:1403] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.076s	user 0.033s	sys 0.010s
I20260709 13:02:10.801744 10360 raft_consensus.cc:3060] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.804520 10633 raft_consensus.cc:359] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.811266 10633 raft_consensus.cc:385] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.811978 10633 raft_consensus.cc:740] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.813150 10633 consensus_queue.cc:260] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.809301 10330 leader_election.cc:304] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:10.821197 10633 ts_tablet_manager.cc:1434] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:02:10.822996 10633 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:10.807899 10632 raft_consensus.cc:359] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.824829 10632 raft_consensus.cc:385] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.818085 10635 tablet_bootstrap.cc:654] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.831061 10634 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:10.831951 10632 raft_consensus.cc:740] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.835197 10632 consensus_queue.cc:260] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.837024 10633 tablet_bootstrap.cc:654] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.840431 10632 ts_tablet_manager.cc:1434] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:02:10.841707 10632 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.849467 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37a3271e472433d9feb62b8343643e7" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:10.850797 10588 raft_consensus.cc:3060] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.853963 10632 tablet_bootstrap.cc:654] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.853983 10511 raft_consensus.cc:2468] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:10.859191 10405 leader_election.cc:304] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:10.862082 10750 raft_consensus.cc:2804] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.862617 10830 raft_consensus.cc:493] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.864408 10633 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:10.863492 10830 raft_consensus.cc:515] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:10.862661 10750 raft_consensus.cc:697] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:10.867262 10750 consensus_queue.cc:237] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.868836 10633 ts_tablet_manager.cc:1403] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.004s
I20260709 13:02:10.867290 10830 leader_election.cc:290] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:10.872422 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:10.874572 10330 leader_election.cc:343] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.876099 10635 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:10.877275 10635 ts_tablet_manager.cc:1403] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.006s
I20260709 13:02:10.882623 10635 raft_consensus.cc:359] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.883808 10635 raft_consensus.cc:385] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.884191 10635 raft_consensus.cc:740] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.885061 10635 consensus_queue.cc:260] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.886901 10633 raft_consensus.cc:359] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.891230 10633 raft_consensus.cc:385] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.891525 10635 ts_tablet_manager.cc:1434] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.002s
I20260709 13:02:10.893471 10635 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:10.891790 10633 raft_consensus.cc:740] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.895838 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:10.895915 10632 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
W20260709 13:02:10.900025 10330 leader_election.cc:343] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.900501 10632 ts_tablet_manager.cc:1403] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.010s
I20260709 13:02:10.900713 10330 leader_election.cc:304] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:10.903157 10830 raft_consensus.cc:2749] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.907238 10634 tablet_bootstrap.cc:654] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.908004 10633 consensus_queue.cc:260] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.908375 10632 raft_consensus.cc:359] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.913522 10632 raft_consensus.cc:385] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.914115 10632 raft_consensus.cc:740] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.915864 10632 consensus_queue.cc:260] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.918651 10633 ts_tablet_manager.cc:1434] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.004s
I20260709 13:02:10.919996 10633 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:10.922963 10632 ts_tablet_manager.cc:1434] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:02:10.924417 10632 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.925009 10588 raft_consensus.cc:2468] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:10.938213 10633 tablet_bootstrap.cc:654] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.943297 10634 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:10.944032 10634 ts_tablet_manager.cc:1403] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.003s
I20260709 13:02:10.945274 10632 tablet_bootstrap.cc:654] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.948722 10634 raft_consensus.cc:359] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.950044 10634 raft_consensus.cc:385] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.950722 10634 raft_consensus.cc:740] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.951869 10634 consensus_queue.cc:260] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.955801 10634 ts_tablet_manager.cc:1434] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:02:10.957077 10634 tablet_bootstrap.cc:492] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:10.957696 10809 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.958417 10809 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.959820 10632 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:10.962093 10632 ts_tablet_manager.cc:1403] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:02:10.965623 10634 tablet_bootstrap.cc:654] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.966558 10722 raft_consensus.cc:2749] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.967761 10632 raft_consensus.cc:359] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.968564 10632 raft_consensus.cc:385] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.969139 10635 tablet_bootstrap.cc:654] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.947093 10258 catalog_manager.cc:5697] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.968827 10632 raft_consensus.cc:740] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.978334 10788 raft_consensus.cc:493] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.979276 10788 raft_consensus.cc:515] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:10.982101 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.983629 10788 leader_election.cc:290] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:10.978303 10632 consensus_queue.cc:260] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:10.985369 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:10.986397 10362 raft_consensus.cc:2468] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:10.988385 10632 ts_tablet_manager.cc:1434] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:02:10.988497 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:10.989224 10634 tablet_bootstrap.cc:492] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:10.989714 10632 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:10.989877 10514 raft_consensus.cc:2468] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:10.990254 10634 ts_tablet_manager.cc:1403] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.010s
I20260709 13:02:10.991820 10554 leader_election.cc:304] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:10.994472 10634 raft_consensus.cc:359] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:10.995218 10634 raft_consensus.cc:385] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.995500 10634 raft_consensus.cc:740] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.995743 10750 raft_consensus.cc:493] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.996587 10788 raft_consensus.cc:2804] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.002581 10788 raft_consensus.cc:493] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.996371 10750 raft_consensus.cc:515] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.003134 10788 raft_consensus.cc:3060] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.999249 10634 consensus_queue.cc:260] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:11.007162 10330 leader_election.cc:343] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.014477 10809 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:11.015183 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.014940 10835 raft_consensus.cc:493] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.018100 10835 raft_consensus.cc:515] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.007396 10755 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.020167 10755 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.020902 10835 leader_election.cc:290] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.025030 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a410e026f642eb97377be90f0dc9ab" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.026158 10437 raft_consensus.cc:2468] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
W20260709 13:02:11.034252 10405 consensus_peers.cc:597] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 -> Peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Couldn't send request to peer 40a50bcbfe194a288c6b3333e6556a88. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.036437 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.038444 10755 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:11.040874 10405 leader_election.cc:343] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:11.042235 10330 leader_election.cc:343] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.043474 10330 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:11.029693 10480 leader_election.cc:304] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:11.045512 10835 raft_consensus.cc:2804] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.046063 10835 raft_consensus.cc:493] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.046434 10835 raft_consensus.cc:3060] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.138666 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.143710 10635 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:11.144388 10750 leader_election.cc:290] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:11.145488 10635 ts_tablet_manager.cc:1403] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.252s	user 0.043s	sys 0.018s
I20260709 13:02:11.148245 10788 raft_consensus.cc:515] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.149823 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83813c5ebc124df1a2eac0d37f2e6393" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:11.150770 10514 raft_consensus.cc:2468] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:11.152917 10635 raft_consensus.cc:359] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.154397 10635 raft_consensus.cc:385] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.155994 10632 tablet_bootstrap.cc:700] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Time spent opening tablet: real 0.111s	user 0.001s	sys 0.012s
I20260709 13:02:11.156850 10632 tablet_bootstrap.cc:654] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.160741 10788 leader_election.cc:290] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:11.162321 10640 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.159974 10835 raft_consensus.cc:515] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.163725 10640 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:11.161726 10809 raft_consensus.cc:2749] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.154964 10635 raft_consensus.cc:740] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.167464 10640 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:11.168939 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a410e026f642eb97377be90f0dc9ab" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
W20260709 13:02:11.173491 10478 leader_election.cc:343] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.174306 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83813c5ebc124df1a2eac0d37f2e6393" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.176187 10835 leader_election.cc:290] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.175932 10405 leader_election.cc:304] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:11.183847 10633 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:11.186465 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:11.192798 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a410e026f642eb97377be90f0dc9ab" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:11.203943 10360 raft_consensus.cc:3060] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.203980 10439 raft_consensus.cc:3060] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.204033 10633 ts_tablet_manager.cc:1403] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.284s	user 0.040s	sys 0.014s
I20260709 13:02:11.174961 10635 consensus_queue.cc:260] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.210366 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a410e026f642eb97377be90f0dc9ab" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.192022 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.211131 10633 raft_consensus.cc:359] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.210424 10635 ts_tablet_manager.cc:1434] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.001s
I20260709 13:02:11.194517 10634 ts_tablet_manager.cc:1434] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.203s	user 0.009s	sys 0.007s
W20260709 13:02:11.212648 10478 leader_election.cc:343] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.212996 10755 raft_consensus.cc:2804] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.213212 10635 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:11.233196 10634 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:11.233667 10755 raft_consensus.cc:493] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.234445 10755 raft_consensus.cc:3060] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.196849 10846 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.236371 10846 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.214781 10825 consensus_queue.cc:1048] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.211958 10633 raft_consensus.cc:385] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:11.239198 10480 leader_election.cc:343] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.215811 10794 raft_consensus.cc:493] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.181612 10403 leader_election.cc:343] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.242007 10403 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:11.241852 10794 raft_consensus.cc:515] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:11.243131 10403 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 61607.5us
I20260709 13:02:11.217947 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.220665 10360 raft_consensus.cc:2468] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:11.244308 10794 leader_election.cc:290] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:11.223667 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:11.225577 10632 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:11.215565 10750 consensus_queue.cc:1048] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:11.241034 10439 raft_consensus.cc:2468] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
W20260709 13:02:11.244314 10403 leader_election.cc:343] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.248056 10750 raft_consensus.cc:2749] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.246407 10514 raft_consensus.cc:3060] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.240638 10633 raft_consensus.cc:740] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.249734 10633 consensus_queue.cc:260] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.254652 10634 tablet_bootstrap.cc:654] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.256503 10552 leader_election.cc:304] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:11.257165 10633 ts_tablet_manager.cc:1434] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 13:02:11.246663 10632 ts_tablet_manager.cc:1403] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.257s	user 0.015s	sys 0.016s
I20260709 13:02:11.257666 10788 raft_consensus.cc:2804] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.258276 10788 raft_consensus.cc:697] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:11.258447 10633 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:11.257026 10480 leader_election.cc:304] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:11.259272 10788 consensus_queue.cc:237] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:11.260855 10480 leader_election.cc:343] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.262176 10632 raft_consensus.cc:359] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.262069 10640 raft_consensus.cc:2804] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.261857 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.267501 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.267913 10640 raft_consensus.cc:697] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:11.268098 10588 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:11.268779 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:11.269357 10640 consensus_queue.cc:237] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.269945 10511 raft_consensus.cc:2393] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:11.261402 10480 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:11.272962 10835 raft_consensus.cc:2749] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.263468 10632 raft_consensus.cc:385] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.275110 10632 raft_consensus.cc:740] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.277159 10632 consensus_queue.cc:260] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:11.265914 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 51087.1us
I20260709 13:02:11.281924 10480 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:11.283142 10835 raft_consensus.cc:2804] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.246559 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.283668 10835 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.284004 10361 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:11.284147 10835 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.244412 10846 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:11.286353 10635 tablet_bootstrap.cc:654] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.289147 10735 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.289812 10735 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.293429 10735 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:11.280788 10632 ts_tablet_manager.cc:1434] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:02:11.300349 10632 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:11.296077 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:11.323328 10633 tablet_bootstrap.cc:654] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.307375 10848 consensus_queue.cc:1048] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:02:11.291366 10755 raft_consensus.cc:515] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.312569 10514 raft_consensus.cc:2468] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:11.347874 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.324052 10511 raft_consensus.cc:2468] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:11.350368 10330 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:11.352528 10735 raft_consensus.cc:2804] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.352810 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83813c5ebc124df1a2eac0d37f2e6393" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:11.353057 10735 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.353652 10735 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.353739 10362 raft_consensus.cc:3060] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.356134 10755 leader_election.cc:290] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
W20260709 13:02:11.367134 10330 leader_election.cc:343] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.332367 10554 leader_election.cc:304] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:11.373916 10644 raft_consensus.cc:3060] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:11.376013 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 43742.5us
I20260709 13:02:11.381141 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83813c5ebc124df1a2eac0d37f2e6393" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:11.382061 10511 raft_consensus.cc:3060] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.382591 10634 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:11.386693 10634 ts_tablet_manager.cc:1403] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.018s
I20260709 13:02:11.387488 10848 consensus_queue.cc:1048] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.400746 10634 raft_consensus.cc:359] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.401763 10634 raft_consensus.cc:385] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.402482 10634 raft_consensus.cc:740] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.408469 10755 consensus_queue.cc:1048] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.412276 10634 consensus_queue.cc:260] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.426026 10825 raft_consensus.cc:493] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.432264 10825 raft_consensus.cc:515] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.433097 10644 raft_consensus.cc:2749] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.409689 10835 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.435456 10825 leader_election.cc:290] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:11.436740 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.442009 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.439802 10634 ts_tablet_manager.cc:1434] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 13:02:11.441982 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
W20260709 13:02:11.445695 10405 leader_election.cc:343] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.446003 10586 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.453390 10634 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:11.465638 10633 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:11.466432 10633 ts_tablet_manager.cc:1403] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.007s
I20260709 13:02:11.436578 10511 raft_consensus.cc:2468] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:11.473220 10405 leader_election.cc:304] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:11.478379 10633 raft_consensus.cc:359] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.488828 10835 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:11.460702 10403 leader_election.cc:343] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.489661 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:11.490029 10403 leader_election.cc:304] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:11.490552 10361 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.496407 10848 raft_consensus.cc:2749] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.479329 10633 raft_consensus.cc:385] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.499060 10633 raft_consensus.cc:740] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.500442 10633 consensus_queue.cc:260] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.504978 10634 tablet_bootstrap.cc:654] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.505349 10633 ts_tablet_manager.cc:1434] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:02:11.497613 10755 raft_consensus.cc:2804] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.510294 10633 tablet_bootstrap.cc:492] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:11.515655 10755 raft_consensus.cc:697] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:11.516969 10755 consensus_queue.cc:237] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.510288 10261 catalog_manager.cc:5697] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.535251 10259 catalog_manager.cc:5697] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.538024 10635 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:11.538990 10635 ts_tablet_manager.cc:1403] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.326s	user 0.018s	sys 0.030s
I20260709 13:02:11.503940 10735 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.560086 10846 raft_consensus.cc:493] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.560895 10846 raft_consensus.cc:515] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.564301 10846 leader_election.cc:290] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.564841 10586 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:11.566576 10735 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:11.584919 10480 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:11.587076 10846 raft_consensus.cc:2804] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.587814 10846 raft_consensus.cc:697] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:11.588726 10846 consensus_queue.cc:237] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.569371 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d5c2fee8bc4c7cb4ec2dceb9b5ca36" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.571130 10632 tablet_bootstrap.cc:654] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.570899 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d5c2fee8bc4c7cb4ec2dceb9b5ca36" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.574074 10362 raft_consensus.cc:2468] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:11.573879 10635 raft_consensus.cc:359] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.594825 10635 raft_consensus.cc:385] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.595239 10635 raft_consensus.cc:740] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.574823 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:11.596210 10513 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.596015 10635 consensus_queue.cc:260] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.598949 10635 ts_tablet_manager.cc:1434] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:02:11.600129 10635 tablet_bootstrap.cc:492] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:11.600679 10436 raft_consensus.cc:2468] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
W20260709 13:02:11.601056 10478 leader_election.cc:343] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.576879 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:11.579505 10633 tablet_bootstrap.cc:654] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.607697 10480 leader_election.cc:304] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:11.608937 10640 raft_consensus.cc:2804] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.609701 10640 raft_consensus.cc:493] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.610145 10640 raft_consensus.cc:3060] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:11.611400 10330 leader_election.cc:343] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.618708 10635 tablet_bootstrap.cc:654] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.628499 10513 raft_consensus.cc:2468] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
W20260709 13:02:11.633824 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 160729us
I20260709 13:02:11.634518 10330 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:11.644618 10735 raft_consensus.cc:2804] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.646392 10735 raft_consensus.cc:697] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:11.647585 10735 consensus_queue.cc:237] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.651161 10361 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:11.655239 10864 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.656208 10864 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.659474 10644 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.660399 10644 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.664708 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.665627 10362 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:11.668574 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.671808 10584 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:11.672778 10644 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.674029 10552 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:11.674746 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.677352 10436 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:11.680615 10644 raft_consensus.cc:2804] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.681318 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.681514 10644 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.682334 10644 raft_consensus.cc:3060] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.682514 10864 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:11.677599 10640 raft_consensus.cc:515] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.688710 10634 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:11.692266 10635 tablet_bootstrap.cc:492] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:11.691948 10405 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:11.695112 10632 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:11.701056 10634 ts_tablet_manager.cc:1403] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.253s	user 0.020s	sys 0.001s
I20260709 13:02:11.701195 10635 ts_tablet_manager.cc:1403] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.005s
I20260709 13:02:11.702471 10632 ts_tablet_manager.cc:1403] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.402s	user 0.023s	sys 0.006s
I20260709 13:02:11.704375 10864 raft_consensus.cc:2804] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.682369 10361 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:11.706900 10864 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.709983 10864 raft_consensus.cc:3060] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.712929 10635 raft_consensus.cc:359] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:11.714001 10635 raft_consensus.cc:385] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.713544 10633 tablet_bootstrap.cc:492] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:11.714371 10635 raft_consensus.cc:740] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.714951 10633 ts_tablet_manager.cc:1403] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.205s	user 0.020s	sys 0.006s
I20260709 13:02:11.716953 10635 consensus_queue.cc:260] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:11.721395 10846 consensus_queue.cc:1048] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.725485 10632 raft_consensus.cc:359] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.727115 10632 raft_consensus.cc:385] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.727526 10632 raft_consensus.cc:740] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.728415 10632 consensus_queue.cc:260] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.731050 10632 ts_tablet_manager.cc:1434] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:02:11.732290 10632 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:11.732905 10633 raft_consensus.cc:359] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:11.733904 10633 raft_consensus.cc:385] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.734218 10633 raft_consensus.cc:740] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.736980 10635 ts_tablet_manager.cc:1434] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.003s
I20260709 13:02:11.739328 10635 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:11.741118 10632 tablet_bootstrap.cc:654] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.743026 10640 leader_election.cc:290] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.743198 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d5c2fee8bc4c7cb4ec2dceb9b5ca36" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:11.744310 10439 raft_consensus.cc:3060] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.744514 10644 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.746722 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d5c2fee8bc4c7cb4ec2dceb9b5ca36" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:11.747840 10634 raft_consensus.cc:359] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.749501 10634 raft_consensus.cc:385] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.735039 10633 consensus_queue.cc:260] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:11.748773 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
W20260709 13:02:11.752087 10478 leader_election.cc:343] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.751966 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:11.760856 10362 raft_consensus.cc:3060] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.764997 10788 consensus_queue.cc:1048] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.748829 10644 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.750070 10634 raft_consensus.cc:740] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.769167 10634 consensus_queue.cc:260] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.775496 10634 ts_tablet_manager.cc:1434] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
W20260709 13:02:11.787585 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:11.788278 10634 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:11.793164 10635 tablet_bootstrap.cc:654] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.800928 10633 ts_tablet_manager.cc:1434] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.001s
I20260709 13:02:11.814137 10634 tablet_bootstrap.cc:654] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.816365 10864 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.817973 10437 raft_consensus.cc:2393] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:11.828569 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:11.831166 10586 raft_consensus.cc:2393] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:11.828606 10258 catalog_manager.cc:5697] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.834847 10364 raft_consensus.cc:3060] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.851643 10260 catalog_manager.cc:5697] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.860039 10864 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:11.862694 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:11.869441 10633 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:11.875248 10403 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:11.878286 10755 raft_consensus.cc:2749] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.885241 10846 consensus_queue.cc:1048] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.889750 10846 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.890959 10846 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.896212 10849 consensus_queue.cc:1048] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.885496 10439 raft_consensus.cc:2468] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:11.903916 10644 raft_consensus.cc:493] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.905211 10846 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:11.905409 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:11.907015 10362 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:11.908313 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.921383 10360 raft_consensus.cc:2468] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
W20260709 13:02:11.918815 10480 leader_election.cc:343] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.924333 10480 leader_election.cc:304] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:11.926291 10632 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:11.926056 10478 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:11.926882 10632 ts_tablet_manager.cc:1403] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.031s
I20260709 13:02:11.927161 10855 raft_consensus.cc:2804] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.927346 10644 raft_consensus.cc:515] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.928102 10855 raft_consensus.cc:697] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:11.929168 10855 consensus_queue.cc:237] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.930259 10644 leader_election.cc:290] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:11.931788 10835 raft_consensus.cc:2804] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.933058 10835 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.934759 10835 raft_consensus.cc:3060] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.940865 10634 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:11.941527 10634 ts_tablet_manager.cc:1403] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.007s
I20260709 13:02:11.934954 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:11.944056 10552 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:11.945348 10644 raft_consensus.cc:2804] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.946285 10644 raft_consensus.cc:697] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:11.947350 10644 consensus_queue.cc:237] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:11.948050 10634 raft_consensus.cc:359] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.949608 10634 raft_consensus.cc:385] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.949957 10634 raft_consensus.cc:740] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.952001 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:11.952863 10439 raft_consensus.cc:2468] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:11.954686 10554 leader_election.cc:304] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:11.936910 10846 raft_consensus.cc:493] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.956665 10849 raft_consensus.cc:2804] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.959393 10849 raft_consensus.cc:493] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.960027 10849 raft_consensus.cc:3060] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.950826 10634 consensus_queue.cc:260] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:11.965925 10632 raft_consensus.cc:359] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.966969 10632 raft_consensus.cc:385] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.967303 10632 raft_consensus.cc:740] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
W20260709 13:02:11.965250 10552 leader_election.cc:343] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.965039 10846 raft_consensus.cc:515] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:11.974469 10632 consensus_queue.cc:260] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:11.975790 10635 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:11.976871 10635 ts_tablet_manager.cc:1403] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.238s	user 0.040s	sys 0.042s
I20260709 13:02:11.978711 10634 ts_tablet_manager.cc:1434] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 13:02:11.982753 10634 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:11.985769 10633 tablet_bootstrap.cc:654] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.960315 10258 catalog_manager.cc:5697] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.990078 10632 ts_tablet_manager.cc:1434] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.063s	user 0.011s	sys 0.000s
I20260709 13:02:12.003779 10635 raft_consensus.cc:359] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.004684 10635 raft_consensus.cc:385] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.004978 10635 raft_consensus.cc:740] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.006421 10632 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:12.006340 10635 consensus_queue.cc:260] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.016705 10633 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:12.017695 10633 ts_tablet_manager.cc:1403] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.004s
I20260709 13:02:12.022326 10633 raft_consensus.cc:359] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.023307 10633 raft_consensus.cc:385] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.023072 10835 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.023726 10633 raft_consensus.cc:740] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.023792 10864 consensus_queue.cc:1048] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.024905 10633 consensus_queue.cc:260] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.027427 10794 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.028496 10835 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.030776 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:12.032364 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:12.033155 10360 raft_consensus.cc:3060] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.034317 10854 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.037461 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 55438us
W20260709 13:02:12.038138 10480 leader_election.cc:343] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.028581 10794 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.041690 10794 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.042611 10849 raft_consensus.cc:515] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.034935 10854 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.053539 10633 ts_tablet_manager.cc:1434] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.035s	user 0.000s	sys 0.007s
I20260709 13:02:12.045374 10755 consensus_queue.cc:1048] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.044891 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:12.057515 10635 ts_tablet_manager.cc:1434] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:02:12.062011 10633 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:12.066638 10635 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:12.088874 10854 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:12.090232 10632 tablet_bootstrap.cc:654] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.092568 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:12.094058 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:12.095824 10514 raft_consensus.cc:2468] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:12.097178 10846 leader_election.cc:290] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:12.097942 10405 leader_election.cc:343] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.099020 10360 raft_consensus.cc:2468] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:12.099421 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8888b8a7dea849eeb0d1a87c9a347e9c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:12.100986 10478 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:12.101366 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8888b8a7dea849eeb0d1a87c9a347e9c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:12.103426 10846 raft_consensus.cc:2804] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.104489 10846 raft_consensus.cc:697] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:12.105599 10846 consensus_queue.cc:237] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.103494 10405 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
W20260709 13:02:12.111997 10480 leader_election.cc:343] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.114056 10755 raft_consensus.cc:2804] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.114850 10755 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.115396 10755 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:12.117461 10480 leader_election.cc:343] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.118462 10480 leader_election.cc:304] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:12.120915 10835 raft_consensus.cc:2749] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.123750 10849 leader_election.cc:290] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:12.125634 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:12.126607 10436 raft_consensus.cc:3060] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.127039 10640 consensus_queue.cc:1048] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.147215 10634 tablet_bootstrap.cc:654] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.139328 10633 tablet_bootstrap.cc:654] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.152647 10735 raft_consensus.cc:493] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.159480 10632 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:12.160709 10632 ts_tablet_manager.cc:1403] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.004s
I20260709 13:02:12.153753 10735 raft_consensus.cc:515] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.179447 10809 consensus_queue.cc:1048] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.192157 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d5c2fee8bc4c7cb4ec2dceb9b5ca36" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:12.193163 10437 raft_consensus.cc:2393] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 1: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:12.199476 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.201782 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:12.207331 10632 raft_consensus.cc:359] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.210033 10632 raft_consensus.cc:385] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.210388 10632 raft_consensus.cc:740] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.214557 10632 consensus_queue.cc:260] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.219848 10361 raft_consensus.cc:3060] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.236588 10632 ts_tablet_manager.cc:1434] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.076s	user 0.013s	sys 0.007s
I20260709 13:02:12.238130 10632 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:12.252702 10552 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:12.230083 10735 leader_election.cc:290] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:12.256021 10849 raft_consensus.cc:2749] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.269953 10632 tablet_bootstrap.cc:654] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.274137 10634 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.274909 10634 ts_tablet_manager.cc:1403] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.295s	user 0.007s	sys 0.014s
I20260709 13:02:12.276024 10755 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.278708 10635 tablet_bootstrap.cc:654] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.275341 10633 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:12.278553 10755 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:12.281400 10633 ts_tablet_manager.cc:1403] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.220s	user 0.022s	sys 0.005s
I20260709 13:02:12.300065 10436 raft_consensus.cc:2468] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:12.277971 10260 catalog_manager.cc:5697] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.284152 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d5c2fee8bc4c7cb4ec2dceb9b5ca36" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:12.288964 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:12.289847 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:12.290225 10835 consensus_queue.cc:1048] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.295495 10361 raft_consensus.cc:2468] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:12.296722 10634 raft_consensus.cc:359] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.302271 10554 leader_election.cc:304] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:12.304414 10633 raft_consensus.cc:359] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.317067 10633 raft_consensus.cc:385] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:12.308156 10405 leader_election.cc:343] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.317222 10794 raft_consensus.cc:2804] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.318392 10794 raft_consensus.cc:697] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
W20260709 13:02:12.302817 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 50273.1us
I20260709 13:02:12.319592 10794 consensus_queue.cc:237] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.308244 10512 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.324872 10634 raft_consensus.cc:385] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.325503 10634 raft_consensus.cc:740] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.326515 10634 consensus_queue.cc:260] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.317484 10633 raft_consensus.cc:740] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.333999 10633 consensus_queue.cc:260] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.339115 10634 ts_tablet_manager.cc:1434] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.003s
I20260709 13:02:12.340500 10634 tablet_bootstrap.cc:492] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.341086 10633 ts_tablet_manager.cc:1434] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
W20260709 13:02:12.342207 10330 consensus_peers.cc:597] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.344869 10633 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:12.346832 10635 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:12.347469 10635 ts_tablet_manager.cc:1403] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.281s	user 0.010s	sys 0.016s
I20260709 13:02:12.352123 10586 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.356343 10835 raft_consensus.cc:493] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.357034 10835 raft_consensus.cc:515] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.361142 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8efb10cd18e427c897514fa94979888" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:12.363162 10480 leader_election.cc:343] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.364084 10512 raft_consensus.cc:2468] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:12.366230 10405 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:12.367764 10755 raft_consensus.cc:2804] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.368355 10755 raft_consensus.cc:697] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:12.368721 10835 leader_election.cc:290] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.369213 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8efb10cd18e427c897514fa94979888" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.369338 10755 consensus_queue.cc:237] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.371670 10634 tablet_bootstrap.cc:654] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:12.371377 10478 leader_election.cc:343] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.373713 10478 leader_election.cc:304] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:12.376111 10330 leader_election.cc:304] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:12.377183 10902 raft_consensus.cc:3060] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.378975 10835 raft_consensus.cc:2749] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.380556 10633 tablet_bootstrap.cc:654] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.355162 10635 raft_consensus.cc:359] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.381245 10635 raft_consensus.cc:385] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.381942 10635 raft_consensus.cc:740] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.382481 10825 raft_consensus.cc:493] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.383154 10825 raft_consensus.cc:515] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.383912 10635 consensus_queue.cc:260] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.360421 10258 catalog_manager.cc:5697] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.388118 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.389142 10364 raft_consensus.cc:2468] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:12.390609 10825 leader_election.cc:290] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.390355 10258 catalog_manager.cc:5697] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:12.391768 10403 leader_election.cc:304] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:12.393860 10825 raft_consensus.cc:2804] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.394379 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:12.396914 10405 leader_election.cc:343] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.394423 10825 raft_consensus.cc:493] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.400247 10825 raft_consensus.cc:3060] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.404366 10632 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:12.405231 10632 ts_tablet_manager.cc:1403] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.008s
I20260709 13:02:12.408700 10259 catalog_manager.cc:5697] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.412053 10634 tablet_bootstrap.cc:492] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.412623 10634 ts_tablet_manager.cc:1403] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.002s
I20260709 13:02:12.411713 10635 ts_tablet_manager.cc:1434] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:02:12.414513 10632 raft_consensus.cc:359] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.416077 10634 raft_consensus.cc:359] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.416962 10634 raft_consensus.cc:385] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.417238 10634 raft_consensus.cc:740] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.404429 10902 raft_consensus.cc:2749] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.415367 10632 raft_consensus.cc:385] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.419116 10632 raft_consensus.cc:740] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.418174 10634 consensus_queue.cc:260] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.420090 10635 tablet_bootstrap.cc:492] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:12.419890 10632 consensus_queue.cc:260] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.422302 10632 ts_tablet_manager.cc:1434] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:12.422859 10634 ts_tablet_manager.cc:1434] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:12.423413 10825 raft_consensus.cc:515] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.423990 10634 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.429005 10825 leader_election.cc:290] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.431221 10633 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:12.432060 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:12.431950 10633 ts_tablet_manager.cc:1403] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.005s
I20260709 13:02:12.432849 10361 raft_consensus.cc:3060] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.436081 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:12.439379 10261 catalog_manager.cc:5697] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.444267 10361 raft_consensus.cc:2468] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:12.440798 10632 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:12.445516 10644 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.446099 10644 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.448887 10644 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:12.450282 10403 leader_election.cc:304] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:12.436231 10633 raft_consensus.cc:359] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.451779 10633 raft_consensus.cc:385] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.452210 10633 raft_consensus.cc:740] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.453853 10632 tablet_bootstrap.cc:654] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.453397 10633 consensus_queue.cc:260] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.453967 10862 raft_consensus.cc:2804] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.454648 10862 raft_consensus.cc:697] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:12.456629 10633 ts_tablet_manager.cc:1434] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:02:12.458088 10633 tablet_bootstrap.cc:492] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:12.457826 10855 consensus_queue.cc:1048] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.464149 10634 tablet_bootstrap.cc:654] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.468866 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:12.469733 10439 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:12.471520 10554 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:12.473918 10891 raft_consensus.cc:2804] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.474403 10891 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.474735 10891 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.474752 10633 tablet_bootstrap.cc:654] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.482184 10634 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.483222 10634 ts_tablet_manager.cc:1403] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.011s
I20260709 13:02:12.456223 10862 consensus_queue.cc:237] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.492566 10634 raft_consensus.cc:359] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:12.493330 10405 leader_election.cc:343] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.493865 10634 raft_consensus.cc:385] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.494505 10634 raft_consensus.cc:740] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.495631 10634 consensus_queue.cc:260] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.499107 10634 ts_tablet_manager.cc:1434] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:02:12.500808 10634 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.500938 10635 tablet_bootstrap.cc:654] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.516587 10846 consensus_queue.cc:1048] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.518603 10634 tablet_bootstrap.cc:654] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.535827 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.542765 10634 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.543655 10634 ts_tablet_manager.cc:1403] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.002s
W20260709 13:02:12.544126 10480 consensus_peers.cc:597] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d -> Peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Couldn't send request to peer 40a50bcbfe194a288c6b3333e6556a88. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.554741 10634 raft_consensus.cc:359] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.555943 10634 raft_consensus.cc:385] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.556245 10634 raft_consensus.cc:740] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.556985 10634 consensus_queue.cc:260] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.567287 10634 ts_tablet_manager.cc:1434] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:02:12.569013 10634 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.592900 10634 tablet_bootstrap.cc:654] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.598625 10835 consensus_queue.cc:1048] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.609759 10644 consensus_queue.cc:1048] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.614535 10634 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.615522 10634 ts_tablet_manager.cc:1403] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.003s
I20260709 13:02:12.627983 10634 raft_consensus.cc:359] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.628858 10634 raft_consensus.cc:385] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.631981 10634 raft_consensus.cc:740] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.634438 10634 consensus_queue.cc:260] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.639629 10634 ts_tablet_manager.cc:1434] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:02:12.641388 10634 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.673498 10835 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.674787 10835 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.679085 10835 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.679839 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.680949 10634 tablet_bootstrap.cc:654] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.682335 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:12.682554 10478 leader_election.cc:343] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:12.685878 10480 leader_election.cc:343] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.687723 10480 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:12.690919 10835 raft_consensus.cc:2749] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.699713 10634 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.700759 10634 ts_tablet_manager.cc:1403] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.000s
I20260709 13:02:12.705888 10634 raft_consensus.cc:359] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.707203 10634 raft_consensus.cc:385] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.718036 10634 raft_consensus.cc:740] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.719345 10634 consensus_queue.cc:260] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:12.722586 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 271870us
I20260709 13:02:12.725801 10634 ts_tablet_manager.cc:1434] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:02:12.727613 10634 tablet_bootstrap.cc:492] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.737175 10640 raft_consensus.cc:493] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.738195 10640 raft_consensus.cc:515] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:12.743903 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade59aed1b7f49f2ae404b4f1f714521" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.744971 10362 raft_consensus.cc:2468] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:12.747192 10478 leader_election.cc:304] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:12.750273 10846 raft_consensus.cc:2804] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.751083 10846 raft_consensus.cc:493] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.751672 10846 raft_consensus.cc:3060] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.753974 10634 tablet_bootstrap.cc:654] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.772918 10634 tablet_bootstrap.cc:492] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:12.773808 10634 ts_tablet_manager.cc:1403] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.006s
I20260709 13:02:12.782157 10440 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.785609 10644 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.786523 10644 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.785131 10634 raft_consensus.cc:359] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.788272 10634 raft_consensus.cc:385] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.788635 10634 raft_consensus.cc:740] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.789279 10644 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:12.789485 10634 consensus_queue.cc:260] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.790868 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:12.794701 10634 ts_tablet_manager.cc:1434] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:02:12.795025 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:12.796425 10634 tablet_bootstrap.cc:492] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:12.796924 10513 raft_consensus.cc:2393] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
W20260709 13:02:12.806150 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 71664.2us
I20260709 13:02:12.815128 10634 tablet_bootstrap.cc:654] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.835047 10640 leader_election.cc:290] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:12.856197 10633 tablet_bootstrap.cc:492] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:12.856949 10633 ts_tablet_manager.cc:1403] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.399s	user 0.080s	sys 0.087s
I20260709 13:02:12.889981 10633 raft_consensus.cc:359] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.891414 10633 raft_consensus.cc:385] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.891875 10633 raft_consensus.cc:740] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.886224 10849 raft_consensus.cc:493] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.892874 10633 consensus_queue.cc:260] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:12.893635 10849 raft_consensus.cc:515] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.896350 10849 leader_election.cc:290] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:12.896555 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade59aed1b7f49f2ae404b4f1f714521" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:12.897456 10633 ts_tablet_manager.cc:1434] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.004s
W20260709 13:02:12.859624 10552 leader_election.cc:343] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.899075 10633 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:12.882956 10554 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
W20260709 13:02:12.906852 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 45768.2us
W20260709 13:02:12.910820 10480 leader_election.cc:343] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.913024 10644 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.913667 10644 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:12.916214 10644 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:12.917713 10644 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.918246 10644 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:12.924539 10644 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:12.922804 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:12.965878 10632 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:12.967103 10632 ts_tablet_manager.cc:1403] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.544s	user 0.129s	sys 0.112s
I20260709 13:02:12.934590 10849 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.973780 10633 tablet_bootstrap.cc:654] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.983506 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4ae9839c944dbaa83cf17b5a5d5170" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:12.997568 10359 raft_consensus.cc:2393] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:12.973192 10891 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.013414 10635 tablet_bootstrap.cc:492] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:13.023058 10635 ts_tablet_manager.cc:1403] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.603s	user 0.025s	sys 0.027s
I20260709 13:02:13.017436 10835 raft_consensus.cc:493] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.021653 10644 raft_consensus.cc:493] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.024072 10644 raft_consensus.cc:515] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:13.013908 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:13.037030 10632 raft_consensus.cc:359] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.047124 10632 raft_consensus.cc:385] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.048259 10632 raft_consensus.cc:740] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.049418 10632 consensus_queue.cc:260] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.061931 10644 leader_election.cc:290] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:13.064375 10632 ts_tablet_manager.cc:1434] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.000s
I20260709 13:02:13.064926 10634 tablet_bootstrap.cc:492] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:13.065505 10634 ts_tablet_manager.cc:1403] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.269s	user 0.032s	sys 0.088s
I20260709 13:02:13.069057 10632 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:13.032130 10835 raft_consensus.cc:515] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.088299 10794 consensus_queue.cc:1048] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.088649 10854 consensus_queue.cc:1048] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.090284 10794 consensus_queue.cc:1048] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.092600 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:13.097982 10891 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:13.108270 10632 tablet_bootstrap.cc:654] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.109308 10633 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:13.109022 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8efb10cd18e427c897514fa94979888" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:13.109987 10633 ts_tablet_manager.cc:1403] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.211s	user 0.033s	sys 0.022s
I20260709 13:02:13.110140 10512 raft_consensus.cc:2468] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:13.111733 10835 leader_election.cc:290] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:13.136870 10633 raft_consensus.cc:359] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:13.137879 10633 raft_consensus.cc:385] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.138203 10633 raft_consensus.cc:740] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.125137 10846 raft_consensus.cc:515] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:13.146059 10846 leader_election.cc:290] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:13.147231 10634 raft_consensus.cc:359] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.148042 10634 raft_consensus.cc:385] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.138938 10633 consensus_queue.cc:260] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:13.148327 10634 raft_consensus.cc:740] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.154330 10633 ts_tablet_manager.cc:1434] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:02:13.155640 10633 tablet_bootstrap.cc:492] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:13.158071 10586 raft_consensus.cc:3060] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.152851 10634 consensus_queue.cc:260] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.152356 10862 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
W20260709 13:02:13.168819 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:13.182561 10635 raft_consensus.cc:359] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.184094 10635 raft_consensus.cc:385] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.184417 10635 raft_consensus.cc:740] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.185057 10635 consensus_queue.cc:260] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.183406 10634 ts_tablet_manager.cc:1434] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.000s
I20260709 13:02:13.186964 10634 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
W20260709 13:02:13.169742 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 82389.7us
W20260709 13:02:13.165961 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 54880.3us
I20260709 13:02:13.196460 10635 ts_tablet_manager.cc:1434] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.000s
I20260709 13:02:13.188156 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:13.198693 10363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:13.188796 10862 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:13.206188 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674a2e3712f54be4898228175becf617" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:13.242476 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade59aed1b7f49f2ae404b4f1f714521" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:13.245982 10849 raft_consensus.cc:2749] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:13.245677 10554 leader_election.cc:343] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.254163 10632 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
W20260709 13:02:13.253134 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 52032us
I20260709 13:02:13.254215 10634 tablet_bootstrap.cc:654] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.255147 10632 ts_tablet_manager.cc:1403] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.187s	user 0.010s	sys 0.032s
I20260709 13:02:13.268350 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade59aed1b7f49f2ae404b4f1f714521" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:13.269196 10360 raft_consensus.cc:3060] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.272883 10862 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:13.275580 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:13.276428 10261 catalog_manager.cc:5697] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } }
W20260709 13:02:13.282029 10480 leader_election.cc:343] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:13.282984 10480 leader_election.cc:343] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.295095 10635 tablet_bootstrap.cc:492] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:13.301578 10633 tablet_bootstrap.cc:654] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:13.254426 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 59072.6us
I20260709 13:02:13.309361 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674a2e3712f54be4898228175becf617" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:13.310205 10586 raft_consensus.cc:2468] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:13.306049 10632 raft_consensus.cc:359] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:13.316403 10632 raft_consensus.cc:385] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.316978 10632 raft_consensus.cc:740] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.318120 10632 consensus_queue.cc:260] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:13.320876 10632 ts_tablet_manager.cc:1434] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.001s
I20260709 13:02:13.322726 10632 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:13.336763 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:13.337970 10439 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.344548 10825 consensus_queue.cc:1048] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.322376 10552 leader_election.cc:304] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:13.358474 10360 raft_consensus.cc:2468] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:13.364454 10587 raft_consensus.cc:3060] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.369660 10930 raft_consensus.cc:2749] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:13.369850 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 62909.2us
W20260709 13:02:13.370911 10552 leader_election.cc:343] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.371457 10552 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:13.372555 10930 raft_consensus.cc:2749] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.373293 10554 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:13.375272 10554 leader_election.cc:304] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:13.378223 10930 raft_consensus.cc:2804] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:13.375988 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8efb10cd18e427c897514fa94979888" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:13.378661 10930 raft_consensus.cc:493] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.379087 10930 raft_consensus.cc:3060] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.379244 10364 raft_consensus.cc:2468] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:13.376255 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:13.376873 10478 leader_election.cc:304] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:13.383003 10362 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.394661 10634 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:13.395354 10634 ts_tablet_manager.cc:1403] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.209s	user 0.017s	sys 0.015s
I20260709 13:02:13.393280 10924 raft_consensus.cc:2804] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:13.414077 10635 tablet_bootstrap.cc:654] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.420362 10862 consensus_queue.cc:1048] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.415982 10924 raft_consensus.cc:697] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:13.423066 10924 consensus_queue.cc:237] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:13.444824 10633 tablet_bootstrap.cc:492] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:13.433075 10849 raft_consensus.cc:493] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.446148 10849 raft_consensus.cc:515] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.445576 10633 ts_tablet_manager.cc:1403] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.290s	user 0.035s	sys 0.029s
I20260709 13:02:13.487233 10439 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:13.492157 10632 tablet_bootstrap.cc:654] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.503225 10846 raft_consensus.cc:493] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.503978 10846 raft_consensus.cc:515] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:13.506469 10846 leader_election.cc:290] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:13.491768 10855 raft_consensus.cc:493] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fde7d06ee724b9bb005a69743b50211)
I20260709 13:02:13.508075 10855 raft_consensus.cc:515] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.509119 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:13.511969 10480 leader_election.cc:343] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.495611 10634 raft_consensus.cc:359] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:13.514108 10634 raft_consensus.cc:385] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.514617 10634 raft_consensus.cc:740] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.516441 10634 consensus_queue.cc:260] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:13.517149 10480 leader_election.cc:304] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:13.520375 10634 ts_tablet_manager.cc:1434] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.001s
I20260709 13:02:13.521924 10930 raft_consensus.cc:515] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:13.527159 10633 raft_consensus.cc:359] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.528811 10633 raft_consensus.cc:385] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.529320 10633 raft_consensus.cc:740] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.529477 10634 tablet_bootstrap.cc:492] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:13.530452 10633 consensus_queue.cc:260] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.525285 10846 raft_consensus.cc:2804] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:13.554078 10554 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:13.555999 10935 consensus_queue.cc:1048] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:02:13.558187 10935 raft_consensus.cc:2804] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:13.558838 10935 raft_consensus.cc:697] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:13.560680 10362 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:13.561702 10901 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.562444 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:13.562749 10901 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.572449 10901 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:13.536191 10846 raft_consensus.cc:493] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.588266 10846 raft_consensus.cc:3060] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.588582 10849 leader_election.cc:290] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:13.595777 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8888b8a7dea849eeb0d1a87c9a347e9c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:13.608390 10633 ts_tablet_manager.cc:1434] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.160s	user 0.021s	sys 0.019s
I20260709 13:02:13.612169 10633 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:13.607029 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:13.626080 10891 raft_consensus.cc:2749] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.626641 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:13.655553 10635 tablet_bootstrap.cc:492] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:13.656631 10635 ts_tablet_manager.cc:1403] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.364s	user 0.027s	sys 0.009s
I20260709 13:02:13.626186 10855 leader_election.cc:290] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:13.628902 10439 raft_consensus.cc:2468] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:13.672740 10632 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:13.673437 10632 ts_tablet_manager.cc:1403] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.352s	user 0.041s	sys 0.019s
I20260709 13:02:13.697837 10635 raft_consensus.cc:359] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.729225 10635 raft_consensus.cc:385] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.729831 10635 raft_consensus.cc:740] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.731763 10635 consensus_queue.cc:260] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.733503 10634 tablet_bootstrap.cc:654] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.744653 10635 ts_tablet_manager.cc:1434] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.088s	user 0.011s	sys 0.000s
I20260709 13:02:13.746503 10635 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
W20260709 13:02:13.661795 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 121420us
W20260709 13:02:13.745317 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 178693us
W20260709 13:02:13.736608 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 44652.6us
I20260709 13:02:13.611613 10935 consensus_queue.cc:237] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.769284 10405 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:13.772195 10632 raft_consensus.cc:359] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.773350 10632 raft_consensus.cc:385] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.776685 10633 tablet_bootstrap.cc:654] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.773710 10632 raft_consensus.cc:740] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.781570 10632 consensus_queue.cc:260] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:13.778079 10554 leader_election.cc:304] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:13.794519 10632 ts_tablet_manager.cc:1434] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.002s
I20260709 13:02:13.804745 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8888b8a7dea849eeb0d1a87c9a347e9c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:13.805835 10514 raft_consensus.cc:2468] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:13.806034 10956 raft_consensus.cc:2804] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:13.806622 10956 raft_consensus.cc:493] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.807024 10956 raft_consensus.cc:3060] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.807361 10953 raft_consensus.cc:493] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.807958 10953 raft_consensus.cc:515] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.810470 10953 leader_election.cc:290] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:13.817203 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:13.820619 10480 leader_election.cc:343] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.794857 10825 raft_consensus.cc:2749] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:13.851244 10632 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:13.853813 10403 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 82449.6us
W20260709 13:02:13.836891 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 67729.2us
I20260709 13:02:13.869468 10634 tablet_bootstrap.cc:492] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:13.873018 10634 ts_tablet_manager.cc:1403] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.346s	user 0.029s	sys 0.012s
I20260709 13:02:13.882552 10930 leader_election.cc:290] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:13.883438 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8efb10cd18e427c897514fa94979888" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:13.884318 10512 raft_consensus.cc:3060] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.887018 10846 raft_consensus.cc:515] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.889290 10825 consensus_queue.cc:1048] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.902206 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:13.905565 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:13.906509 10437 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:13.908032 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674a2e3712f54be4898228175becf617" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:13.908913 10439 raft_consensus.cc:3060] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.889593 10846 leader_election.cc:290] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:13.879488 10478 leader_election.cc:343] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.935871 10956 raft_consensus.cc:515] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:13.956141 10635 tablet_bootstrap.cc:654] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.952270 10478 leader_election.cc:304] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:13.968040 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8efb10cd18e427c897514fa94979888" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:13.969122 10362 raft_consensus.cc:3060] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:13.969225 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 90993.2us
I20260709 13:02:13.973142 10846 raft_consensus.cc:2749] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.935284 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9860e256ccdf41ad8f40aee782e8dac8" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:13.990329 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674a2e3712f54be4898228175becf617" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:13.990754 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:13.991209 10588 raft_consensus.cc:3060] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.990578 10330 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:14.003278 10934 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.004033 10934 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:14.005115 10970 raft_consensus.cc:2804] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:14.005646 10970 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.006006 10970 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.006847 10934 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:13.988430 10261 catalog_manager.cc:5697] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.999135 10956 leader_election.cc:290] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:14.020871 10480 leader_election.cc:304] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:14.023485 10846 raft_consensus.cc:2749] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:14.025121 10480 leader_election.cc:343] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.025875 10480 leader_election.cc:304] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:14.035894 10954 raft_consensus.cc:2749] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.039007 10439 raft_consensus.cc:2468] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:14.041141 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:14.048260 10433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8888b8a7dea849eeb0d1a87c9a347e9c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:14.049124 10433 raft_consensus.cc:3060] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.065263 10512 raft_consensus.cc:2468] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
W20260709 13:02:14.067103 10552 leader_election.cc:343] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.069768 10588 raft_consensus.cc:2468] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:14.073359 10634 raft_consensus.cc:359] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.074394 10633 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:14.084182 10634 raft_consensus.cc:385] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.084477 10633 ts_tablet_manager.cc:1403] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.473s	user 0.019s	sys 0.029s
I20260709 13:02:14.084578 10634 raft_consensus.cc:740] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.085629 10634 consensus_queue.cc:260] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.075794 10635 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:14.086547 10362 raft_consensus.cc:2468] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:14.091323 10924 consensus_queue.cc:1048] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.063345 10632 tablet_bootstrap.cc:654] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.093995 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:14.094820 10510 raft_consensus.cc:2468] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:14.096985 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8888b8a7dea849eeb0d1a87c9a347e9c" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:14.097833 10512 raft_consensus.cc:3060] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.099407 10433 raft_consensus.cc:2468] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:14.102691 10552 leader_election.cc:304] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:14.103814 10934 raft_consensus.cc:2804] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.104405 10934 raft_consensus.cc:697] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:14.105391 10934 consensus_queue.cc:237] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:14.107759 10940 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.108665 10940 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.113801 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:14.114675 10588 raft_consensus.cc:2468] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:14.088656 10634 ts_tablet_manager.cc:1434] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.215s	user 0.007s	sys 0.001s
W20260709 13:02:14.119953 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 88943.5us
I20260709 13:02:14.121944 10634 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:14.089205 10635 ts_tablet_manager.cc:1403] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.343s	user 0.022s	sys 0.004s
I20260709 13:02:14.130720 10940 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:14.087980 10633 raft_consensus.cc:359] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:14.134840 10633 raft_consensus.cc:385] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.135305 10633 raft_consensus.cc:740] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.082629 10970 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.136529 10330 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:14.148756 10633 consensus_queue.cc:260] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:14.160310 10940 raft_consensus.cc:2804] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.161177 10940 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.161696 10940 raft_consensus.cc:3060] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.162089 10433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:14.162706 10635 raft_consensus.cc:359] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:14.163514 10635 raft_consensus.cc:385] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.163848 10635 raft_consensus.cc:740] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
W20260709 13:02:14.164165 10330 leader_election.cc:343] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.164741 10635 consensus_queue.cc:260] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:14.146968 10554 leader_election.cc:304] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:14.176502 10635 ts_tablet_manager.cc:1434] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 13:02:14.177619 10635 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:14.184639 10794 raft_consensus.cc:2804] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.185722 10794 raft_consensus.cc:697] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:14.189218 10554 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:14.194407 10953 raft_consensus.cc:493] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.198720 10953 raft_consensus.cc:515] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:14.201345 10953 leader_election.cc:290] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:14.203979 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:14.206573 10478 leader_election.cc:343] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.192274 10480 leader_election.cc:304] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:14.212395 10953 raft_consensus.cc:2804] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.187254 10794 consensus_queue.cc:237] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.215943 10972 raft_consensus.cc:2804] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.225307 10972 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.226120 10972 raft_consensus.cc:3060] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.220496 10953 raft_consensus.cc:697] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:14.237437 10953 consensus_queue.cc:237] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.241297 10433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:14.252516 10633 ts_tablet_manager.cc:1434] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.168s	user 0.010s	sys 0.000s
I20260709 13:02:14.254140 10633 tablet_bootstrap.cc:492] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:14.255815 10512 raft_consensus.cc:2468] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:14.259600 10634 tablet_bootstrap.cc:654] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.229595 10940 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.264078 10940 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:14.264365 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:14.265125 10588 raft_consensus.cc:3060] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.265627 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:14.267300 10970 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:14.269548 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:14.270470 10434 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.272825 10632 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:14.273486 10632 ts_tablet_manager.cc:1403] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.422s	user 0.010s	sys 0.011s
I20260709 13:02:14.292256 10634 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:14.293254 10634 ts_tablet_manager.cc:1403] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.007s
I20260709 13:02:14.273615 10433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:14.298810 10439 raft_consensus.cc:3060] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.300026 10634 raft_consensus.cc:359] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:14.301360 10634 raft_consensus.cc:385] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.301697 10634 raft_consensus.cc:740] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
W20260709 13:02:14.302776 10330 leader_election.cc:343] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.303220 10634 consensus_queue.cc:260] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:14.284173 10480 leader_election.cc:343] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.307847 10480 leader_election.cc:304] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:14.310511 10259 catalog_manager.cc:5697] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.313676 10634 ts_tablet_manager.cc:1434] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:02:14.312448 10924 raft_consensus.cc:2749] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.325736 10634 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:14.337610 10588 raft_consensus.cc:2468] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:14.339869 10330 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:14.342885 10632 raft_consensus.cc:359] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.344532 10632 raft_consensus.cc:385] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.345026 10632 raft_consensus.cc:740] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.342671 10735 raft_consensus.cc:2804] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.348569 10735 raft_consensus.cc:697] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:14.349614 10735 consensus_queue.cc:237] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.352622 10632 consensus_queue.cc:260] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.362874 10633 tablet_bootstrap.cc:654] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:14.363178 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:14.367331 10632 ts_tablet_manager.cc:1434] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.002s
I20260709 13:02:14.369695 10632 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:14.378508 10935 raft_consensus.cc:493] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.379325 10935 raft_consensus.cc:515] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.380111 10364 raft_consensus.cc:1240] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Rejecting Update request from peer 40a50bcbfe194a288c6b3333e6556a88 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:14.388906 10635 tablet_bootstrap.cc:654] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.395181 10960 consensus_queue.cc:1059] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:14.398357 10960 raft_consensus.cc:3055] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.398823 10960 raft_consensus.cc:740] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:14.404194 10260 catalog_manager.cc:5697] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.399820 10960 consensus_queue.cc:260] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.429597 10935 leader_election.cc:290] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:14.430904 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:14.434092 10960 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:14.435959 10554 leader_election.cc:343] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.442938 10434 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:14.444409 10436 raft_consensus.cc:1240] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Rejecting Update request from peer 40a50bcbfe194a288c6b3333e6556a88 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:14.447499 10330 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:14.447878 10825 raft_consensus.cc:493] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.448765 10825 raft_consensus.cc:515] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:14.449628 10940 raft_consensus.cc:2804] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.450466 10940 raft_consensus.cc:697] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:14.452428 10825 leader_election.cc:290] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:14.452132 10940 consensus_queue.cc:237] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.460852 10640 consensus_queue.cc:1048] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.465612 10262 catalog_manager.cc:5697] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.482365 10262 catalog_manager.cc:5697] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.489315 10364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade59aed1b7f49f2ae404b4f1f714521" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:14.492849 10983 log.cc:927] Time spent T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:02:14.493257 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:14.496676 10972 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:14.516160 10554 leader_election.cc:343] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.516911 10554 leader_election.cc:304] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:14.526541 10632 tablet_bootstrap.cc:654] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.529176 10634 tablet_bootstrap.cc:654] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.531847 10935 raft_consensus.cc:2749] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.537438 10735 raft_consensus.cc:493] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.543952 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade59aed1b7f49f2ae404b4f1f714521" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:14.546641 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:14.549369 10508 raft_consensus.cc:3060] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.543138 10735 raft_consensus.cc:515] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:14.566911 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:14.568840 10405 leader_election.cc:304] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
W20260709 13:02:14.571717 10330 leader_election.cc:343] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.573556 10259 catalog_manager.cc:5697] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.583003 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:14.586485 10330 leader_election.cc:343] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.595597 10330 leader_election.cc:304] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:14.568964 10508 raft_consensus.cc:2468] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:14.606246 10940 raft_consensus.cc:2749] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.591732 10735 leader_election.cc:290] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:14.615301 10972 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:14.694350 10633 tablet_bootstrap.cc:492] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:14.695290 10633 ts_tablet_manager.cc:1403] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.442s	user 0.046s	sys 0.064s
I20260709 13:02:14.725747 10633 raft_consensus.cc:359] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.727283 10633 raft_consensus.cc:385] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.727859 10633 raft_consensus.cc:740] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.730017 10633 consensus_queue.cc:260] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.745007 10632 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:14.746023 10632 ts_tablet_manager.cc:1403] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.377s	user 0.020s	sys 0.023s
I20260709 13:02:14.747947 10935 raft_consensus.cc:493] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.763505 10935 raft_consensus.cc:515] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:14.766048 10990 log.cc:927] Time spent T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:14.779186 10632 raft_consensus.cc:359] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:14.780068 10632 raft_consensus.cc:385] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.780419 10632 raft_consensus.cc:740] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.781047 10632 consensus_queue.cc:260] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:14.883993 10862 raft_consensus.cc:2749] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:14.861939 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:14.903872 10554 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:14.906744 10972 consensus_queue.cc:1048] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:14.920707 10953 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.922147 10953 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:14.925241 10633 ts_tablet_manager.cc:1434] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.229s	user 0.013s	sys 0.024s
I20260709 13:02:14.938370 10953 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:14.942224 10633 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:14.959889 10935 leader_election.cc:290] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:14.961886 10956 raft_consensus.cc:2804] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.962757 10956 raft_consensus.cc:697] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:14.962966 10633 tablet_bootstrap.cc:654] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.965724 10956 consensus_queue.cc:237] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:14.978133 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:14.979682 10934 consensus_queue.cc:1048] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.985591 10635 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:14.987604 10635 ts_tablet_manager.cc:1403] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.810s	user 0.093s	sys 0.091s
I20260709 13:02:15.000468 10632 ts_tablet_manager.cc:1434] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.254s	user 0.010s	sys 0.000s
I20260709 13:02:15.002188 10634 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:15.020268 10634 ts_tablet_manager.cc:1403] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.695s	user 0.046s	sys 0.046s
I20260709 13:02:15.026193 10439 raft_consensus.cc:1275] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:15.029301 10940 consensus_queue.cc:1048] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.049813 10940 consensus_queue.cc:1048] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.094329 10634 raft_consensus.cc:359] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.095569 10634 raft_consensus.cc:385] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.096378 10634 raft_consensus.cc:740] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.097519 10632 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:15.098004 10634 consensus_queue.cc:260] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.101925 10635 raft_consensus.cc:359] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.103511 10635 raft_consensus.cc:385] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:15.098062 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 80922.3us
I20260709 13:02:15.108420 10634 ts_tablet_manager.cc:1434] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.004s
I20260709 13:02:15.116006 10635 raft_consensus.cc:740] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
W20260709 13:02:15.070801 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 96583.7us
I20260709 13:02:15.129609 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:15.120362 10735 raft_consensus.cc:493] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.130862 10735 raft_consensus.cc:515] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.134752 10586 raft_consensus.cc:1275] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:02:15.135462 10586 pending_rounds.cc:85] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: Aborting all ops after (but not including) 0
I20260709 13:02:15.136024 10586 pending_rounds.cc:107] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:15.136572 10586 raft_consensus.cc:2889] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.137143 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:15.140285 10735 leader_election.cc:290] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:15.143909 10633 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
W20260709 13:02:15.135385 10330 consensus_peers.cc:597] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:15.154322 10633 ts_tablet_manager.cc:1403] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.216s	user 0.030s	sys 0.020s
I20260709 13:02:15.147823 10635 consensus_queue.cc:260] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.120500 10634 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:15.124277 10260 catalog_manager.cc:5697] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.175565 10935 consensus_queue.cc:1048] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.175638 10998 consensus_queue.cc:1048] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:02:15.179150 10552 leader_election.cc:343] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:15.183391 10552 leader_election.cc:343] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.183677 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:15.185380 10554 leader_election.cc:343] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.185978 10554 leader_election.cc:304] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:15.206856 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:15.218078 10480 leader_election.cc:343] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.210857 10940 consensus_queue.cc:1048] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:15.229305 10998 raft_consensus.cc:2749] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:15.230408 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 47350.5us
I20260709 13:02:15.254637 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:15.263780 10632 tablet_bootstrap.cc:654] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:15.270005 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 70863us
W20260709 13:02:15.285765 10330 leader_election.cc:343] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.283034 10633 raft_consensus.cc:359] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.286695 10996 consensus_queue.cc:1048] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:02:15.290692 10330 leader_election.cc:343] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:15.291177 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 63841.9us
I20260709 13:02:15.291445 10330 leader_election.cc:304] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:15.292536 10735 raft_consensus.cc:2749] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.288993 10633 raft_consensus.cc:385] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.296934 10633 raft_consensus.cc:740] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
W20260709 13:02:15.306444 10480 leader_election.cc:343] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.310679 10967 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.311508 10967 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.316624 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:15.331605 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:15.333107 10635 ts_tablet_manager.cc:1434] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.345s	user 0.007s	sys 0.007s
I20260709 13:02:15.320755 10480 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:15.342064 10967 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:15.343240 10996 raft_consensus.cc:2749] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.347249 10403 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:15.347218 10996 consensus_queue.cc:1048] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.352305 10862 raft_consensus.cc:2749] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.366483 10635 tablet_bootstrap.cc:492] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:15.365878 10633 consensus_queue.cc:260] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.407902 10632 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:15.409770 10632 ts_tablet_manager.cc:1403] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.313s	user 0.033s	sys 0.051s
I20260709 13:02:15.469105 10633 ts_tablet_manager.cc:1434] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.314s	user 0.011s	sys 0.003s
I20260709 13:02:15.470835 10633 tablet_bootstrap.cc:492] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:15.510403 10635 tablet_bootstrap.cc:654] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.523422 10972 raft_consensus.cc:493] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.524233 10972 raft_consensus.cc:515] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:15.542760 10552 consensus_peers.cc:597] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:15.505026 10632 raft_consensus.cc:359] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:15.544014 10632 raft_consensus.cc:385] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.544364 10632 raft_consensus.cc:740] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
W20260709 13:02:15.550052 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 147868us
I20260709 13:02:15.572170 10972 leader_election.cc:290] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:15.579005 10634 tablet_bootstrap.cc:654] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.579787 10632 consensus_queue.cc:260] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:15.583267 10632 ts_tablet_manager.cc:1434] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.171s	user 0.009s	sys 0.001s
I20260709 13:02:15.589890 10632 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:15.595995 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 129165us
I20260709 13:02:15.654990 10633 tablet_bootstrap.cc:654] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.637450 10358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:15.669763 10358 raft_consensus.cc:2468] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:15.669746 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:15.674194 10632 tablet_bootstrap.cc:654] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.683175 10552 leader_election.cc:304] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:15.694520 10959 consensus_queue.cc:1048] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.699841 11019 raft_consensus.cc:2804] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.700588 11019 raft_consensus.cc:493] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.700996 11019 raft_consensus.cc:3060] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.704965 10439 raft_consensus.cc:3060] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:15.706061 10554 leader_election.cc:343] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.724375 11015 raft_consensus.cc:493] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.725113 11015 raft_consensus.cc:515] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:15.728188 10632 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:15.729089 10632 ts_tablet_manager.cc:1403] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.140s	user 0.007s	sys 0.010s
I20260709 13:02:15.729424 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:15.731307 11015 leader_election.cc:290] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:15.733476 10478 leader_election.cc:343] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.734189 10635 tablet_bootstrap.cc:492] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:15.735059 10635 ts_tablet_manager.cc:1403] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.400s	user 0.019s	sys 0.011s
I20260709 13:02:15.740090 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:15.743469 10480 leader_election.cc:343] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.744460 10480 leader_election.cc:304] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:15.745702 10640 raft_consensus.cc:2749] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.750310 10640 raft_consensus.cc:493] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.750974 10640 raft_consensus.cc:515] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:15.753654 10640 leader_election.cc:290] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:15.753957 11019 raft_consensus.cc:515] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.755342 10634 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:15.755990 10634 ts_tablet_manager.cc:1403] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.636s	user 0.017s	sys 0.008s
I20260709 13:02:15.757718 10635 raft_consensus.cc:359] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:15.758664 10635 raft_consensus.cc:385] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.758975 10635 raft_consensus.cc:740] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.754864 10632 raft_consensus.cc:359] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.762588 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:15.763430 10359 raft_consensus.cc:3060] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.760862 10632 raft_consensus.cc:385] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.768535 10632 raft_consensus.cc:740] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.768769 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:15.769387 10632 consensus_queue.cc:260] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.760058 10635 consensus_queue.cc:260] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:15.774863 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:15.775774 11019 leader_election.cc:290] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:15.779338 10480 leader_election.cc:343] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.782972 10634 raft_consensus.cc:359] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.784292 10634 raft_consensus.cc:385] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.785035 10634 raft_consensus.cc:740] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.788730 10634 consensus_queue.cc:260] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:15.789428 10480 leader_election.cc:343] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.790036 10480 leader_election.cc:304] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:15.790268 10846 raft_consensus.cc:493] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.791064 10846 raft_consensus.cc:515] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.791780 10996 raft_consensus.cc:2749] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.793596 11019 raft_consensus.cc:493] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.794283 11019 raft_consensus.cc:515] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.795178 10846 leader_election.cc:290] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:15.795477 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:15.797364 10478 leader_election.cc:343] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.797900 11019 leader_election.cc:290] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:15.800206 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:15.801676 10359 raft_consensus.cc:2468] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
W20260709 13:02:15.801880 10552 leader_election.cc:343] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.803604 10552 leader_election.cc:304] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:15.804625 11019 raft_consensus.cc:2804] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.806255 10939 raft_consensus.cc:493] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.806888 10939 raft_consensus.cc:515] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:15.809518 10261 catalog_manager.cc:5697] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.812319 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:15.812669 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:15.813436 10586 raft_consensus.cc:2468] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
W20260709 13:02:15.814424 10405 leader_election.cc:343] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.815265 10405 leader_election.cc:304] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:15.813110 10632 ts_tablet_manager.cc:1434] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.003s
I20260709 13:02:15.821657 10632 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:15.823046 11006 raft_consensus.cc:2804] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.805404 11019 raft_consensus.cc:697] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:15.823875 11006 raft_consensus.cc:493] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.829231 11006 raft_consensus.cc:3060] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.809665 10939 leader_election.cc:290] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:15.840416 10735 raft_consensus.cc:493] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.841064 10735 raft_consensus.cc:515] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:15.841979 11019 consensus_queue.cc:237] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:15.844725 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:15.833722 10634 ts_tablet_manager.cc:1434] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:02:15.839169 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:15.846483 10330 leader_election.cc:343] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.834357 10635 ts_tablet_manager.cc:1434] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.099s	user 0.011s	sys 0.002s
I20260709 13:02:15.852888 10635 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:15.856242 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:15.858507 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:15.863104 10585 raft_consensus.cc:2468] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:15.873446 10634 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:15.883118 10735 leader_election.cc:290] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:15.885598 11006 raft_consensus.cc:515] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:15.856405 10554 leader_election.cc:343] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.896524 10480 leader_election.cc:304] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:15.898368 11015 raft_consensus.cc:2804] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.898883 11015 raft_consensus.cc:493] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.900239 10735 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.900982 10735 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:15.912596 10635 tablet_bootstrap.cc:654] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.899288 11015 raft_consensus.cc:3060] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.947875 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:15.952339 10330 leader_election.cc:343] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.952955 10633 tablet_bootstrap.cc:492] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:15.953877 10633 ts_tablet_manager.cc:1403] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.483s	user 0.041s	sys 0.058s
I20260709 13:02:15.955806 11006 leader_election.cc:290] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:15.952922 10330 leader_election.cc:304] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:15.958343 11008 raft_consensus.cc:2749] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.958153 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:15.959614 10585 raft_consensus.cc:3060] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.965167 10632 tablet_bootstrap.cc:654] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.971015 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
W20260709 13:02:15.972077 10554 leader_election.cc:343] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.983457 10735 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:15.988391 10633 raft_consensus.cc:359] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:15.985927 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:15.989346 10633 raft_consensus.cc:385] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.989727 10633 raft_consensus.cc:740] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.990302 10634 tablet_bootstrap.cc:654] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.991961 10554 leader_election.cc:304] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:15.994165 10794 raft_consensus.cc:2749] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.997591 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:15.998549 10405 leader_election.cc:343] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.999573 10330 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:16.002243 10633 consensus_queue.cc:260] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.006668 10735 raft_consensus.cc:2749] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.045081 10632 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:16.045754 10632 ts_tablet_manager.cc:1403] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.005s
I20260709 13:02:16.048880 10633 ts_tablet_manager.cc:1434] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.000s
I20260709 13:02:16.059974 10632 raft_consensus.cc:359] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.061573 10632 raft_consensus.cc:385] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.062048 10632 raft_consensus.cc:740] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.068085 11015 raft_consensus.cc:515] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.074985 10585 raft_consensus.cc:2468] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:16.078851 10635 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:16.087060 10635 ts_tablet_manager.cc:1403] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.234s	user 0.014s	sys 0.007s
I20260709 13:02:16.088173 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
W20260709 13:02:16.090660 10478 leader_election.cc:343] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.090467 10635 raft_consensus.cc:359] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.091428 10635 raft_consensus.cc:385] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.091799 10635 raft_consensus.cc:740] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.092511 10359 raft_consensus.cc:3060] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.092960 10635 consensus_queue.cc:260] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.063647 10632 consensus_queue.cc:260] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.098935 10405 leader_election.cc:304] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:16.100060 10939 raft_consensus.cc:2804] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:16.100932 10939 raft_consensus.cc:697] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:16.102375 10939 consensus_queue.cc:237] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.118364 10633 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:16.086086 11015 leader_election.cc:290] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:16.132992 10635 ts_tablet_manager.cc:1434] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:02:16.096510 10260 catalog_manager.cc:5697] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:16.148694 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 111332us
I20260709 13:02:16.151821 10632 ts_tablet_manager.cc:1434] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.106s	user 0.014s	sys 0.008s
I20260709 13:02:16.152933 10735 raft_consensus.cc:493] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.153381 10632 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:16.153537 10735 raft_consensus.cc:515] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.154341 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:16.155076 10588 raft_consensus.cc:3060] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.173035 10735 leader_election.cc:290] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:16.178726 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:16.180092 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:16.181105 10635 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:16.180030 10634 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:16.181948 10634 ts_tablet_manager.cc:1403] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.309s	user 0.021s	sys 0.004s
I20260709 13:02:16.185503 10634 raft_consensus.cc:359] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.186360 10634 raft_consensus.cc:385] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.186697 10634 raft_consensus.cc:740] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
W20260709 13:02:16.187762 10330 leader_election.cc:343] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:16.189168 10330 leader_election.cc:343] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.190110 10330 leader_election.cc:304] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:16.191944 10735 raft_consensus.cc:2749] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.201205 10635 tablet_bootstrap.cc:654] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.212486 11038 raft_consensus.cc:493] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.226590 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:16.225756 11038 raft_consensus.cc:515] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.230399 10632 tablet_bootstrap.cc:654] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.238806 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:16.239331 10934 consensus_queue.cc:1048] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:16.241218 10478 leader_election.cc:343] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.244089 10633 tablet_bootstrap.cc:654] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.245093 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:16.244273 11038 leader_election.cc:290] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:16.247565 10480 leader_election.cc:343] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.248113 10480 leader_election.cc:304] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:16.249186 11038 raft_consensus.cc:2749] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.253501 10634 consensus_queue.cc:260] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.258905 10634 ts_tablet_manager.cc:1434] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.001s
I20260709 13:02:16.261808 11038 raft_consensus.cc:493] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.262662 11038 raft_consensus.cc:515] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.268302 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:16.273264 10260 catalog_manager.cc:5697] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.275238 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb87559b16a496fba5bb8b6fb3248a5" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:16.277830 10585 raft_consensus.cc:2393] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:16.284658 10480 leader_election.cc:304] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:16.286439 11015 raft_consensus.cc:3060] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.267297 11038 leader_election.cc:290] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:16.324638 10554 consensus_peers.cc:597] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.328516 10634 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:16.346094 11015 raft_consensus.cc:2749] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.359484 10634 tablet_bootstrap.cc:654] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.367660 10633 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:16.368693 10633 ts_tablet_manager.cc:1403] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.311s	user 0.008s	sys 0.011s
I20260709 13:02:16.395253 10588 raft_consensus.cc:2468] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:16.398984 10632 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:16.400207 10632 ts_tablet_manager.cc:1403] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.247s	user 0.052s	sys 0.051s
I20260709 13:02:16.414882 10635 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:16.415711 10635 ts_tablet_manager.cc:1403] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.241s	user 0.016s	sys 0.001s
I20260709 13:02:16.416627 10480 leader_election.cc:304] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:16.419339 11015 raft_consensus.cc:2804] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:16.420015 11015 raft_consensus.cc:697] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:16.421037 11015 consensus_queue.cc:237] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.424736 10633 raft_consensus.cc:359] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.425710 10633 raft_consensus.cc:385] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.447377 10854 raft_consensus.cc:493] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.448252 10854 raft_consensus.cc:515] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.451622 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:16.452210 10854 leader_election.cc:290] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
W20260709 13:02:16.453428 10403 leader_election.cc:343] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.454136 10633 raft_consensus.cc:740] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.455379 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:16.455271 10633 consensus_queue.cc:260] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.456203 10514 raft_consensus.cc:2468] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:16.457255 10633 ts_tablet_manager.cc:1434] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.002s
I20260709 13:02:16.459875 10633 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:16.459185 10634 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:16.461225 10634 ts_tablet_manager.cc:1403] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.012s
I20260709 13:02:16.458925 10405 leader_election.cc:304] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:16.462728 10854 raft_consensus.cc:2804] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:16.463204 10854 raft_consensus.cc:493] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.463653 10854 raft_consensus.cc:3060] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.465283 10635 raft_consensus.cc:359] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.465059 10634 raft_consensus.cc:359] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.470732 10635 raft_consensus.cc:385] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.477334 10635 raft_consensus.cc:740] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.476822 10634 raft_consensus.cc:385] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.486052 10633 tablet_bootstrap.cc:654] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.490447 10634 raft_consensus.cc:740] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.491382 10634 consensus_queue.cc:260] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.486334 10854 raft_consensus.cc:515] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.494189 10634 ts_tablet_manager.cc:1434] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:02:16.494901 10635 consensus_queue.cc:260] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.495860 10854 leader_election.cc:290] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:16.497217 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:16.497910 10635 ts_tablet_manager.cc:1434] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:02:16.489038 10632 raft_consensus.cc:359] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.498872 10632 raft_consensus.cc:385] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:16.499219 10403 leader_election.cc:343] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.500131 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:16.500923 10514 raft_consensus.cc:3060] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.506474 10634 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:16.516423 10634 tablet_bootstrap.cc:654] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.498410 10261 catalog_manager.cc:5697] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.499279 10632 raft_consensus.cc:740] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.521760 10632 consensus_queue.cc:260] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.525245 10632 ts_tablet_manager.cc:1434] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.001s
I20260709 13:02:16.526813 10632 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:16.530201 10635 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:16.532179 11019 raft_consensus.cc:493] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.532902 11019 raft_consensus.cc:515] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.542603 11019 leader_election.cc:290] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:16.544446 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:16.546087 10554 leader_election.cc:343] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.551290 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:16.552254 10362 raft_consensus.cc:2468] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:16.555128 10552 leader_election.cc:304] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:16.557076 10934 raft_consensus.cc:2804] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:16.557564 10934 raft_consensus.cc:493] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.557911 10934 raft_consensus.cc:3060] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.564560 10514 raft_consensus.cc:2468] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:16.565992 10405 leader_election.cc:304] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:16.567514 10939 raft_consensus.cc:2804] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:16.568231 10939 raft_consensus.cc:697] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:16.569242 10939 consensus_queue.cc:237] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.573315 10635 tablet_bootstrap.cc:654] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.577044 10934 raft_consensus.cc:515] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.580533 10633 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:16.581128 10633 ts_tablet_manager.cc:1403] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.025s
I20260709 13:02:16.581094 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:16.582176 10362 raft_consensus.cc:3060] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.579830 10632 tablet_bootstrap.cc:654] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.592095 10633 raft_consensus.cc:359] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.595180 10633 raft_consensus.cc:385] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.595686 10633 raft_consensus.cc:740] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.597072 10633 consensus_queue.cc:260] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.603363 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:16.606106 10554 leader_election.cc:343] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.607070 10633 ts_tablet_manager.cc:1434] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:02:16.608561 10633 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:16.609642 10260 catalog_manager.cc:5697] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.611109 10934 leader_election.cc:290] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:16.615108 10634 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:16.615823 10634 ts_tablet_manager.cc:1403] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.110s	user 0.022s	sys 0.016s
I20260709 13:02:16.616051 10633 tablet_bootstrap.cc:654] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.619261 10634 raft_consensus.cc:359] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.620225 10634 raft_consensus.cc:385] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.620530 10634 raft_consensus.cc:740] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.621583 10634 consensus_queue.cc:260] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.622633 11015 raft_consensus.cc:493] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.623368 11015 raft_consensus.cc:515] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.626902 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:16.628525 10480 leader_election.cc:343] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.630156 11015 leader_election.cc:290] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:16.659677 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:16.661808 10634 ts_tablet_manager.cc:1434] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:02:16.660662 10359 raft_consensus.cc:2468] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:16.665313 10478 leader_election.cc:304] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:16.666260 11015 raft_consensus.cc:2804] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:16.666736 11015 raft_consensus.cc:493] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.667104 11015 raft_consensus.cc:3060] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.671267 10362 raft_consensus.cc:2468] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:16.673105 10552 leader_election.cc:304] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:16.675242 11019 raft_consensus.cc:2804] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:16.676476 11019 raft_consensus.cc:697] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:16.677435 11019 consensus_queue.cc:237] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.690447 10634 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:16.694787 10633 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:16.695604 10633 ts_tablet_manager.cc:1403] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.087s	user 0.033s	sys 0.029s
I20260709 13:02:16.699213 10633 raft_consensus.cc:359] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.700122 10633 raft_consensus.cc:385] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.695604 10635 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:16.701563 10635 ts_tablet_manager.cc:1403] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.172s	user 0.021s	sys 0.002s
I20260709 13:02:16.700531 10633 raft_consensus.cc:740] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.703274 10633 consensus_queue.cc:260] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.704196 10854 consensus_queue.cc:1048] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.713150 10633 ts_tablet_manager.cc:1434] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:02:16.714715 10633 tablet_bootstrap.cc:492] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:16.716333 11015 raft_consensus.cc:515] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.717190 10854 consensus_queue.cc:1048] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:16.724251 10633 tablet_bootstrap.cc:654] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.728229 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
W20260709 13:02:16.734968 10480 leader_election.cc:343] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.732728 10635 raft_consensus.cc:359] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.738270 10635 raft_consensus.cc:385] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.738651 10635 raft_consensus.cc:740] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.739176 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:16.740018 10362 raft_consensus.cc:3060] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.739629 10635 consensus_queue.cc:260] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:16.742201 10635 ts_tablet_manager.cc:1434] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:02:16.745940 11015 leader_election.cc:290] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:16.743386 10635 tablet_bootstrap.cc:492] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:16.759405 10634 tablet_bootstrap.cc:654] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:16.761560 10632 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:16.767581 10632 ts_tablet_manager.cc:1403] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.010s
I20260709 13:02:16.775864 11008 raft_consensus.cc:493] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.777464 11008 raft_consensus.cc:515] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.789294 11008 leader_election.cc:290] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:16.778730 10362 raft_consensus.cc:2468] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:16.744520 10261 catalog_manager.cc:5697] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.797459 10478 leader_election.cc:304] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:16.799042 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:16.802695 11038 raft_consensus.cc:2804] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:16.803409 11038 raft_consensus.cc:697] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:16.804822 11038 consensus_queue.cc:237] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.807232 10635 tablet_bootstrap.cc:654] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:16.810005 10330 leader_election.cc:343] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.818660 10939 raft_consensus.cc:493] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.819665 10939 raft_consensus.cc:515] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.833345 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:16.842703 10633 tablet_bootstrap.cc:492] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:16.843479 10633 ts_tablet_manager.cc:1403] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.014s
I20260709 13:02:16.843266 10632 raft_consensus.cc:359] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.843839 10939 leader_election.cc:290] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:16.844179 10632 raft_consensus.cc:385] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.844497 10632 raft_consensus.cc:740] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.853420 10632 consensus_queue.cc:260] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.866632 10633 raft_consensus.cc:359] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.867584 10633 raft_consensus.cc:385] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.868036 10633 raft_consensus.cc:740] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.869783 10633 consensus_queue.cc:260] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:16.845960 10403 leader_election.cc:343] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.861071 10846 raft_consensus.cc:493] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.862435 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:16.889866 10633 ts_tablet_manager.cc:1434] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.003s
I20260709 13:02:16.893760 10632 ts_tablet_manager.cc:1434] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.126s	user 0.011s	sys 0.000s
I20260709 13:02:16.876151 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:16.894958 10510 raft_consensus.cc:2468] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:16.898614 10585 raft_consensus.cc:2468] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:16.906677 10635 tablet_bootstrap.cc:492] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:16.907410 10635 ts_tablet_manager.cc:1403] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.164s	user 0.018s	sys 0.031s
I20260709 13:02:16.891752 10846 raft_consensus.cc:515] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:16.910136 10846 leader_election.cc:290] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:16.911744 10330 leader_election.cc:304] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:16.898548 11015 consensus_queue.cc:1048] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:02:16.914965 11008 raft_consensus.cc:2804] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:16.915441 11008 raft_consensus.cc:493] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.915836 11008 raft_consensus.cc:3060] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.920236 10640 raft_consensus.cc:493] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.920949 10640 raft_consensus.cc:515] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.921852 10632 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:16.910307 10403 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 75360.7us
I20260709 13:02:16.923646 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:16.925510 10480 leader_election.cc:343] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:16.910748 10635 raft_consensus.cc:359] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.927940 10635 raft_consensus.cc:385] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.928406 10635 raft_consensus.cc:740] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.930626 10635 consensus_queue.cc:260] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.931878 10634 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:16.932569 10634 ts_tablet_manager.cc:1403] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.247s	user 0.034s	sys 0.016s
I20260709 13:02:16.932734 10640 leader_election.cc:290] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:16.935840 10405 leader_election.cc:304] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:16.936985 11062 raft_consensus.cc:2804] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:16.937460 11062 raft_consensus.cc:493] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.937800 11062 raft_consensus.cc:3060] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.938154 10634 raft_consensus.cc:359] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:16.939025 10634 raft_consensus.cc:385] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:16.939324 10634 raft_consensus.cc:740] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:16.963827 10635 ts_tablet_manager.cc:1434] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
W20260709 13:02:16.974443 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 46102us
I20260709 13:02:16.952250 10939 raft_consensus.cc:493] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.979993 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:16.977758 10846 raft_consensus.cc:493] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.984251 10939 raft_consensus.cc:515] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:16.979082 11019 raft_consensus.cc:493] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.996870 10478 consensus_peers.cc:597] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:17.004029 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 101246us
I20260709 13:02:17.002228 10439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:16.996335 10846 raft_consensus.cc:515] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.015741 10633 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:17.003527 10635 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
W20260709 13:02:17.017346 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 75543us
W20260709 13:02:16.993482 10480 leader_election.cc:343] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:17.020203 10480 leader_election.cc:343] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.020849 10480 leader_election.cc:304] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:17.021961 10640 raft_consensus.cc:2749] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.029981 10934 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.026821 10846 leader_election.cc:290] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:17.095806 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 76733.2us
I20260709 13:02:17.030885 10934 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.102555 10634 consensus_queue.cc:260] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.010033 11019 raft_consensus.cc:515] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:17.130440 10261 catalog_manager.cc:5697] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.146517 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:17.179112 11078 raft_consensus.cc:493] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.183979 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 149645us
I20260709 13:02:17.196581 10634 ts_tablet_manager.cc:1434] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.263s	user 0.015s	sys 0.000s
I20260709 13:02:17.197425 10939 leader_election.cc:290] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:17.199077 10934 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:17.202872 11019 leader_election.cc:290] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:17.240334 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 143413us
I20260709 13:02:17.244194 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:17.270800 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:17.271982 10514 raft_consensus.cc:2468] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
W20260709 13:02:17.273535 10554 leader_election.cc:343] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.265808 10934 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.284575 10934 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.296824 10634 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:17.299714 10405 leader_election.cc:304] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:17.300649 10934 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:17.302683 11077 raft_consensus.cc:2804] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:17.303261 11077 raft_consensus.cc:493] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.304546 11077 raft_consensus.cc:3060] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:17.313941 11062 raft_consensus.cc:515] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.232652 11078 raft_consensus.cc:515] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:17.317060 10635 tablet_bootstrap.cc:654] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.318612 11078 leader_election.cc:290] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:17.321460 11062 leader_election.cc:290] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:17.315891 10632 tablet_bootstrap.cc:654] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.344834 10633 tablet_bootstrap.cc:654] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.359244 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:17.362421 10358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:17.363737 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:17.398077 10480 leader_election.cc:343] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:17.513705 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:02:17.481544 11008 consensus_meta.cc:287] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.012s
I20260709 13:02:17.404815 10359 raft_consensus.cc:2468] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:17.521584 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:17.531401 10552 leader_election.cc:343] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.509918 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:17.540297 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:17.540750 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:17.541744 10514 raft_consensus.cc:3060] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:17.526072 11008 raft_consensus.cc:515] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.569974 10438 raft_consensus.cc:3060] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:17.585208 10405 leader_election.cc:343] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.596261 10582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:17.602953 10635 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:17.604216 11008 leader_election.cc:290] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:17.606475 10635 ts_tablet_manager.cc:1403] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.612s	user 0.022s	sys 0.041s
W20260709 13:02:17.608474 10552 leader_election.cc:343] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:17.609336 10552 leader_election.cc:343] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.609731 10552 leader_election.cc:304] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:17.610181 10635 raft_consensus.cc:359] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.611207 10635 raft_consensus.cc:385] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.611503 10635 raft_consensus.cc:740] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.538568 11077 raft_consensus.cc:515] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:17.637753 11077 leader_election.cc:290] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:17.641836 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:17.649425 10355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc89042adb84e11abc2a012b5c30358" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:17.631527 10634 tablet_bootstrap.cc:654] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:17.654532 10478 leader_election.cc:343] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.622738 10794 raft_consensus.cc:2749] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:17.655683 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 131466us
I20260709 13:02:17.656536 10478 leader_election.cc:304] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:17.633736 10635 consensus_queue.cc:260] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.663008 10635 ts_tablet_manager.cc:1434] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:02:17.664531 10635 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:17.668308 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:17.666345 10355 raft_consensus.cc:3060] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:17.676506 10478 leader_election.cc:304] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:17.675889 10361 raft_consensus.cc:2393] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:17.678467 11068 consensus_queue.cc:1048] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:17.684006 11015 raft_consensus.cc:2804] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:17.684541 11015 raft_consensus.cc:493] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.684917 11015 raft_consensus.cc:3060] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:17.688503 10582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:17.689836 11067 consensus_queue.cc:1048] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:17.676879 10846 raft_consensus.cc:2749] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.694430 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:17.695214 10583 raft_consensus.cc:3060] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:17.702307 10405 leader_election.cc:343] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.715330 11098 consensus_queue.cc:1048] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:17.717458 10514 raft_consensus.cc:2468] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:17.732337 10634 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:17.733074 10634 ts_tablet_manager.cc:1403] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.454s	user 0.020s	sys 0.003s
I20260709 13:02:17.749284 10633 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:17.754868 10640 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.755857 10640 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:17.752843 10403 consensus_peers.cc:597] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:17.742528 10554 leader_election.cc:343] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.757370 10554 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:17.758191 10640 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:17.759389 10633 ts_tablet_manager.cc:1403] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.780s	user 0.031s	sys 0.011s
I20260709 13:02:17.753672 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:17.760715 11072 raft_consensus.cc:2749] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.744030 10634 raft_consensus.cc:359] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.764168 10634 raft_consensus.cc:385] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.764757 10634 raft_consensus.cc:740] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.765684 10634 consensus_queue.cc:260] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.780112 10634 ts_tablet_manager.cc:1434] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 13:02:17.780510 10632 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:17.781144 10632 ts_tablet_manager.cc:1403] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.868s	user 0.029s	sys 0.034s
I20260709 13:02:17.773916 10633 raft_consensus.cc:359] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.782981 10633 raft_consensus.cc:385] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.783301 10633 raft_consensus.cc:740] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.795437 10634 tablet_bootstrap.cc:492] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:17.798148 11080 raft_consensus.cc:493] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.798237 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:17.800493 10513 raft_consensus.cc:3060] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:17.806105 10634 tablet_bootstrap.cc:654] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.807560 10633 consensus_queue.cc:260] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.780500 11093 consensus_queue.cc:1048] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:02:17.810998 10507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:17.799047 11080 raft_consensus.cc:515] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.817852 10405 leader_election.cc:304] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:17.821228 10435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:17.821894 11086 raft_consensus.cc:2804] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:17.822522 11086 raft_consensus.cc:697] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:17.831406 10403 leader_election.cc:304] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:17.823513 11086 consensus_queue.cc:237] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:17.824410 10480 consensus_peers.cc:597] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d -> Peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Couldn't send request to peer 40a50bcbfe194a288c6b3333e6556a88. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:17.852367 10554 leader_election.cc:343] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.852929 10554 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
W20260709 13:02:17.846184 10330 leader_election.cc:343] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:17.858232 10480 leader_election.cc:343] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.846803 10632 raft_consensus.cc:359] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.865198 10632 raft_consensus.cc:385] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.867470 10632 raft_consensus.cc:740] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.840674 11080 leader_election.cc:290] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:17.885457 10632 consensus_queue.cc:260] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:17.876358 11019 raft_consensus.cc:2749] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.889050 11015 raft_consensus.cc:515] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.891407 11093 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.892105 11093 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:17.871878 10355 raft_consensus.cc:2468] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:17.899437 10632 ts_tablet_manager.cc:1434] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.001s
I20260709 13:02:17.903486 10435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:17.903966 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:17.904629 10357 raft_consensus.cc:3060] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:17.905807 10635 tablet_bootstrap.cc:654] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.886598 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:17.910389 10480 leader_election.cc:343] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.912348 10633 ts_tablet_manager.cc:1434] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.152s	user 0.010s	sys 0.000s
I20260709 13:02:17.925472 10854 raft_consensus.cc:2749] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.895196 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:17.931499 10633 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
W20260709 13:02:17.933575 11100 log.cc:927] Time spent T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:02:17.945071 11093 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:17.945966 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:17.893157 11015 leader_election.cc:290] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:17.949090 10403 leader_election.cc:343] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.965721 10632 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:17.928243 10508 raft_consensus.cc:2468] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:17.967933 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:17.964433 10480 leader_election.cc:343] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.952991 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:17.972498 10480 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:17.974509 10405 leader_election.cc:304] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
W20260709 13:02:17.979954 10478 leader_election.cc:343] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.971223 10583 raft_consensus.cc:2468] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:17.971524 11081 raft_consensus.cc:493] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.992934 11103 log.cc:927] Time spent T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:18.007180 10513 raft_consensus.cc:2468] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:17.984822 10854 raft_consensus.cc:2804] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:17.983332 11015 raft_consensus.cc:2749] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.994455 10960 raft_consensus.cc:493] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.022043 10854 raft_consensus.cc:493] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.046249 10854 raft_consensus.cc:3060] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.040273 10960 raft_consensus.cc:515] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:18.064239 10480 leader_election.cc:343] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.064898 10480 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:18.066653 10405 leader_election.cc:304] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:18.032850 10633 tablet_bootstrap.cc:654] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.067647 10330 leader_election.cc:304] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: ed955e6936204882a741c58f33790c5d
I20260709 13:02:18.076128 10640 raft_consensus.cc:2749] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:18.082680 10634 tablet_bootstrap.cc:492] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:18.083323 10634 ts_tablet_manager.cc:1403] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.288s	user 0.010s	sys 0.013s
I20260709 13:02:18.021656 11081 raft_consensus.cc:515] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:18.095664 11088 raft_consensus.cc:2804] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.105967 10854 raft_consensus.cc:515] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:18.108901 10854 leader_election.cc:290] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:18.109707 10960 leader_election.cc:290] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:18.110172 10358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:18.114549 11081 leader_election.cc:290] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:18.082005 11077 raft_consensus.cc:2804] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.128018 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:18.155138 10362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:18.131521 11077 raft_consensus.cc:697] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:18.136206 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce1ab0a022b49e09aa7b7a686bff66b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:18.157244 10507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:18.217857 11077 consensus_queue.cc:237] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.200239 10507 raft_consensus.cc:3060] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.221812 10632 tablet_bootstrap.cc:654] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.235216 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a946d8672ce4315b453f1d418d5f197" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:18.203137 11088 raft_consensus.cc:697] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:18.255044 10634 raft_consensus.cc:359] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.256228 10634 raft_consensus.cc:385] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.256594 10634 raft_consensus.cc:740] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.222743 10357 raft_consensus.cc:2468] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
W20260709 13:02:18.232357 10403 leader_election.cc:343] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.262895 10478 leader_election.cc:304] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:18.266556 11092 raft_consensus.cc:2804] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.267285 11092 raft_consensus.cc:697] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:18.268386 11092 consensus_queue.cc:237] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:18.269728 10633 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:18.270416 10633 ts_tablet_manager.cc:1403] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.339s	user 0.023s	sys 0.020s
I20260709 13:02:18.274097 10633 raft_consensus.cc:359] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:18.274988 10633 raft_consensus.cc:385] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.262989 10634 consensus_queue.cc:260] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.276276 10635 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:18.276906 10634 ts_tablet_manager.cc:1434] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.000s
I20260709 13:02:18.276937 10635 ts_tablet_manager.cc:1403] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.613s	user 0.013s	sys 0.008s
I20260709 13:02:18.285387 10360 raft_consensus.cc:3060] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.289295 11088 consensus_queue.cc:237] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:18.291941 10634 tablet_bootstrap.cc:492] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:18.275317 10633 raft_consensus.cc:740] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.316007 10633 consensus_queue.cc:260] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:18.329895 10635 raft_consensus.cc:359] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:18.334658 10635 raft_consensus.cc:385] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.335186 10635 raft_consensus.cc:740] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.337707 10554 leader_election.cc:304] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:18.343636 10794 raft_consensus.cc:2749] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:18.338819 10635 consensus_queue.cc:260] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:18.446966 10330 leader_election.cc:304] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:18.450165 10634 tablet_bootstrap.cc:654] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.431247 10261 catalog_manager.cc:5697] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.420727 10507 raft_consensus.cc:2468] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:18.479581 10635 ts_tablet_manager.cc:1434] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.195s	user 0.004s	sys 0.012s
W20260709 13:02:18.484846 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 13:02:18.492354 10633 ts_tablet_manager.cc:1434] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.222s	user 0.013s	sys 0.008s
I20260709 13:02:18.495533 11131 consensus_queue.cc:1048] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:18.498819 10583 raft_consensus.cc:3060] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.574175 10854 raft_consensus.cc:493] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.574949 10854 raft_consensus.cc:515] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:18.579632 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:18.579900 10635 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:18.580593 10586 raft_consensus.cc:2468] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 0.
I20260709 13:02:18.582676 10405 leader_election.cc:304] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:18.583892 11068 raft_consensus.cc:2804] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.584400 11068 raft_consensus.cc:493] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.584786 11068 raft_consensus.cc:3060] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:18.598897 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:18.599217 10632 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:18.600499 10632 ts_tablet_manager.cc:1403] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.673s	user 0.014s	sys 0.024s
I20260709 13:02:18.595870 10355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:18.628072 10259 catalog_manager.cc:5697] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.602047 10854 leader_election.cc:290] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:18.645154 10633 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:18.647779 10405 leader_election.cc:304] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:18.651022 11131 raft_consensus.cc:2804] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.658191 11131 raft_consensus.cc:697] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:18.665505 11131 consensus_queue.cc:237] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:18.686291 11066 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.688237 11066 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:18.691277 10634 tablet_bootstrap.cc:492] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:18.692013 10634 ts_tablet_manager.cc:1403] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.400s	user 0.014s	sys 0.027s
I20260709 13:02:18.702029 10634 raft_consensus.cc:359] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.702764 10634 raft_consensus.cc:385] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.703053 10634 raft_consensus.cc:740] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.704990 10635 tablet_bootstrap.cc:654] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.704201 10634 consensus_queue.cc:260] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.718195 10634 ts_tablet_manager.cc:1434] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:02:18.719633 10634 tablet_bootstrap.cc:492] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:18.732342 11116 raft_consensus.cc:2749] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:18.710189 10403 leader_election.cc:343] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.739984 11123 raft_consensus.cc:493] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.746344 11123 raft_consensus.cc:515] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.748261 11066 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:18.749305 11125 consensus_queue.cc:1048] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.078s
I20260709 13:02:18.749861 11123 leader_election.cc:290] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:18.750180 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
W20260709 13:02:18.752230 10478 leader_election.cc:343] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.753458 10632 raft_consensus.cc:359] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:18.759063 10632 raft_consensus.cc:385] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.759485 10632 raft_consensus.cc:740] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.761866 10632 consensus_queue.cc:260] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:18.764851 10480 consensus_peers.cc:597] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.765729 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:18.783368 10405 consensus_peers.cc:597] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 -> Peer 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525): Couldn't send request to peer 40a50bcbfe194a288c6b3333e6556a88. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.787477 11116 consensus_queue.cc:1048] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:18.793871 10633 tablet_bootstrap.cc:654] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.802927 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:18.804245 10513 raft_consensus.cc:2468] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:18.808604 10554 leader_election.cc:304] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:18.810281 11120 raft_consensus.cc:2804] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.811013 11120 raft_consensus.cc:493] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.774863 10585 raft_consensus.cc:2468] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 0.
I20260709 13:02:18.811867 11120 raft_consensus.cc:3060] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.818254 11116 raft_consensus.cc:493] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.819125 11116 raft_consensus.cc:515] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:18.735590 11068 raft_consensus.cc:515] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:18.834143 10632 ts_tablet_manager.cc:1434] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.233s	user 0.008s	sys 0.002s
W20260709 13:02:18.835584 10554 consensus_peers.cc:597] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:18.832098 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:18.840158 11068 leader_election.cc:290] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:18.840505 11126 consensus_queue.cc:1048] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:18.847074 10554 leader_election.cc:343] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.844184 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:18.855206 10585 raft_consensus.cc:3060] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.855685 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:18.861335 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:18.862488 10436 raft_consensus.cc:2393] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 1: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:18.845893 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d181df5e24eca9a3124fa9442fe94" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:18.863940 10360 raft_consensus.cc:3060] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.864770 11123 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.865428 11123 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:18.868207 11123 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:18.876685 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:18.877696 10513 raft_consensus.cc:2468] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:18.882318 10554 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:18.884433 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:18.881090 10330 leader_election.cc:304] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:18.896885 10632 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:18.899926 10480 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:18.844192 11116 leader_election.cc:290] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:18.900556 11123 raft_consensus.cc:2804] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.912536 11123 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.913094 11123 raft_consensus.cc:3060] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.914037 10635 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:18.914678 10635 ts_tablet_manager.cc:1403] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.366s	user 0.011s	sys 0.005s
W20260709 13:02:18.916311 10554 leader_election.cc:343] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.918253 10635 raft_consensus.cc:359] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:18.919157 10635 raft_consensus.cc:385] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.919898 10635 raft_consensus.cc:740] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.920660 10635 consensus_queue.cc:260] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:18.905561 10640 raft_consensus.cc:2804] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.923825 10640 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.924368 10640 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.964200 10635 ts_tablet_manager.cc:1434] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:02:18.976435 10640 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.016700 10635 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:19.016990 10634 tablet_bootstrap.cc:654] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.007689 11080 raft_consensus.cc:493] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.033808 11080 raft_consensus.cc:515] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:19.018038 11086 consensus_queue.cc:1048] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:02:19.056957 10585 raft_consensus.cc:2468] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:19.119071 10632 tablet_bootstrap.cc:654] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.124944 10359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:19.127244 11080 leader_election.cc:290] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:19.129832 10633 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:19.130511 10633 ts_tablet_manager.cc:1403] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.491s	user 0.014s	sys 0.021s
I20260709 13:02:19.133199 11120 raft_consensus.cc:515] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:19.166330 10403 consensus_peers.cc:597] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:19.162825 10633 raft_consensus.cc:359] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.167855 10633 raft_consensus.cc:385] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.168226 10633 raft_consensus.cc:740] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.178650 11123 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:19.179930 10640 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:19.184083 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:19.185215 10583 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.178793 10633 consensus_queue.cc:260] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.179142 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:19.201555 10635 tablet_bootstrap.cc:654] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.205732 10507 raft_consensus.cc:3060] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.215451 10633 ts_tablet_manager.cc:1434] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.005s
I20260709 13:02:19.217074 10633 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: Bootstrap starting.
I20260709 13:02:19.231371 10355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:19.237814 11120 leader_election.cc:290] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:19.238452 10405 leader_election.cc:304] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:19.240180 11077 raft_consensus.cc:2804] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:19.241112 11077 raft_consensus.cc:697] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:19.145500 10360 raft_consensus.cc:2468] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:19.243517 11088 raft_consensus.cc:2749] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:19.242569 11077 consensus_queue.cc:237] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.246435 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:19.249382 10554 leader_election.cc:343] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.261696 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:19.263374 10509 raft_consensus.cc:3060] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.274153 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:19.277935 10554 leader_election.cc:343] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.262176 10436 raft_consensus.cc:3060] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.279347 10634 tablet_bootstrap.cc:492] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:19.281920 10634 ts_tablet_manager.cc:1403] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.563s	user 0.039s	sys 0.035s
W20260709 13:02:19.283741 10478 leader_election.cc:343] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.293841 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:19.295010 10514 raft_consensus.cc:3060] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.295369 10405 leader_election.cc:304] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:19.298616 10583 raft_consensus.cc:2468] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:19.312784 10514 raft_consensus.cc:2468] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:19.307382 11123 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:19.326089 10554 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:19.328876 11072 raft_consensus.cc:2804] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:19.329841 11072 raft_consensus.cc:697] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:19.331013 11072 consensus_queue.cc:237] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:19.335592 11087 consensus_queue.cc:1048] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:19.323436 10633 tablet_bootstrap.cc:654] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.362128 10480 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:19.366922 10640 raft_consensus.cc:2804] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:19.367811 10640 raft_consensus.cc:697] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:19.368738 10640 consensus_queue.cc:237] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.408844 10634 raft_consensus.cc:359] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:19.415779 10634 raft_consensus.cc:385] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.416415 10634 raft_consensus.cc:740] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.417799 10634 consensus_queue.cc:260] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
W20260709 13:02:19.410422 11154 log.cc:927] Time spent T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:02:19.442557 10632 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:19.443357 10632 ts_tablet_manager.cc:1403] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.571s	user 0.026s	sys 0.005s
I20260709 13:02:19.457108 10634 ts_tablet_manager.cc:1434] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.175s	user 0.006s	sys 0.003s
I20260709 13:02:19.458381 10632 raft_consensus.cc:359] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:19.459365 10632 raft_consensus.cc:385] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.459899 10261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42966 (request call id 65) took 1282 ms. Trace:
I20260709 13:02:19.460907 10632 raft_consensus.cc:740] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.462073 10635 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:19.463876 10634 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:19.502849 10635 ts_tablet_manager.cc:1403] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.513s	user 0.027s	sys 0.016s
I20260709 13:02:19.511605 10634 tablet_bootstrap.cc:654] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.462128 10632 consensus_queue.cc:260] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:19.526643 10632 ts_tablet_manager.cc:1434] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:02:19.472020 10509 raft_consensus.cc:2468] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:19.484653 10260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42984 (request call id 62) took 1028 ms. Trace:
I20260709 13:02:19.488641 10262 catalog_manager.cc:5697] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.501433 11068 consensus_queue.cc:1048] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:19.530411 10260 rpcz_store.cc:276] 0709 13:02:18.456222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.456369 (+   147us) service_pool.cc:224] Handling call
0709 13:02:19.484525 (+1028156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18581,"reported_tablets":1}
I20260709 13:02:19.525861 10635 raft_consensus.cc:359] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.549448 10635 raft_consensus.cc:385] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.549815 10635 raft_consensus.cc:740] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.553145 10632 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:19.553252 10554 leader_election.cc:304] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:19.550774 10635 consensus_queue.cc:260] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.565093 11132 raft_consensus.cc:2804] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:19.565834 11132 raft_consensus.cc:697] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:19.460530 10261 rpcz_store.cc:276] 0709 13:02:18.192131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.198295 (+  6164us) service_pool.cc:224] Handling call
0709 13:02:19.459709 (+1261414us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:18.637404 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:18.651751 (+ 14347us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:18.651793 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:02:18.651812 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:18.652198 (+   386us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:18.652287 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:18.652320 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:18.652529 (+   209us) tablet.cc:701] Row locks acquired
0709 13:02:18.652547 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:18.652706 (+   159us) write_op.cc:270] Start()
0709 13:02:18.652827 (+   121us) write_op.cc:276] Timestamp: P: 1783602138652661 usec, L: 0
0709 13:02:18.652849 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:18.653726 (+   877us) log.cc:844] Serialized 540 byte log entry
0709 13:02:19.125565 (+471839us) op_driver.cc:464] REPLICATION: finished
0709 13:02:19.367848 (+242283us) write_op.cc:301] APPLY: starting
0709 13:02:19.368113 (+   265us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:19.368231 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:19.368380 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:19.368693 (+   313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:19.369921 (+  1228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:19.369983 (+    62us) write_op.cc:312] APPLY: finished
0709 13:02:19.371577 (+  1594us) log.cc:844] Serialized 22 byte log entry
0709 13:02:19.374613 (+  3036us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.374721 (+   108us) write_op.cc:454] Released schema lock
0709 13:02:19.374771 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:19.378096 (+  3325us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.381258 (+  3162us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":241965,"apply.run_cpu_time_us":3437,"apply.run_wall_time_us":7399,"num_ops":1,"prepare.queue_time_us":138201,"prepare.run_cpu_time_us":78462,"prepare.run_wall_time_us":207395,"raft.queue_time_us":581582,"raft.run_cpu_time_us":69413,"raft.run_wall_time_us":282004,"replication_time_us":472524,"thread_start_us":632494,"threads_started":4,"wal-append.queue_time_us":222163}]]}
I20260709 13:02:19.586277 10635 ts_tablet_manager.cc:1434] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.001s
I20260709 13:02:19.566870 11132 consensus_queue.cc:237] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:19.605597 11131 raft_consensus.cc:2749] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:19.620185 10635 tablet_bootstrap.cc:492] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:19.634322 10633 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: No bootstrap required, opened a new log
I20260709 13:02:19.634960 10633 ts_tablet_manager.cc:1403] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: Time spent bootstrapping tablet: real 0.418s	user 0.049s	sys 0.036s
I20260709 13:02:19.638861 10633 raft_consensus.cc:359] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.639726 10633 raft_consensus.cc:385] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.640030 10633 raft_consensus.cc:740] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.643910 10633 consensus_queue.cc:260] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.657994 10794 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.658262 11126 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.669574 10794 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.670038 11126 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:19.672717 11126 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:19.677842 10435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:19.680979 10480 leader_election.cc:343] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.682377 10633 ts_tablet_manager.cc:1434] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.003s
W20260709 13:02:19.691262 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:19.693048 10794 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:19.694674 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:19.695371 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:19.695689 10511 raft_consensus.cc:2468] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
W20260709 13:02:19.698051 10552 leader_election.cc:343] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.699070 10554 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:19.700335 11075 raft_consensus.cc:2804] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:19.700798 11075 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.701159 11075 raft_consensus.cc:3060] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.679287 11132 raft_consensus.cc:493] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.706983 11132 raft_consensus.cc:515] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:19.709491 11132 leader_election.cc:290] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:19.714684 10632 tablet_bootstrap.cc:654] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.716017 10355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:19.715952 10635 tablet_bootstrap.cc:654] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.730877 10262 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42960 (request call id 67) took 1080 ms. Trace:
W20260709 13:02:19.734475 10478 leader_election.cc:343] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.735862 10478 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:19.735769 10261 catalog_manager.cc:5697] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.740204 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:19.748863 11093 raft_consensus.cc:2749] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:19.735581 10262 rpcz_store.cc:276] 0709 13:02:18.650594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.658202 (+  7608us) service_pool.cc:224] Handling call
0709 13:02:18.846962 (+188760us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540013ced4. stack: 00007f947e36e343 00007f947e36e240 00007f947dcfd1d4 00007f9487a3b304 00007f9487a3b299 00007f94813f7090 00007f9481495f3a 00007f948724c1cc 00007f948734a37e 00007f948580b2a4 00007f948580b232 00007f948580b161 00007f948580b0dc 00007f948580a392 00007f947f7c848c 00007f947f7c78c6
0709 13:02:19.730749 (+883787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:19.626279 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:19.637650 (+ 11371us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:19.637688 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:02:19.637709 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:19.638112 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:19.638193 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:19.638228 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:19.638458 (+   230us) tablet.cc:701] Row locks acquired
0709 13:02:19.638478 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:19.638638 (+   160us) write_op.cc:270] Start()
0709 13:02:19.638772 (+   134us) write_op.cc:276] Timestamp: P: 1783602139638591 usec, L: 0
0709 13:02:19.638792 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:19.639626 (+   834us) log.cc:844] Serialized 540 byte log entry
0709 13:02:19.677582 (+ 37956us) op_driver.cc:464] REPLICATION: finished
0709 13:02:19.678171 (+   589us) write_op.cc:301] APPLY: starting
0709 13:02:19.678267 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:19.678382 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:19.678493 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:19.678740 (+   247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:19.678933 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:19.678985 (+    52us) write_op.cc:312] APPLY: finished
0709 13:02:19.679210 (+   225us) log.cc:844] Serialized 22 byte log entry
0709 13:02:19.685181 (+  5971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.685291 (+   110us) write_op.cc:454] Released schema lock
0709 13:02:19.685336 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:19.685718 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.685766 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":415654144,"child_traces":[["op",{"apply.queue_time_us":358,"apply.run_cpu_time_us":1831,"apply.run_wall_time_us":7519,"num_ops":1,"prepare.queue_time_us":90300,"prepare.run_cpu_time_us":3313,"prepare.run_wall_time_us":15543,"replication_time_us":38626,"thread_start_us":89828,"threads_started":1}]]}
I20260709 13:02:19.762705 10507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:19.767691 10355 raft_consensus.cc:3060] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.768385 10554 leader_election.cc:304] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:19.770351 11072 raft_consensus.cc:2749] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:19.786648 10854 consensus_queue.cc:1048] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:19.815084 10632 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:19.815084 10634 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:19.816438 10634 ts_tablet_manager.cc:1403] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.356s	user 0.056s	sys 0.050s
I20260709 13:02:19.816438 10632 ts_tablet_manager.cc:1403] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.277s	user 0.015s	sys 0.007s
I20260709 13:02:19.820700 10632 raft_consensus.cc:359] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.820961 10259 catalog_manager.cc:5697] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.806983 11075 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.822052 10632 raft_consensus.cc:385] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.825488 10259 catalog_manager.cc:5697] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.823825 10632 raft_consensus.cc:740] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.831527 10632 consensus_queue.cc:260] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.833423 11075 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:19.831492 10854 raft_consensus.cc:493] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.835881 10259 catalog_manager.cc:5697] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.847775 10358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:19.854318 10634 raft_consensus.cc:359] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.855346 10634 raft_consensus.cc:385] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.855734 10634 raft_consensus.cc:740] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.862280 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:19.863694 10508 raft_consensus.cc:3060] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:19.864272 10552 leader_election.cc:343] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:19.857193 10634 consensus_queue.cc:260] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.873499 10634 ts_tablet_manager.cc:1434] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:02:19.875048 10634 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: Bootstrap starting.
I20260709 13:02:19.837772 10854 raft_consensus.cc:515] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.907173 11131 consensus_queue.cc:1048] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:19.898839 10260 catalog_manager.cc:5697] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 0 to 1, leader changed from <none> to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.920389 10632 ts_tablet_manager.cc:1434] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:02:19.938653 10635 tablet_bootstrap.cc:492] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:19.951882 10635 ts_tablet_manager.cc:1403] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.345s	user 0.027s	sys 0.018s
I20260709 13:02:19.939585 10632 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:19.924320 11087 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.957412 11087 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:19.956904 10634 tablet_bootstrap.cc:654] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.960230 10508 raft_consensus.cc:2468] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:19.933717 11120 raft_consensus.cc:493] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.965756 11120 raft_consensus.cc:515] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:19.968564 11087 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:19.972292 10635 raft_consensus.cc:359] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:19.973219 10635 raft_consensus.cc:385] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.973544 10635 raft_consensus.cc:740] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.979207 10854 leader_election.cc:290] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:19.980083 11124 consensus_queue.cc:1048] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:19.983952 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:19.986379 11120 leader_election.cc:290] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:19.987435 10358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed66d8d97d2426a851e3fcccde152e5" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:19.990061 10586 raft_consensus.cc:3060] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.991139 10403 leader_election.cc:304] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:19.992543 11086 raft_consensus.cc:2749] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:19.994904 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 68582.2us
I20260709 13:02:19.999867 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:20.015374 10358 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.021644 10632 tablet_bootstrap.cc:654] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.023620 10635 consensus_queue.cc:260] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:20.032402 10635 ts_tablet_manager.cc:1434] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.004s
I20260709 13:02:20.033947 10635 tablet_bootstrap.cc:492] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:20.037768 10634 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: No bootstrap required, opened a new log
I20260709 13:02:20.038486 10634 ts_tablet_manager.cc:1403] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.003s
I20260709 13:02:20.042630 10634 raft_consensus.cc:359] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.043500 10634 raft_consensus.cc:385] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.049872 10634 raft_consensus.cc:740] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.050614 10632 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:20.051293 10632 ts_tablet_manager.cc:1403] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.004s
W20260709 13:02:20.056633 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 130005us
I20260709 13:02:20.074456 10632 raft_consensus.cc:359] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.075812 10632 raft_consensus.cc:385] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.076192 10632 raft_consensus.cc:740] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.078610 10635 tablet_bootstrap.cc:654] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.083092 10262 catalog_manager.cc:5697] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:20.090606 10632 consensus_queue.cc:260] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.098176 10632 ts_tablet_manager.cc:1434] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:02:20.056794 10634 consensus_queue.cc:260] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.104395 10355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbdc170b3548d0bf43c26db2aa84d0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:20.105352 10355 raft_consensus.cc:2468] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:20.109527 10632 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:20.117116 10632 tablet_bootstrap.cc:654] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.121367 10635 tablet_bootstrap.cc:492] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:20.122107 10635 ts_tablet_manager.cc:1403] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.005s
I20260709 13:02:20.126327 10635 raft_consensus.cc:359] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:20.127965 10635 raft_consensus.cc:385] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.128547 10635 raft_consensus.cc:740] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.129632 10635 consensus_queue.cc:260] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:20.131825 10635 ts_tablet_manager.cc:1434] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:02:20.137141 10635 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:20.147814 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:20.148379 10632 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:20.149452 10632 ts_tablet_manager.cc:1403] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 13:02:20.154780 10632 raft_consensus.cc:359] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.149757 10583 raft_consensus.cc:2393] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 1: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:20.156613 10635 tablet_bootstrap.cc:654] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:20.168576 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 109133us
I20260709 13:02:20.161696 10632 raft_consensus.cc:385] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.164738 10854 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.166893 10552 leader_election.cc:304] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:20.156038 10634 ts_tablet_manager.cc:1434] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: Time spent starting tablet: real 0.117s	user 0.004s	sys 0.005s
I20260709 13:02:20.171044 10854 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:20.172077 11072 raft_consensus.cc:2804] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:20.172547 11072 raft_consensus.cc:493] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.172921 11072 raft_consensus.cc:3060] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.174007 10854 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:20.176955 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:20.181133 10632 raft_consensus.cc:740] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
W20260709 13:02:20.174136 10554 consensus_peers.cc:597] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.183620 10554 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:20.185528 11073 raft_consensus.cc:2804] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:20.186408 11073 raft_consensus.cc:697] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:20.186507 10632 consensus_queue.cc:260] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.186983 10435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbdc170b3548d0bf43c26db2aa84d0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:20.183655 11169 consensus_queue.cc:1048] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:02:20.189563 11073 consensus_queue.cc:237] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:20.191169 10632 ts_tablet_manager.cc:1434] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 13:02:20.196887 10632 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:20.200539 11082 consensus_queue.cc:1048] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:20.214461 11072 raft_consensus.cc:515] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.181454 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:20.226944 10330 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:20.228204 10508 raft_consensus.cc:2393] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:20.229209 11072 leader_election.cc:290] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:20.229555 11172 raft_consensus.cc:2749] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:20.230561 10405 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:20.235107 10854 raft_consensus.cc:3060] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.237190 10360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbdc170b3548d0bf43c26db2aa84d0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:20.238159 10360 raft_consensus.cc:3060] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.253486 10635 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:20.258764 10635 ts_tablet_manager.cc:1403] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.004s
I20260709 13:02:20.271788 10360 raft_consensus.cc:2468] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:20.274073 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbdc170b3548d0bf43c26db2aa84d0" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:20.274755 10436 raft_consensus.cc:3060] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.274133 10439 raft_consensus.cc:3060] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.280594 10635 raft_consensus.cc:359] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.281500 10635 raft_consensus.cc:385] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.281798 10635 raft_consensus.cc:740] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.283114 10632 tablet_bootstrap.cc:654] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.285630 11172 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.276942 10554 leader_election.cc:343] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:20.286466 11172 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:20.288340 10554 leader_election.cc:343] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:20.288940 11172 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:20.295018 10635 consensus_queue.cc:260] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.304800 10635 ts_tablet_manager.cc:1434] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:02:20.315532 10552 leader_election.cc:304] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:20.336629 11169 raft_consensus.cc:2804] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:20.346062 11169 raft_consensus.cc:697] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:20.320065 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:20.320335 10794 consensus_queue.cc:1048] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:02:20.372851 10262 catalog_manager.cc:5697] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.388789 10635 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
W20260709 13:02:20.388481 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 60999.3us
I20260709 13:02:20.373665 11080 raft_consensus.cc:493] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.393126 11080 raft_consensus.cc:515] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:20.397480 11169 consensus_queue.cc:237] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.383097 11132 consensus_queue.cc:1048] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:02:20.403944 10330 leader_election.cc:343] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:20.385620 10854 raft_consensus.cc:2749] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:20.415886 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 95108.2us
W20260709 13:02:20.420825 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 103122us
I20260709 13:02:20.442613 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:20.464802 10632 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:20.465525 10632 ts_tablet_manager.cc:1403] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.269s	user 0.030s	sys 0.028s
I20260709 13:02:20.471120 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ab34f9dee040f1a9711e01915f2048" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:20.488140 10635 tablet_bootstrap.cc:654] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.489403 10405 leader_election.cc:304] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:20.467835 11080 leader_election.cc:290] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:20.499397 10854 raft_consensus.cc:2749] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:20.539669 10632 raft_consensus.cc:359] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:20.540988 10632 raft_consensus.cc:385] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.541603 10632 raft_consensus.cc:740] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.542735 10632 consensus_queue.cc:260] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:20.545814 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 74397.7us
I20260709 13:02:20.557081 10632 ts_tablet_manager.cc:1434] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.091s	user 0.011s	sys 0.000s
I20260709 13:02:20.583592 10632 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:20.612003 10632 tablet_bootstrap.cc:654] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.588925 11086 raft_consensus.cc:493] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.639604 11086 raft_consensus.cc:515] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:20.642881 11086 leader_election.cc:290] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:20.732517 10403 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 107262us
I20260709 13:02:20.745532 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbdc170b3548d0bf43c26db2aa84d0" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:20.747921 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 432551us
I20260709 13:02:20.815483 11172 raft_consensus.cc:493] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.816155 11172 raft_consensus.cc:515] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:20.836469 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbdc170b3548d0bf43c26db2aa84d0" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:20.837610 10361 raft_consensus.cc:2393] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:20.847599 10632 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:20.848954 10632 ts_tablet_manager.cc:1403] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.018s
I20260709 13:02:20.803390 10794 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.819367 11172 leader_election.cc:290] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:20.862979 10794 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:20.950416 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 238896us
I20260709 13:02:20.951792 10635 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:20.952349 10635 ts_tablet_manager.cc:1403] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.567s	user 0.027s	sys 0.041s
W20260709 13:02:20.954021 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 182964us
I20260709 13:02:20.961375 10632 raft_consensus.cc:359] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:20.963054 10632 raft_consensus.cc:385] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.963507 10632 raft_consensus.cc:740] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.966161 10632 consensus_queue.cc:260] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:20.971232 10632 ts_tablet_manager.cc:1434] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.122s	user 0.014s	sys 0.000s
I20260709 13:02:20.979931 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:21.038317 10632 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:20.999946 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9420094312cb4ae390240a2dafe35479" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:21.065184 10405 leader_election.cc:304] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:21.036182 10794 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:21.064990 10635 raft_consensus.cc:359] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:21.071518 10635 raft_consensus.cc:385] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:21.071964 10635 raft_consensus.cc:740] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:21.078747 10635 consensus_queue.cc:260] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:21.094967 11205 log.cc:927] Time spent T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:02:21.095997 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:21.096881 10586 raft_consensus.cc:2468] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:21.075023 11195 raft_consensus.cc:3060] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.104914 10330 leader_election.cc:304] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:21.106155 11087 raft_consensus.cc:2749] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:21.111250 10440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:21.112191 10440 raft_consensus.cc:2468] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 0.
I20260709 13:02:21.137507 11147 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.138470 11147 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:21.145373 10330 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:21.146930 11087 raft_consensus.cc:2804] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:21.147398 11087 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.147769 11087 raft_consensus.cc:3060] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.143101 11147 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:21.159763 10635 ts_tablet_manager.cc:1434] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.207s	user 0.011s	sys 0.000s
W20260709 13:02:21.174657 10552 consensus_peers.cc:597] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.162283 10554 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:21.194533 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:21.195631 10511 raft_consensus.cc:2468] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 0.
I20260709 13:02:21.202862 10635 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211: Bootstrap starting.
I20260709 13:02:21.187130 11072 raft_consensus.cc:2804] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:21.210919 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:21.214783 10361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:21.228883 10358 raft_consensus.cc:3060] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.225657 10632 tablet_bootstrap.cc:654] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:21.211033 11072 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.247645 11072 raft_consensus.cc:3060] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.263207 10794 consensus_queue.cc:1048] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:21.269109 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 66122.9us
I20260709 13:02:21.269971 10635 tablet_bootstrap.cc:654] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:21.274570 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:21.276129 11195 raft_consensus.cc:2749] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:21.283125 11211 consensus_queue.cc:1048] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:21.278530 10330 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:21.296480 11147 raft_consensus.cc:2804] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:21.297020 11147 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.298638 11147 raft_consensus.cc:3060] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:21.311411 10330 leader_election.cc:343] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:21.320542 11072 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:21.323194 11072 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:21.329324 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:21.330641 10635 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211: No bootstrap required, opened a new log
I20260709 13:02:21.342442 10635 ts_tablet_manager.cc:1403] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211: Time spent bootstrapping tablet: real 0.163s	user 0.019s	sys 0.003s
I20260709 13:02:21.332788 11087 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:21.352088 10436 raft_consensus.cc:3060] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.393712 11147 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:21.396677 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:21.385670 11189 consensus_queue.cc:1048] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:02:21.399432 11087 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:21.400084 10361 raft_consensus.cc:2393] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 1: Already voted for candidate b4af86c3867e41659d5499027b08b924 in this term.
I20260709 13:02:21.407265 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:21.411463 10582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:21.417459 10582 raft_consensus.cc:2393] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 1: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:21.412398 10635 raft_consensus.cc:359] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:21.425541 10635 raft_consensus.cc:385] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:21.425972 10635 raft_consensus.cc:740] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Initialized, Role: FOLLOWER
I20260709 13:02:21.429000 10635 consensus_queue.cc:260] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:21.438006 10436 raft_consensus.cc:2468] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:21.441975 10632 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: No bootstrap required, opened a new log
I20260709 13:02:21.442677 10632 ts_tablet_manager.cc:1403] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.441s	user 0.016s	sys 0.015s
I20260709 13:02:21.448750 11147 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:21.450580 10554 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:21.452137 11189 raft_consensus.cc:2804] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:21.452766 11189 raft_consensus.cc:697] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:21.454139 11189 consensus_queue.cc:237] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:21.495836 10635 ts_tablet_manager.cc:1434] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211: Time spent starting tablet: real 0.153s	user 0.010s	sys 0.000s
I20260709 13:02:21.506497 10632 raft_consensus.cc:359] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:21.509109 10632 raft_consensus.cc:385] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:21.509626 10632 raft_consensus.cc:740] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:21.526352 10632 consensus_queue.cc:260] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:21.544220 10330 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:21.546453 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:21.547279 10512 raft_consensus.cc:3060] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.558423 11087 raft_consensus.cc:2749] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:21.560635 11086 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.561296 11086 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:21.568110 10512 raft_consensus.cc:2468] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:21.574800 11086 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:21.582041 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:21.582814 10436 raft_consensus.cc:3060] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.592170 10355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:21.593367 10355 raft_consensus.cc:2393] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate b4af86c3867e41659d5499027b08b924 in this term.
W20260709 13:02:21.616627 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 56117.5us
I20260709 13:02:21.620162 10330 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:21.621101 11216 raft_consensus.cc:2804] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:21.621668 11216 raft_consensus.cc:697] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:21.622596 11216 consensus_queue.cc:237] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:21.642413 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:21.643683 10509 raft_consensus.cc:2393] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 1: Already voted for candidate b4af86c3867e41659d5499027b08b924 in this term.
I20260709 13:02:21.646193 10632 ts_tablet_manager.cc:1434] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.203s	user 0.011s	sys 0.003s
I20260709 13:02:21.663117 10436 raft_consensus.cc:2468] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 1.
I20260709 13:02:21.681588 10405 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:21.682582 10854 raft_consensus.cc:2749] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:21.691015 11229 log.cc:927] Time spent T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: Append to log took a long time: real 0.151s	user 0.003s	sys 0.001s
W20260709 13:02:21.701418 11225 log.cc:927] Time spent T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:02:21.713687 10259 catalog_manager.cc:5697] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:21.752164 10330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 45392.8us
I20260709 13:02:21.802502 11215 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.803396 11215 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:21.808125 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:21.814942 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:21.812299 11215 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:21.829931 10330 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:21.834144 11215 raft_consensus.cc:2749] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:21.855026 10361 raft_consensus.cc:3060] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:21.855634 10261 catalog_manager.cc:5697] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.889333 10259 catalog_manager.cc:5697] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.903004 11219 consensus_queue.cc:1048] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:21.953864 11169 consensus_queue.cc:1048] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:22.117396 10963 consensus_queue.cc:1048] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:22.142624 11171 consensus_queue.cc:1048] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:23.648921   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:23.651268 10552 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:02:23.670411 10478 consensus_peers.cc:597] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.676911 10552 consensus_peers.cc:597] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.684589 10478 consensus_peers.cc:597] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.686525 10552 consensus_peers.cc:597] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.687443 10552 consensus_peers.cc:597] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.731096   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:23.732461   431 tablet_replica.cc:333] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.733858   431 raft_consensus.cc:2243] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.734668   431 raft_consensus.cc:2272] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.735321 10552 consensus_peers.cc:597] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.736196 10552 consensus_peers.cc:597] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.737702   431 tablet_replica.cc:333] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.738730   431 raft_consensus.cc:2243] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.739372   431 raft_consensus.cc:2272] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.741874   431 tablet_replica.cc:333] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.742736   431 raft_consensus.cc:2243] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.743376   431 raft_consensus.cc:2272] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.745878   431 tablet_replica.cc:333] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.746654   431 raft_consensus.cc:2243] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.747712   431 raft_consensus.cc:2272] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.749980   431 tablet_replica.cc:333] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.751046   431 raft_consensus.cc:2243] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.751689   431 raft_consensus.cc:2272] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.754670   431 tablet_replica.cc:333] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.755918   431 raft_consensus.cc:2243] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.756656   431 raft_consensus.cc:2272] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.758834 10552 consensus_peers.cc:597] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.759809 10552 consensus_peers.cc:597] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.759821   431 tablet_replica.cc:333] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.760957   431 raft_consensus.cc:2243] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.761929   431 raft_consensus.cc:2272] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.765246   431 tablet_replica.cc:333] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.766299   431 raft_consensus.cc:2243] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.767038   431 raft_consensus.cc:2272] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.770716   431 tablet_replica.cc:333] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.771639   431 raft_consensus.cc:2243] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.772831   431 raft_consensus.cc:2272] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.773816 10403 consensus_peers.cc:597] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.774021 10552 consensus_peers.cc:597] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.775014 10552 consensus_peers.cc:597] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.775978   431 tablet_replica.cc:333] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.776878   431 raft_consensus.cc:2243] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.777447   431 raft_consensus.cc:2272] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.779456 10552 consensus_peers.cc:597] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.780630   431 tablet_replica.cc:333] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.781456   431 raft_consensus.cc:2243] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.782047   431 raft_consensus.cc:2272] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.785584   431 tablet_replica.cc:333] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.786612   431 raft_consensus.cc:2243] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.787318   431 raft_consensus.cc:2272] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.790704   431 tablet_replica.cc:333] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.792078   431 raft_consensus.cc:2243] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.792889   431 raft_consensus.cc:2272] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.796491   431 tablet_replica.cc:333] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.797590   431 raft_consensus.cc:2243] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.798568   431 raft_consensus.cc:2272] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.801679   431 tablet_replica.cc:333] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.802830   431 raft_consensus.cc:2243] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.804177   431 raft_consensus.cc:2272] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.805739 10403 consensus_peers.cc:597] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.807830   431 tablet_replica.cc:333] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: stopping tablet replica
W20260709 13:02:23.808143 10403 consensus_peers.cc:597] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.809023   431 raft_consensus.cc:2243] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.809746   431 raft_consensus.cc:2272] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.813162   431 tablet_replica.cc:333] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.814186   431 raft_consensus.cc:2243] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.814746   431 raft_consensus.cc:2272] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.815099 10403 consensus_peers.cc:597] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.817826   431 tablet_replica.cc:333] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.818744   431 raft_consensus.cc:2243] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.819273   431 raft_consensus.cc:2272] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.822388   431 tablet_replica.cc:333] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.824098   431 raft_consensus.cc:2243] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.824936   431 raft_consensus.cc:2272] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.827970   431 tablet_replica.cc:333] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.828845   431 raft_consensus.cc:2243] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.829486   431 raft_consensus.cc:2272] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.832446   431 tablet_replica.cc:333] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
W20260709 13:02:23.832603 10552 consensus_peers.cc:597] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.833598   431 raft_consensus.cc:2243] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.834336   431 raft_consensus.cc:2272] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.836812   431 tablet_replica.cc:333] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.837743   431 raft_consensus.cc:2243] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.838642   431 raft_consensus.cc:2272] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.842860   431 tablet_replica.cc:333] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.844116   431 raft_consensus.cc:2243] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:02:23.844349 10478 consensus_peers.cc:597] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.844112 10403 consensus_peers.cc:597] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.845803   431 raft_consensus.cc:2272] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.848953   431 tablet_replica.cc:333] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.850133   431 raft_consensus.cc:2243] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.850765   431 raft_consensus.cc:2272] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.853852   431 tablet_replica.cc:333] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.854631   431 raft_consensus.cc:2243] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.855227   431 raft_consensus.cc:2272] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.859040   431 tablet_replica.cc:333] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.859866   431 raft_consensus.cc:2243] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.860510   431 raft_consensus.cc:2272] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.862884   431 tablet_replica.cc:333] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.863636   431 raft_consensus.cc:2243] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.864638   431 raft_consensus.cc:2272] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.867975   431 tablet_replica.cc:333] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.869002   431 raft_consensus.cc:2243] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.869596   431 raft_consensus.cc:2272] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.872116   431 tablet_replica.cc:333] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.872798   431 raft_consensus.cc:2243] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.873857   431 raft_consensus.cc:2272] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.876893   431 tablet_replica.cc:333] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.877727   431 raft_consensus.cc:2243] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.878640   431 raft_consensus.cc:2272] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.881096   431 tablet_replica.cc:333] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.881718   431 raft_consensus.cc:2243] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.882191   431 raft_consensus.cc:2272] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.884630   431 tablet_replica.cc:333] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.885514   431 raft_consensus.cc:2243] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.886113   431 raft_consensus.cc:2272] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.888653   431 tablet_replica.cc:333] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: stopping tablet replica
W20260709 13:02:23.889482 10478 consensus_peers.cc:597] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.889525   431 raft_consensus.cc:2243] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.891219   431 raft_consensus.cc:2272] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.893518 10478 consensus_peers.cc:597] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.895347   431 tablet_replica.cc:333] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.896457   431 raft_consensus.cc:2243] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.897076   431 raft_consensus.cc:2272] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.906071   431 tablet_replica.cc:333] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.907001   431 raft_consensus.cc:2243] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.908275   431 raft_consensus.cc:2272] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.911827   431 tablet_replica.cc:333] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.912817   431 raft_consensus.cc:2243] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.913441   431 raft_consensus.cc:2272] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.917163   431 tablet_replica.cc:333] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.918790   431 raft_consensus.cc:2243] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.919811   431 raft_consensus.cc:2272] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.920070 10478 consensus_peers.cc:597] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.924008   431 tablet_replica.cc:333] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.925032   431 raft_consensus.cc:2243] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.925689   431 raft_consensus.cc:2272] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.928723   431 tablet_replica.cc:333] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.929631   431 raft_consensus.cc:2243] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.930354   431 raft_consensus.cc:2272] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.930555 10478 consensus_peers.cc:597] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.931346 10478 consensus_peers.cc:597] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.933435   431 tablet_replica.cc:333] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.934360   431 raft_consensus.cc:2243] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.935021   431 raft_consensus.cc:2272] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.938867   431 tablet_replica.cc:333] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.939822   431 raft_consensus.cc:2243] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.940797   431 raft_consensus.cc:2272] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.943600 10552 consensus_peers.cc:597] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.944097   431 tablet_replica.cc:333] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.945047   431 raft_consensus.cc:2243] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.946352   431 raft_consensus.cc:2272] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.949520   431 tablet_replica.cc:333] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.950166   431 raft_consensus.cc:2243] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.950769   431 raft_consensus.cc:2272] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.953336   431 tablet_replica.cc:333] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.954273   431 raft_consensus.cc:2243] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.954919   431 raft_consensus.cc:2272] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.957253 10478 consensus_peers.cc:597] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.958168   431 tablet_replica.cc:333] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: stopping tablet replica
I20260709 13:02:23.958969   431 raft_consensus.cc:2243] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.960263   431 raft_consensus.cc:2272] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.997681 10552 consensus_peers.cc:597] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.007166 10552 consensus_peers.cc:597] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.012470 10552 consensus_peers.cc:597] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.015146 10403 consensus_peers.cc:597] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.019909 10478 consensus_peers.cc:597] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.034303 10552 consensus_peers.cc:597] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.042495   431 connection.cc:466] server connection from 127.0.0.1:56318 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56318 (request call id 156) could send its response
W20260709 13:02:24.052438 10478 consensus_peers.cc:597] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.052563 10403 consensus_peers.cc:597] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.061728   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:24.200127   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:24.217116 11256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:24.248342 11257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:24.265489   431 server_base.cc:1061] running on GCE node
W20260709 13:02:24.267185 11259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:24.271389   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:24.271848   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:24.272128   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602144272077 us; error 0 us; skew 500 ppm
I20260709 13:02:24.272876   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:24.276814   431 webserver.cc:533] Webserver started at http://127.0.107.193:35353/ using document root <none> and password file <none>
I20260709 13:02:24.277872   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:24.278128   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:24.289176   431 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:02:24.300954 11265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:24.302201   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:24.303802   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "b4af86c3867e41659d5499027b08b924"
format_stamp: "Formatted at 2026-07-09 13:02:04 on dist-test-slave-fc6v"
I20260709 13:02:24.304359   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:24.331275   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:24.333014   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:24.346904   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:24.371933 11272 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:02:24.722872 11211 raft_consensus.cc:493] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:24.723654 11211 raft_consensus.cc:515] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:24.726507 11211 leader_election.cc:290] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:24.728873 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:24.735193 10552 leader_election.cc:336] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:24.735764 10552 leader_election.cc:304] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:24.736617 11211 raft_consensus.cc:2749] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.787187 11093 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:24.787992 11093 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:24.791700 11093 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:24.793030 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:24.798405 10478 leader_election.cc:336] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:24.799371 10478 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:24.801335 11093 raft_consensus.cc:2749] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.831364   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:02:24.832113   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.477s	user 0.014s	sys 0.007s
I20260709 13:02:24.832521   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:02:24.839038 11272 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:24.855372 11272 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:24.856603 11272 tablet_bootstrap.cc:492] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:24.857519 11272 ts_tablet_manager.cc:1403] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:02:24.860705 11272 raft_consensus.cc:359] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:24.861626 11272 raft_consensus.cc:740] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.862473 11272 consensus_queue.cc:260] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:24.865507 11272 ts_tablet_manager.cc:1434] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:02:24.866463 11272 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:24.882616 11272 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:24.884075 11272 tablet_bootstrap.cc:492] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:24.885000 11272 ts_tablet_manager.cc:1403] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:02:24.888098 11272 raft_consensus.cc:359] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:24.889026 11272 raft_consensus.cc:740] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.890029 11272 consensus_queue.cc:260] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:24.892364 11272 ts_tablet_manager.cc:1434] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:24.893461 11272 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:24.916868 11245 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:24.917637 11245 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:24.918267 11272 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:24.919775 11272 tablet_bootstrap.cc:492] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:24.920701 11272 ts_tablet_manager.cc:1403] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.012s
I20260709 13:02:24.923070 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:24.923878 11272 raft_consensus.cc:359] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:24.924826 11272 raft_consensus.cc:740] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.926029 11245 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:24.925846 11272 consensus_queue.cc:260] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:24.928949 11272 ts_tablet_manager.cc:1434] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:02:24.930106 10403 leader_election.cc:336] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:24.930724 11272 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:24.930792 10403 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:24.930981 11093 raft_consensus.cc:493] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:24.932359 11093 raft_consensus.cc:515] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:24.932631 11245 raft_consensus.cc:2749] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.933423 11255 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:24.936532 11255 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:24.939453 11255 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:24.942028 11093 leader_election.cc:290] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:24.989322 11077 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
W20260709 13:02:24.990401 10552 leader_election.cc:336] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:24.991876 11077 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.012651 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.020802 11263 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.023113 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:25.032483 11093 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.026635 11273 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.024525 10586 raft_consensus.cc:2468] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:25.045925 11280 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.046835 11273 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.047255 11280 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.052964 11131 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.054615 11131 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.055974 11093 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.061187 11273 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:25.027017 10478 leader_election.cc:336] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.062585 11131 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:25.023443 11263 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:25.068281 11077 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:25.072090 11263 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.078161 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.078850 11280 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:25.080542 11272 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.072165 11077 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.084513 10554 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.089099 11077 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.091766 11211 raft_consensus.cc:2749] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:25.079975 10478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 53258.2us
I20260709 13:02:25.085636 11255 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.099679 11255 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:25.084930 11093 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:25.105777 11272 tablet_bootstrap.cc:492] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:25.120376 11272 ts_tablet_manager.cc:1403] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.012s
I20260709 13:02:25.126019 11247 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.127584 11247 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.133145 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.133383 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:25.134193 10437 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
W20260709 13:02:25.134768 10403 leader_election.cc:336] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.138417 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:25.139864 10508 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.134428 10510 raft_consensus.cc:2468] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.138880 11247 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:25.138923 11077 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.147429 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:25.151146 10511 raft_consensus.cc:2468] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
W20260709 13:02:25.149920 10403 leader_election.cc:336] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:25.153620 10552 leader_election.cc:336] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.155088 11255 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:25.159857 10403 leader_election.cc:336] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.166071 11272 raft_consensus.cc:359] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.168673 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:25.169014 11077 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
W20260709 13:02:25.184059 10403 leader_election.cc:336] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.184890 11077 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.183504 11272 raft_consensus.cc:740] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.168815 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:25.174563 10478 leader_election.cc:336] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.188148 10478 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.188329 10511 raft_consensus.cc:2468] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.189141 11093 raft_consensus.cc:2749] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:25.189429 10478 leader_election.cc:336] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:25.190088 10478 leader_election.cc:336] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.191067 11077 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
W20260709 13:02:25.177778 10552 leader_election.cc:336] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.186944 11272 consensus_queue.cc:260] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.195817 10405 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.207248 11077 raft_consensus.cc:2749] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:25.213160 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.196674 10480 leader_election.cc:304] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.218302 11131 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.216346 11077 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.219743 11131 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.219926 11077 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.223012 11131 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.224622 11281 raft_consensus.cc:2804] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.225311 11281 raft_consensus.cc:493] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.225633 11272 ts_tablet_manager.cc:1434] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.004s
I20260709 13:02:25.225837 11281 raft_consensus.cc:3060] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.229414 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:25.230078 11272 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:25.230396 10586 raft_consensus.cc:2468] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.232388 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:25.233517 10584 raft_consensus.cc:2468] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.239122 11282 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.240111 10405 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:25.240141 11282 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.244002 11285 raft_consensus.cc:2804] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.244658 11285 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.244809 11282 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:25.245211 11285 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.252131 10405 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:25.259696 11285 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.264818 11131 raft_consensus.cc:2804] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.267151 11131 raft_consensus.cc:493] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.267685 11131 raft_consensus.cc:3060] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:25.260481 10478 leader_election.cc:336] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:25.270792 10403 leader_election.cc:336] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:25.275307 10403 leader_election.cc:336] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.276134 10405 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
W20260709 13:02:25.276683 10403 leader_election.cc:336] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.277770 11245 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.277312 11077 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.278439 11245 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.278973 11245 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.282344 11281 raft_consensus.cc:515] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:25.292444 10554 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.293561 11255 raft_consensus.cc:2804] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.294045 11255 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.294438 11255 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.294708 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:25.302754 10403 leader_election.cc:336] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:25.303769 10478 leader_election.cc:336] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.304978 11281 leader_election.cc:290] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.291281 11285 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.309134 11245 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.314234 10480 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.316423 11093 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.316952 11093 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.317404 11093 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.302754 11272 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.320014 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:25.320910 10510 raft_consensus.cc:2468] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.312438 10405 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.325376 11285 raft_consensus.cc:2804] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.325898 11285 raft_consensus.cc:493] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.325709 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.326375 11272 tablet_bootstrap.cc:492] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:25.327023 10434 raft_consensus.cc:2468] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 1.
I20260709 13:02:25.327502 11272 ts_tablet_manager.cc:1403] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.013s
I20260709 13:02:25.326475 11285 raft_consensus.cc:3060] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:25.332463 10403 leader_election.cc:336] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.325922 10405 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.345230 11077 raft_consensus.cc:2804] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.344664 11255 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:25.345692 11077 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.346446 11077 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.346716 10586 raft_consensus.cc:2393] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 2: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:25.348826 11093 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.351729 10480 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.352957 11263 raft_consensus.cc:2804] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.353528 11263 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.353981 11263 raft_consensus.cc:3060] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.354374 11280 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.355257 11280 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.359205 11280 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:25.360666 11093 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:25.310894 11131 raft_consensus.cc:515] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.340721 11272 raft_consensus.cc:359] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.363442 11272 raft_consensus.cc:740] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.364847 11131 leader_election.cc:290] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.364662 11272 consensus_queue.cc:260] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.340198 10554 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.343493 11247 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.366883 11247 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.368350 11272 ts_tablet_manager.cc:1434] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:02:25.369959 11272 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:25.370658 11247 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:25.361323 11255 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:25.341061 11245 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:25.373575 11247 raft_consensus.cc:2749] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.387030 11263 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.394495 11263 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:25.402467 10478 leader_election.cc:336] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.405902 11272 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.406919 10405 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.407749 11272 tablet_bootstrap.cc:492] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:25.408653 11272 ts_tablet_manager.cc:1403] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.007s
I20260709 13:02:25.410012 11077 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.413200 11272 raft_consensus.cc:359] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.414137 11272 raft_consensus.cc:740] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
W20260709 13:02:25.414692 10552 leader_election.cc:336] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.415458 11272 consensus_queue.cc:260] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.417896 11077 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:25.419819 11131 raft_consensus.cc:2804] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.431622 11131 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.432153 11131 raft_consensus.cc:3060] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.433532 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:25.434434 10438 raft_consensus.cc:3060] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.435623 11272 ts_tablet_manager.cc:1434] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 13:02:25.437140 11272 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:25.442586 11131 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.420763 11285 raft_consensus.cc:515] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.423004 10480 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.424294 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:25.424153 10507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:25.444306 10434 raft_consensus.cc:2393] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 2: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:25.444357 10507 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.425755 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.447999 10436 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 2.
I20260709 13:02:25.427261 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895e4e5d09f4753aa274460cf68c95d" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:25.448865 10480 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.449452 10583 raft_consensus.cc:3060] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.449879 11263 raft_consensus.cc:2749] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.448098 11285 leader_election.cc:290] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
W20260709 13:02:25.418565 10403 leader_election.cc:336] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.461248 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:25.462350 10510 raft_consensus.cc:2393] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 2: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:25.464505 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:25.465265 10510 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:25.467109 10478 leader_election.cc:336] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.470803 10405 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:25.472512 11131 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:25.472852 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bc1796a9a64f4ba15df6480a21b893" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:25.473542 10512 raft_consensus.cc:3060] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.475204 11131 raft_consensus.cc:2749] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.477362 10438 raft_consensus.cc:2468] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
W20260709 13:02:25.459806 10403 leader_election.cc:336] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.480855 11247 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.481634 11247 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.482192 10582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:25.483060 10582 raft_consensus.cc:2468] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 1.
I20260709 13:02:25.484392 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a30d488569446dbc9a32630b2e3094" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
W20260709 13:02:25.485038 10552 leader_election.cc:336] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.485648 10587 raft_consensus.cc:3060] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.489648 10480 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.491340 11093 raft_consensus.cc:2804] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.491964 11093 raft_consensus.cc:697] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:25.493414 11093 consensus_queue.cc:237] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.489677 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:25.494768 10586 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.496743 10554 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.500079 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:25.500900 10511 raft_consensus.cc:3060] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.504186 11211 raft_consensus.cc:2804] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:25.504848 11211 raft_consensus.cc:493] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.505316 11211 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:25.510828 10403 leader_election.cc:336] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.498983 10510 raft_consensus.cc:2468] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:25.523345 11247 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:25.524814 10552 leader_election.cc:336] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.528257 10586 raft_consensus.cc:2468] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:25.525179 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:25.529572 10434 raft_consensus.cc:2468] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 1.
I20260709 13:02:25.533150 10554 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.536405 10405 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.537500 11288 raft_consensus.cc:2804] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.538048 11288 raft_consensus.cc:697] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:25.539140 11288 consensus_queue.cc:237] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.540642 10511 raft_consensus.cc:2468] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:25.535168 10587 raft_consensus.cc:2468] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
W20260709 13:02:25.549176 10403 leader_election.cc:336] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.550069 10583 raft_consensus.cc:2468] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
W20260709 13:02:25.550246 10403 leader_election.cc:336] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.556943 10480 leader_election.cc:304] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.561869 10512 raft_consensus.cc:2468] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:25.561286 11263 raft_consensus.cc:2804] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.563926 11263 raft_consensus.cc:697] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:25.565374 10405 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.568740 11263 consensus_queue.cc:237] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:25.573269 10507 raft_consensus.cc:2468] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 2.
I20260709 13:02:25.574337 11281 raft_consensus.cc:2749] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.563791 11246 raft_consensus.cc:2804] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.576395 11246 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.576865 11246 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.576567 11211 raft_consensus.cc:515] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.579214 11211 leader_election.cc:290] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:25.591639 10552 leader_election.cc:336] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.594779 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deea6823d2534b959728fc210dd07642" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:25.595896 10434 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:25.628189 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 66773.4us
I20260709 13:02:25.629484 10405 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.629626 10554 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.630383 11131 raft_consensus.cc:2804] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.630805 11131 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:25.631150 11131 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.633993 11285 raft_consensus.cc:2804] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.635221 11285 raft_consensus.cc:697] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:25.647208 11255 raft_consensus.cc:2804] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.636843 11285 consensus_queue.cc:237] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.665961 10405 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.671077 10434 raft_consensus.cc:2468] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 3.
I20260709 13:02:25.670356 11131 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.671784 10405 leader_election.cc:304] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.680765 11246 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.684763 11077 raft_consensus.cc:2804] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.678180 10554 leader_election.cc:304] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.690757 11255 raft_consensus.cc:697] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:25.693325 11211 raft_consensus.cc:2804] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.693964 11211 raft_consensus.cc:697] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:25.696466 11131 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:25.698773 11211 consensus_queue.cc:237] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.672757 11245 raft_consensus.cc:2804] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.707897 11245 raft_consensus.cc:697] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:25.709487 11245 consensus_queue.cc:237] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:25.710356 10403 leader_election.cc:336] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.715420 11272 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.724560 11246 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:25.724363 11255 consensus_queue.cc:237] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:25.730365 11077 raft_consensus.cc:697] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:25.738335 11272 tablet_bootstrap.cc:492] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:25.740146 11272 ts_tablet_manager.cc:1403] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.303s	user 0.039s	sys 0.045s
I20260709 13:02:25.744233 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:25.745167 10434 raft_consensus.cc:2393] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a50bcbfe194a288c6b3333e6556a88 in current term 2: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
W20260709 13:02:25.745891 10552 leader_election.cc:336] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:25.745738 11272 raft_consensus.cc:359] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.749382 11272 raft_consensus.cc:740] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.775102 11272 consensus_queue.cc:260] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.785218 10260 catalog_manager.cc:5697] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.792419 10405 leader_election.cc:304] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.787446 10260 catalog_manager.cc:5697] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.794749 11280 raft_consensus.cc:2804] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.795670 11280 raft_consensus.cc:697] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:25.800786 11280 consensus_queue.cc:237] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:25.798833 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 56042.9us
I20260709 13:02:25.806806 10554 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.807628 11077 consensus_queue.cc:237] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:25.833443 11272 ts_tablet_manager.cc:1434] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.004s
I20260709 13:02:25.838733 11272 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:25.823359 11211 raft_consensus.cc:2749] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.857434 10261 catalog_manager.cc:5697] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.865813 10261 catalog_manager.cc:5697] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 2 to 3, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.871559 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:25.885349 10587 raft_consensus.cc:2393] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 2: Already voted for candidate 40a50bcbfe194a288c6b3333e6556a88 in this term.
I20260709 13:02:25.892467 10405 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:25.898274 11301 raft_consensus.cc:2749] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.912606   431 ts_tablet_manager.cc:600] Registering tablets (31/45 complete)
I20260709 13:02:25.952622 10512 raft_consensus.cc:1275] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.955278 11245 consensus_queue.cc:1048] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:25.971438 11272 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.972836 11272 tablet_bootstrap.cc:492] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:25.973752 11272 ts_tablet_manager.cc:1403] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.011s
I20260709 13:02:25.978602 11272 raft_consensus.cc:359] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.979673 11272 raft_consensus.cc:740] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.980604 11272 consensus_queue.cc:260] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:25.982900 11272 ts_tablet_manager.cc:1434] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:25.984334 11272 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:25.995739 10259 catalog_manager.cc:5697] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.998173 10259 catalog_manager.cc:5697] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.009347 11272 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.010671 11272 tablet_bootstrap.cc:492] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.011482 11272 ts_tablet_manager.cc:1403] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 13:02:26.013357 10587 raft_consensus.cc:1275] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.014894 11272 raft_consensus.cc:359] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.015873 11272 raft_consensus.cc:740] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.016968 11272 consensus_queue.cc:260] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.019796 11272 ts_tablet_manager.cc:1434] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:26.017807 11282 consensus_queue.cc:1048] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:26.020928 11272 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:26.036936 10259 catalog_manager.cc:5697] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:26.038550 10403 consensus_peers.cc:597] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.049757   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:02:26.050336   431 ts_tablet_manager.cc:595] Time spent register tablets: real 1.218s	user 0.367s	sys 0.046s
I20260709 13:02:26.057183 11272 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.059051 11272 tablet_bootstrap.cc:492] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.060830 11272 ts_tablet_manager.cc:1403] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.040s	user 0.033s	sys 0.000s
I20260709 13:02:26.066592 11272 raft_consensus.cc:359] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.068114 11272 raft_consensus.cc:740] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.069422 11272 consensus_queue.cc:260] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:26.081650 10478 consensus_peers.cc:597] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.086079 11272 ts_tablet_manager.cc:1434] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.003s
W20260709 13:02:26.087282 11313 log.cc:927] Time spent T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:02:26.091722 10478 consensus_peers.cc:597] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.088195 11272 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:26.101577 10478 consensus_peers.cc:597] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.039141 10259 catalog_manager.cc:5697] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.105710 10259 catalog_manager.cc:5697] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 1 to 2, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.115123 10438 raft_consensus.cc:1275] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Refusing update from remote peer 40a50bcbfe194a288c6b3333e6556a88: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:26.119997 11211 consensus_queue.cc:1048] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:26.132532 10438 raft_consensus.cc:1275] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:26.111789 10552 consensus_peers.cc:597] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.135234 10552 consensus_peers.cc:597] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.135378 11281 consensus_queue.cc:1048] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:26.155730 10403 consensus_peers.cc:597] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.156852 10585 raft_consensus.cc:1275] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:26.159017 10403 consensus_peers.cc:597] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.160107 11077 consensus_queue.cc:1048] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:26.197412 10478 consensus_peers.cc:597] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.207062 10403 consensus_peers.cc:597] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.211313 11275 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.212332 11275 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:26.218735 10552 consensus_peers.cc:597] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.220695 11275 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:26.231429 10507 raft_consensus.cc:1275] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer 40a50bcbfe194a288c6b3333e6556a88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.231384 10512 raft_consensus.cc:1275] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.235092 11255 consensus_queue.cc:1048] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:26.238878 11245 consensus_queue.cc:1048] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:26.257463 10511 raft_consensus.cc:1275] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.258044 11272 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.265856 11272 tablet_bootstrap.cc:492] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.267021 11272 ts_tablet_manager.cc:1403] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.180s	user 0.033s	sys 0.039s
I20260709 13:02:26.266185 11245 consensus_queue.cc:1048] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:02:26.273332 11327 log.cc:927] Time spent T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:26.304454 11272 raft_consensus.cc:359] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:26.305856 11272 raft_consensus.cc:740] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.315069 11272 consensus_queue.cc:260] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:26.331856 10403 consensus_peers.cc:597] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.344024 11275 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.345095 11275 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.348166 11275 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:26.355079 10403 consensus_peers.cc:597] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.360859 10403 consensus_peers.cc:597] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.358470 10552 consensus_peers.cc:597] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.363265 10552 consensus_peers.cc:597] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.364599 10552 consensus_peers.cc:597] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.367858 11272 ts_tablet_manager.cc:1434] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.002s
W20260709 13:02:26.361874 10403 consensus_peers.cc:597] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.398689 10583 raft_consensus.cc:1275] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.403133 11272 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:26.404744 11077 consensus_queue.cc:1048] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:26.414978 10552 consensus_peers.cc:597] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.415937 10552 consensus_peers.cc:597] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.458168 11275 raft_consensus.cc:493] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.459234 11275 raft_consensus.cc:515] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.462383 11275 leader_election.cc:290] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
W20260709 13:02:26.478897 10478 consensus_peers.cc:597] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.482066 10478 consensus_peers.cc:597] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.505018 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:26.505786 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:26.506546 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:26.506810 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:26.510550 10552 consensus_peers.cc:597] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.511490 10552 consensus_peers.cc:597] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.520109 10552 consensus_peers.cc:597] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.525534 11269 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:26.526855 11275 raft_consensus.cc:2749] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:26.534125 10478 consensus_peers.cc:597] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.517416 10403 consensus_peers.cc:597] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.520915 10552 consensus_peers.cc:597] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.546217 10403 consensus_peers.cc:597] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.561432 10478 consensus_peers.cc:597] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.571134 10508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a9b8a588f84978934f47ceffea9d2a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:26.574975 10552 consensus_peers.cc:597] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.575559 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
W20260709 13:02:26.578969 10403 consensus_peers.cc:597] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.580112 11275 raft_consensus.cc:493] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.580809 11275 raft_consensus.cc:515] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.593385 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:26.599088 11275 leader_election.cc:290] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:26.609346 11269 leader_election.cc:304] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:26.610983 11269 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
I20260709 13:02:26.613126 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b7f2c040940b0898fde87b644800c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:26.620730 11348 raft_consensus.cc:2749] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:26.621681 11348 raft_consensus.cc:2749] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:26.619014 10478 consensus_peers.cc:597] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.622862 10478 consensus_peers.cc:597] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.624333 11269 leader_election.cc:304] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:26.628382 11275 raft_consensus.cc:2749] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:26.630352 10552 consensus_peers.cc:597] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.631811 10403 consensus_peers.cc:597] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.641803 11275 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.642496 11275 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:26.648136 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:26.650599 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:26.653714 11275 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:26.653736 11269 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
W20260709 13:02:26.654759 10478 consensus_peers.cc:597] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.661669 11275 raft_consensus.cc:2749] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:26.686403 11272 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.689693 11272 tablet_bootstrap.cc:492] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.690536 11272 ts_tablet_manager.cc:1403] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.288s	user 0.017s	sys 0.007s
I20260709 13:02:26.696067 11272 raft_consensus.cc:359] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:26.696964 11272 raft_consensus.cc:740] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.697937 11272 consensus_queue.cc:260] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:26.700595 11272 ts_tablet_manager.cc:1434] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:02:26.701640 11272 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:26.738018 11272 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.739799 11272 tablet_bootstrap.cc:492] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.740967 11272 ts_tablet_manager.cc:1403] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.007s
W20260709 13:02:26.741658 10552 consensus_peers.cc:597] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.744990 11272 raft_consensus.cc:359] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.746318 11272 raft_consensus.cc:740] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.747356 11272 consensus_queue.cc:260] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.750464 11272 ts_tablet_manager.cc:1434] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:26.751873 11272 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:26.753365 10552 consensus_peers.cc:597] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:26.771690 10478 consensus_peers.cc:597] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.773916 11272 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.775255 11272 tablet_bootstrap.cc:492] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.776088 11272 ts_tablet_manager.cc:1403] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 13:02:26.779253 11272 raft_consensus.cc:359] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.780169 11272 raft_consensus.cc:740] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.780962 11272 consensus_queue.cc:260] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.784528 11272 ts_tablet_manager.cc:1434] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:26.786069 11272 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:26.789324 10552 consensus_peers.cc:597] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.813759 11272 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.815241 11272 tablet_bootstrap.cc:492] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.816174 11272 ts_tablet_manager.cc:1403] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.003s
I20260709 13:02:26.819207 11272 raft_consensus.cc:359] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.820217 11272 raft_consensus.cc:740] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.821233 11272 consensus_queue.cc:260] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.823900 11272 ts_tablet_manager.cc:1434] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:26.825016 11272 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:26.884418   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41529
I20260709 13:02:26.884590 11402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41529 every 8 connection(s)
I20260709 13:02:26.937155 11275 raft_consensus.cc:493] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.937894 11275 raft_consensus.cc:515] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:26.940821 10478 consensus_peers.cc:597] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:26.941434 11272 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.942610 11272 tablet_bootstrap.cc:492] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.943464 11272 ts_tablet_manager.cc:1403] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.119s	user 0.074s	sys 0.035s
I20260709 13:02:26.943320 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:26.947098 11272 raft_consensus.cc:359] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.947425 11275 leader_election.cc:290] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:26.948161 11272 raft_consensus.cc:740] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.948941 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1787e8259fbe45eca97480c9dacb51ff" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:26.949433 11272 consensus_queue.cc:260] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:26.950857 11269 leader_election.cc:304] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:26.953183 11348 raft_consensus.cc:2749] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:26.953557 11272 ts_tablet_manager.cc:1434] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:02:26.954783 11272 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:26.973702 11374 raft_consensus.cc:3060] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.983413 11272 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:26.984849 11272 tablet_bootstrap.cc:492] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:26.985764 11272 ts_tablet_manager.cc:1403] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:02:26.986719 11406 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46067
I20260709 13:02:26.987277 11406 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:26.988386 11406 heartbeater.cc:507] Master 127.0.107.254:46067 requested a full tablet report, sending...
I20260709 13:02:26.989269 11272 raft_consensus.cc:359] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:26.990193 11272 raft_consensus.cc:740] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.991938 11373 raft_consensus.cc:3060] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.003867 11272 consensus_queue.cc:260] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:27.006699 11272 ts_tablet_manager.cc:1434] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:02:27.008159 11272 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:27.013055 11348 raft_consensus.cc:493] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.013782 11348 raft_consensus.cc:515] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:27.019734 11348 leader_election.cc:290] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:27.022020 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:27.022331 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581df3f2a4a94df5adb7fc58515064fb" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
W20260709 13:02:27.216735 11269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 191327us
I20260709 13:02:27.279103 11348 raft_consensus.cc:493] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.307229 11269 leader_election.cc:304] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:27.312858 11275 raft_consensus.cc:2749] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.306880 11348 raft_consensus.cc:515] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:27.316534 11348 leader_election.cc:290] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:27.321794 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:27.324266 11275 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.324975 11275 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
W20260709 13:02:27.357738 10552 consensus_peers.cc:597] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:27.363061 11346 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.406351 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864793e789784a5dac120669f112203e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:27.421295 11346 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.445205 11373 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.498651 11275 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:27.476672 11418 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.523619 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 96526.7us
I20260709 13:02:27.483515 11269 leader_election.cc:304] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d
W20260709 13:02:27.544301 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 110660us
I20260709 13:02:27.545765 11272 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:27.520078 11418 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.549139 11275 raft_consensus.cc:2749] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.581342 11272 tablet_bootstrap.cc:492] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:27.583256 11272 ts_tablet_manager.cc:1403] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.575s	user 0.048s	sys 0.052s
W20260709 13:02:27.573884 10554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 77129.4us
W20260709 13:02:27.558645 11269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37525, user_credentials={real_user=slave}} blocked reactor thread for 87711.1us
I20260709 13:02:27.605656 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:27.610818 10434 raft_consensus.cc:2393] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 2: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
W20260709 13:02:27.652349 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 51750.3us
I20260709 13:02:27.665143 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:27.666692 10509 raft_consensus.cc:2393] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4af86c3867e41659d5499027b08b924 in current term 2: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:27.651615 11374 raft_consensus.cc:3060] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.668680 11272 raft_consensus.cc:359] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.672276 11272 raft_consensus.cc:740] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.675765 11272 consensus_queue.cc:260] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.679831 11272 ts_tablet_manager.cc:1434] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 13:02:27.680961 11272 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:27.658313 11418 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:27.668617 11438 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.704376 11438 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:27.712572 11438 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:27.736533 11346 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:27.771467 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:27.772852 10436 raft_consensus.cc:2468] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 2.
I20260709 13:02:27.788344 11269 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:27.795575 11427 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:27.800617 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 71693.4us
W20260709 13:02:27.816001 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 161491us
I20260709 13:02:27.829288 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:27.830406 10438 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:27.843216 10480 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:27.847925 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:27.854791 10554 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:27.856305 11263 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.856873 11263 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.857174 11272 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:27.858630 11272 tablet_bootstrap.cc:492] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:27.857239 11263 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.861382 11366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:27.864883 11435 raft_consensus.cc:2804] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.868067 11272 ts_tablet_manager.cc:1403] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.187s	user 0.032s	sys 0.027s
I20260709 13:02:27.876853 11272 raft_consensus.cc:359] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.877801 11272 raft_consensus.cc:740] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.878840 11272 consensus_queue.cc:260] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.879881 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924" is_pre_election: true
I20260709 13:02:27.884480 11272 ts_tablet_manager.cc:1434] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:27.885679 11272 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:27.871143 11435 raft_consensus.cc:493] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.887351 11435 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.889729 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:27.933475 11427 raft_consensus.cc:2749] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.938072 11370 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:27.959024 10403 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:27.960268 11443 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.960734 11443 raft_consensus.cc:493] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.961092 11443 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.962461 11263 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.964121 10509 raft_consensus.cc:2393] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fde7d06ee724b9bb005a69743b50211 in current term 3: Already voted for candidate ed955e6936204882a741c58f33790c5d in this term.
I20260709 13:02:27.966832 11263 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:27.970930 11435 raft_consensus.cc:515] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:27.971326 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:27.972169 11370 raft_consensus.cc:3060] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.979275 11443 raft_consensus.cc:515] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:27.980976 11275 raft_consensus.cc:493] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed955e6936204882a741c58f33790c5d)
I20260709 13:02:27.981699 11275 raft_consensus.cc:515] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:27.982925 11443 leader_election.cc:290] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:27.985540 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:27.986253 10261 ts_manager.cc:194] Re-registered known tserver with Master: b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:27.994035 11275 leader_election.cc:290] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:27.994203 10506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d" is_pre_election: true
I20260709 13:02:27.996556 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6301e11540ca4c42bddb309293400170" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211" is_pre_election: true
I20260709 13:02:27.998557 11269 leader_election.cc:304] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4af86c3867e41659d5499027b08b924; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:27.999711 11435 leader_election.cc:290] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 election: Requested vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:28.000205 10436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:28.000847 10436 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.003856 11275 raft_consensus.cc:2749] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:28.004029 11370 raft_consensus.cc:2468] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 3.
I20260709 13:02:28.005362 10478 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:28.006413 11273 raft_consensus.cc:2804] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.012329 11273 raft_consensus.cc:697] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 3 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:28.013348 11273 consensus_queue.cc:237] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.011286 10436 raft_consensus.cc:2468] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 3.
W20260709 13:02:28.007588 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 72850.2us
I20260709 13:02:28.024081 10438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
W20260709 13:02:28.024914 10552 leader_election.cc:343] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:28.025341 10438 raft_consensus.cc:2393] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed955e6936204882a741c58f33790c5d in current term 3: Already voted for candidate 2fde7d06ee724b9bb005a69743b50211 in this term.
I20260709 13:02:28.033452 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c547c7ecd9274a4fa127dcf61445590a" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4af86c3867e41659d5499027b08b924"
I20260709 13:02:28.034410 10554 leader_election.cc:304] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:28.035763 11441 raft_consensus.cc:2804] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.036393 10506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a8d77410064b2298c3e33291b7ea3b" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:28.036406 11441 raft_consensus.cc:697] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 3 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:28.038437 11441 consensus_queue.cc:237] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.046276 10405 leader_election.cc:304] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:28.056967 11437 raft_consensus.cc:2749] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:28.087807 10552 leader_election.cc:343] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:28.120926 10259 catalog_manager.cc:5697] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 1 to 3, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.147879 11272 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.147604 10260 catalog_manager.cc:5697] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 1 to 3, leader changed from b4af86c3867e41659d5499027b08b924 (127.0.107.193) to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.149667 11272 tablet_bootstrap.cc:492] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.153788 11272 ts_tablet_manager.cc:1403] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.268s	user 0.027s	sys 0.005s
I20260709 13:02:28.159415 10261 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47042
I20260709 13:02:28.160202 11272 raft_consensus.cc:359] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.161154 11272 raft_consensus.cc:740] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.166723 11406 heartbeater.cc:499] Master 127.0.107.254:46067 was elected leader, sending a full tablet report...
I20260709 13:02:28.161952 11272 consensus_queue.cc:260] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.179335 11272 ts_tablet_manager.cc:1434] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 13:02:28.181430 11272 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.199769 11272 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.201010 11272 tablet_bootstrap.cc:492] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.201906 11272 ts_tablet_manager.cc:1403] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:02:28.205065 11272 raft_consensus.cc:359] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.205865 11272 raft_consensus.cc:740] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.207214 11272 consensus_queue.cc:260] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.209748 11272 ts_tablet_manager.cc:1434] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:02:28.210768 11272 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.212795 11370 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.240152 11272 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.241838 11272 tablet_bootstrap.cc:492] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.243254 11272 ts_tablet_manager.cc:1403] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.003s
I20260709 13:02:28.246531 11272 raft_consensus.cc:359] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.247387 11272 raft_consensus.cc:740] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.248225 11272 consensus_queue.cc:260] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.250094 11272 ts_tablet_manager.cc:1434] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:28.251073 11272 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.271378 11272 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.272666 11272 tablet_bootstrap.cc:492] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.273502 11272 ts_tablet_manager.cc:1403] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:02:28.276561 11272 raft_consensus.cc:359] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.277405 11272 raft_consensus.cc:740] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.278224 11272 consensus_queue.cc:260] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.280683 11272 ts_tablet_manager.cc:1434] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:28.287873 11272 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.306250 11272 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.307386 11272 tablet_bootstrap.cc:492] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.308267 11272 ts_tablet_manager.cc:1403] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:02:28.310967 11272 raft_consensus.cc:359] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.311643 11272 raft_consensus.cc:740] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.312431 11272 consensus_queue.cc:260] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.314797 11272 ts_tablet_manager.cc:1434] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:28.315877 11272 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.334247 11272 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.335285 11272 tablet_bootstrap.cc:492] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.335981 11272 ts_tablet_manager.cc:1403] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:02:28.338143 11272 raft_consensus.cc:359] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.338721 11272 raft_consensus.cc:740] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.339365 11272 consensus_queue.cc:260] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.341342 11272 ts_tablet_manager.cc:1434] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:28.342316 11272 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.362672 11272 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.363876 11272 tablet_bootstrap.cc:492] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.364791 11272 ts_tablet_manager.cc:1403] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:02:28.367686 11272 raft_consensus.cc:359] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.368305 11272 raft_consensus.cc:740] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.368983 11272 consensus_queue.cc:260] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.371435 11272 ts_tablet_manager.cc:1434] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:28.372854 11272 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.381366 11374 raft_consensus.cc:3060] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.495242 11272 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.498934 11272 tablet_bootstrap.cc:492] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.500140 11272 ts_tablet_manager.cc:1403] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.128s	user 0.057s	sys 0.045s
I20260709 13:02:28.504791 11272 raft_consensus.cc:359] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.506006 11272 raft_consensus.cc:740] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.506916 11272 consensus_queue.cc:260] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.510062 11272 ts_tablet_manager.cc:1434] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:02:28.511133 11272 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:28.513792 10552 consensus_peers.cc:597] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.514873 11366 raft_consensus.cc:1275] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:28.521595 11346 consensus_queue.cc:1048] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.556567 11272 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.557827 11272 tablet_bootstrap.cc:492] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.558669 11272 ts_tablet_manager.cc:1403] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.004s
I20260709 13:02:28.563076 11272 raft_consensus.cc:359] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.564026 11272 raft_consensus.cc:740] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.564904 11272 consensus_queue.cc:260] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.568077 11272 ts_tablet_manager.cc:1434] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:02:28.570004 11272 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.598109 10438 raft_consensus.cc:1275] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:28.601382 11346 consensus_queue.cc:1048] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.618155 10438 raft_consensus.cc:1275] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Refusing update from remote peer 40a50bcbfe194a288c6b3333e6556a88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:28.636183 11441 consensus_queue.cc:1048] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.642251 11272 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.643942 11272 tablet_bootstrap.cc:492] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.645284 11272 ts_tablet_manager.cc:1403] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.006s
I20260709 13:02:28.648725 11272 raft_consensus.cc:359] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.651439 11272 raft_consensus.cc:740] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.652473 11272 consensus_queue.cc:260] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.654964 11272 ts_tablet_manager.cc:1434] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:28.656500 11272 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.685055 11272 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.692746 11272 tablet_bootstrap.cc:492] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
W20260709 13:02:28.693876 10552 consensus_peers.cc:597] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:28.693907 11272 ts_tablet_manager.cc:1403] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.009s
I20260709 13:02:28.702644 11272 raft_consensus.cc:359] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.703503 11272 raft_consensus.cc:740] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.704373 11272 consensus_queue.cc:260] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.722805 11272 ts_tablet_manager.cc:1434] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 13:02:28.724152 11272 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
W20260709 13:02:28.748940 10478 consensus_peers.cc:597] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:28.761171 11272 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.762454 11272 tablet_bootstrap.cc:492] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.763307 11272 ts_tablet_manager.cc:1403] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.008s
I20260709 13:02:28.767338 11272 raft_consensus.cc:359] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.768234 11272 raft_consensus.cc:740] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.769419 11272 consensus_queue.cc:260] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:28.771600 10478 consensus_peers.cc:597] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:28.772810 11272 ts_tablet_manager.cc:1434] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:02:28.775331 11272 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.788522 11374 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.801653 11272 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.804064 11272 tablet_bootstrap.cc:492] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.806875 11272 ts_tablet_manager.cc:1403] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.007s
I20260709 13:02:28.810525 11272 raft_consensus.cc:359] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.811412 11272 raft_consensus.cc:740] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.812325 11272 consensus_queue.cc:260] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.817835 11272 ts_tablet_manager.cc:1434] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:02:28.819051 11272 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.839305 11272 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.840351 11272 tablet_bootstrap.cc:492] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.841208 11272 ts_tablet_manager.cc:1403] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:02:28.844455 11272 raft_consensus.cc:359] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.845166 11272 raft_consensus.cc:740] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.845957 11272 consensus_queue.cc:260] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:28.848160 11272 ts_tablet_manager.cc:1434] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:02:28.850090 11272 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.871913 11272 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.873155 11272 tablet_bootstrap.cc:492] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.874300 11272 ts_tablet_manager.cc:1403] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.016s
I20260709 13:02:28.877628 11272 raft_consensus.cc:359] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.878312 11272 raft_consensus.cc:740] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.879024 11272 consensus_queue.cc:260] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.881515 11272 ts_tablet_manager.cc:1434] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:28.884230 11272 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.902199 11272 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.903317 11272 tablet_bootstrap.cc:492] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.904469 11272 ts_tablet_manager.cc:1403] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:02:28.907684 11272 raft_consensus.cc:359] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.908521 11272 raft_consensus.cc:740] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.909288 11272 consensus_queue.cc:260] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.911806 11272 ts_tablet_manager.cc:1434] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:28.913136 11272 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.934309 11272 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.935412 11272 tablet_bootstrap.cc:492] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.936208 11272 ts_tablet_manager.cc:1403] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:02:28.939684 11272 raft_consensus.cc:359] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.940486 11272 raft_consensus.cc:740] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.941371 11272 consensus_queue.cc:260] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:28.943959 11272 ts_tablet_manager.cc:1434] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:28.945358 11272 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:28.975175 11272 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:28.976514 11272 tablet_bootstrap.cc:492] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:28.977442 11272 ts_tablet_manager.cc:1403] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.008s
I20260709 13:02:28.980593 11272 raft_consensus.cc:359] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.981547 11272 raft_consensus.cc:740] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.982326 11272 consensus_queue.cc:260] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:28.984750 11272 ts_tablet_manager.cc:1434] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:28.985754 11272 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.153079 11374 raft_consensus.cc:3060] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:02:29.217967 10552 consensus_peers.cc:597] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:29.219650 10552 consensus_peers.cc:597] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:29.227069 11272 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.229302 11272 tablet_bootstrap.cc:492] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.230214 11272 ts_tablet_manager.cc:1403] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.245s	user 0.095s	sys 0.131s
I20260709 13:02:29.233568 11272 raft_consensus.cc:359] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:29.241003 11272 raft_consensus.cc:740] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.241868 11272 consensus_queue.cc:260] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:29.244819 11272 ts_tablet_manager.cc:1434] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:02:29.246085 11272 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.267866 11272 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.269060 11272 tablet_bootstrap.cc:492] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.269852 11272 ts_tablet_manager.cc:1403] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:02:29.274051 11272 raft_consensus.cc:359] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.275415 11272 raft_consensus.cc:740] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.276371 11272 consensus_queue.cc:260] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:29.279311 10403 consensus_peers.cc:597] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:29.279753 11272 ts_tablet_manager.cc:1434] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:29.280782 11272 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.306799 11272 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.308019 11272 tablet_bootstrap.cc:492] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.308712 11272 ts_tablet_manager.cc:1403] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.003s
I20260709 13:02:29.311056 11272 raft_consensus.cc:359] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:29.311873 11272 raft_consensus.cc:740] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.313249 11272 consensus_queue.cc:260] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:29.315922 11272 ts_tablet_manager.cc:1434] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:02:29.316861 11272 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.345466 11272 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.347064 11272 tablet_bootstrap.cc:492] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.348042 11272 ts_tablet_manager.cc:1403] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.004s
I20260709 13:02:29.350622 11272 raft_consensus.cc:359] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.351598 11272 raft_consensus.cc:740] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.352413 11272 consensus_queue.cc:260] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.354660 11272 ts_tablet_manager.cc:1434] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:29.357220 11272 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.381572 11272 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.382584 11272 tablet_bootstrap.cc:492] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.383245 11272 ts_tablet_manager.cc:1403] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:02:29.385566 11272 raft_consensus.cc:359] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.386161 11272 raft_consensus.cc:740] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.387250 11272 consensus_queue.cc:260] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.389567 11272 ts_tablet_manager.cc:1434] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:29.390589 11272 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.412606 11272 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.413879 11272 tablet_bootstrap.cc:492] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.414793 11272 ts_tablet_manager.cc:1403] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:02:29.417728 11272 raft_consensus.cc:359] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.418365 11272 raft_consensus.cc:740] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.419481 11272 consensus_queue.cc:260] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.421684 11272 ts_tablet_manager.cc:1434] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:29.422645 11272 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.443996 11272 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.445953 11272 tablet_bootstrap.cc:492] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.447784 11272 ts_tablet_manager.cc:1403] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:02:29.450927 11272 raft_consensus.cc:359] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:29.451805 11272 raft_consensus.cc:740] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.452613 11272 consensus_queue.cc:260] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:29.455192 11272 ts_tablet_manager.cc:1434] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:29.458710 11272 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Bootstrap starting.
I20260709 13:02:29.492411 11272 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.493363 11272 tablet_bootstrap.cc:492] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Bootstrap complete.
I20260709 13:02:29.494318 11272 ts_tablet_manager.cc:1403] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.000s
I20260709 13:02:29.497805 11272 raft_consensus.cc:359] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.498517 11272 raft_consensus.cc:740] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4af86c3867e41659d5499027b08b924, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.499413 11272 consensus_queue.cc:260] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:29.501569 11272 ts_tablet_manager.cc:1434] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:29.547627 11375 raft_consensus.cc:3060] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.645629 11374 raft_consensus.cc:3060] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:35.199196 10405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41119, user_credentials={real_user=slave}} blocked reactor thread for 43955.2us
W20260709 13:02:35.292821 10480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36833, user_credentials={real_user=slave}} blocked reactor thread for 71599.1us
I20260709 13:02:36.967773   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:37.058032 10438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:37.059142 10438 raft_consensus.cc:606] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:37.062579 10438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "ed955e6936204882a741c58f33790c5d"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:37.063186 10438 raft_consensus.cc:606] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Received request to transfer leadership to TS ed955e6936204882a741c58f33790c5d
I20260709 13:02:37.066025 10438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:37.066777 10438 raft_consensus.cc:606] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:37.083614 10584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:37.084407 10584 raft_consensus.cc:606] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:37.100293 10513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1"
dest_uuid: "ed955e6936204882a741c58f33790c5d"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:34586
I20260709 13:02:37.100909 10513 raft_consensus.cc:606] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:37.104413 10438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:37.105007 10438 raft_consensus.cc:606] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:37.108237 10438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "ed955e6936204882a741c58f33790c5d"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:37.109324 10438 raft_consensus.cc:606] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Received request to transfer leadership to TS ed955e6936204882a741c58f33790c5d
I20260709 13:02:37.111698   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:02:37.112697 11519 raft_consensus.cc:993] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.113417 11519 raft_consensus.cc:1081] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.114087   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:37.115753 11375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39774
I20260709 13:02:37.116540 11375 raft_consensus.cc:493] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.116947 11375 raft_consensus.cc:3060] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.126912 11375 raft_consensus.cc:515] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:37.129463 11375 leader_election.cc:290] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:37.130774 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:37.131058 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee36daa5d94e96826a33c6f6bc52b9" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:37.131718 10434 raft_consensus.cc:3055] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.132232 10434 raft_consensus.cc:740] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:37.133164 10434 consensus_queue.cc:260] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:37.134727 10434 raft_consensus.cc:3060] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.131768 10513 raft_consensus.cc:3060] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.146404 10434 raft_consensus.cc:2468] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.148165 10513 raft_consensus.cc:2468] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.148329 11269 leader_election.cc:304] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:37.150763 11522 raft_consensus.cc:2804] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.152220 11522 raft_consensus.cc:697] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:37.153205 11522 consensus_queue.cc:237] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:37.175705 10260 catalog_manager.cc:5697] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.190802 11511 raft_consensus.cc:993] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower ed955e6936204882a741c58f33790c5d to start an election
I20260709 13:02:37.191637 11519 raft_consensus.cc:1081] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Signalling peer ed955e6936204882a741c58f33790c5d to start an election
I20260709 13:02:37.193678 10513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4"
dest_uuid: "ed955e6936204882a741c58f33790c5d"
 from {username='slave'} at 127.0.0.1:42136
I20260709 13:02:37.194671 10513 raft_consensus.cc:493] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.195222 10513 raft_consensus.cc:3060] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.209667 10513 raft_consensus.cc:515] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:37.212417 10513 leader_election.cc:290] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:37.214473 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:37.215235 10434 raft_consensus.cc:3055] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.215595 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56f8cd4bda3c413c90061d4f6488adc4" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:37.215646 10434 raft_consensus.cc:740] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:37.216303 10584 raft_consensus.cc:3060] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.217096 10434 consensus_queue.cc:260] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:37.218600 10434 raft_consensus.cc:3060] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.229421 10584 raft_consensus.cc:2468] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:37.231626 11511 raft_consensus.cc:993] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower ed955e6936204882a741c58f33790c5d to start an election
I20260709 13:02:37.232357 11519 raft_consensus.cc:1081] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Signalling peer ed955e6936204882a741c58f33790c5d to start an election
I20260709 13:02:37.232833 10434 raft_consensus.cc:2468] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:37.233202 10480 leader_election.cc:304] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:37.235847 11273 raft_consensus.cc:2804] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.236382 11273 raft_consensus.cc:697] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:37.237290 10509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e"
dest_uuid: "ed955e6936204882a741c58f33790c5d"
 from {username='slave'} at 127.0.0.1:42136
I20260709 13:02:37.237325 11273 consensus_queue.cc:237] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:37.238138 10509 raft_consensus.cc:493] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.238600 10509 raft_consensus.cc:3060] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.249358 10509 raft_consensus.cc:515] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:37.252866 10509 leader_election.cc:290] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:37.256656 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:37.257262 10584 raft_consensus.cc:3060] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.264936 10260 catalog_manager.cc:5697] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 1 to 2, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.278306 11515 raft_consensus.cc:993] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.279371 11516 raft_consensus.cc:1081] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.281411 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e1c88c6584293ac3dcd5eafc80a3e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:37.282164 11375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:02:37.287955 11375 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.288381 11375 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.289367 10584 raft_consensus.cc:2468] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:37.291807 10480 leader_election.cc:304] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:37.299988 11273 raft_consensus.cc:2804] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.301013 11273 raft_consensus.cc:697] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:37.308532 10434 raft_consensus.cc:3055] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.309092 10434 raft_consensus.cc:740] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:37.310228 10434 consensus_queue.cc:260] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:37.312764 11375 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:37.315461 10434 raft_consensus.cc:3060] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.310077 11273 consensus_queue.cc:237] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:37.317462 11375 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:37.317898 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:37.318878 10584 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.317544 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:37.319805 10513 raft_consensus.cc:3055] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.320152 10513 raft_consensus.cc:740] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:37.320946 10513 consensus_queue.cc:260] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:37.328632 11511 raft_consensus.cc:993] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.329295 11511 raft_consensus.cc:1081] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.322548 10513 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.330175 10584 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.332974 11269 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:37.334131 11522 raft_consensus.cc:2804] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.334964 11522 raft_consensus.cc:697] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:37.337455 11522 consensus_queue.cc:237] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:37.334319 11375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39774
I20260709 13:02:37.345597 11375 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.346076 11375 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.350431 10513 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.351588 10434 raft_consensus.cc:2468] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:37.365825 10260 catalog_manager.cc:5697] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from ed955e6936204882a741c58f33790c5d (127.0.107.195) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.375099 11375 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:37.378243 11375 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:37.380432 10261 catalog_manager.cc:5697] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d reported cstate change: term changed from 1 to 2, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to ed955e6936204882a741c58f33790c5d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ed955e6936204882a741c58f33790c5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.381321 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:37.382848 10584 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.383008 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866a2c25fa64b6987b969ccaf9ce324" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:37.383810 10434 raft_consensus.cc:3055] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:37.384148 10434 raft_consensus.cc:740] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:37.385257 10434 consensus_queue.cc:260] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:37.386631 10434 raft_consensus.cc:3060] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.397886 10434 raft_consensus.cc:2468] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 3.
I20260709 13:02:37.398464 10584 raft_consensus.cc:2468] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 3.
I20260709 13:02:37.400799 11269 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:37.404721 11522 raft_consensus.cc:2804] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.406149 11522 raft_consensus.cc:697] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 3 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:37.407436 11522 consensus_queue.cc:237] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:37.466696 11535 raft_consensus.cc:993] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.485677 11511 raft_consensus.cc:1081] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.521042 11373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39774
I20260709 13:02:37.522363 11373 raft_consensus.cc:493] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.524319 11373 raft_consensus.cc:3060] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.564144 11373 raft_consensus.cc:515] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:37.580751 11373 leader_election.cc:290] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:37.597348 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:37.598210 10434 raft_consensus.cc:3055] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.598548 10434 raft_consensus.cc:740] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:37.601667 10434 consensus_queue.cc:260] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:37.650835 10434 raft_consensus.cc:3060] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.664438 10436 raft_consensus.cc:1275] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.678339 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db3331e816f4156a1d2bca954a3254a" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:37.679255 10509 raft_consensus.cc:3060] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.681282 10513 raft_consensus.cc:1275] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.671177 10261 catalog_manager.cc:5697] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 2 to 3, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.682605 11516 consensus_queue.cc:1048] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:02:37.720417 10434 raft_consensus.cc:2468] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.722343 11269 leader_election.cc:304] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:37.723678 11522 raft_consensus.cc:2804] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.724345 11522 raft_consensus.cc:697] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:37.726400 10509 raft_consensus.cc:2468] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.725631 11522 consensus_queue.cc:237] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:37.732856 11523 consensus_queue.cc:1048] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:02:37.737643 10552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41529, user_credentials={real_user=slave}} blocked reactor thread for 82272.8us
I20260709 13:02:37.753427 10261 catalog_manager.cc:5697] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.766999 10437 raft_consensus.cc:1275] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.772886 11545 raft_consensus.cc:993] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.773538 11545 raft_consensus.cc:1081] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:37.775658 11522 consensus_queue.cc:1048] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.777316 11374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:37.778041 11374 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.782423 10586 raft_consensus.cc:1275] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.778409 11374 raft_consensus.cc:3060] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.788520 11515 consensus_queue.cc:1048] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.799405 10509 raft_consensus.cc:1275] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.815168 10584 raft_consensus.cc:1275] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.820148 11515 consensus_queue.cc:1048] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.822391 11556 consensus_queue.cc:1048] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.843789 10586 raft_consensus.cc:1275] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.846374 11556 consensus_queue.cc:1048] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.873793 10436 raft_consensus.cc:1275] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer ed955e6936204882a741c58f33790c5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.877421 11532 consensus_queue.cc:1048] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.937779 11374 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:37.941186 11374 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:37.941737 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:37.947715 10509 raft_consensus.cc:3060] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.944875 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:37.954288 10586 raft_consensus.cc:3055] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.954712 10586 raft_consensus.cc:740] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:37.955695 10586 consensus_queue.cc:260] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:37.956987 10586 raft_consensus.cc:3060] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.966349 10509 raft_consensus.cc:2468] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.967911 11269 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:37.968353 10586 raft_consensus.cc:2468] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:37.969055 11523 raft_consensus.cc:2804] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.969602 11523 raft_consensus.cc:697] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:37.970649 11523 consensus_queue.cc:237] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:37.992336 10584 raft_consensus.cc:1275] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:37.994445 11523 consensus_queue.cc:1048] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.000959 10260 catalog_manager.cc:5697] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.009488 10436 raft_consensus.cc:1275] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:38.016569 11523 consensus_queue.cc:1048] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.115770   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.169734   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.221367 10434 raft_consensus.cc:1275] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.227290 11523 consensus_queue.cc:1048] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:38.246986 10509 raft_consensus.cc:1275] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.260165 11556 consensus_queue.cc:1048] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:38.261715 10509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "293161fc043b46428f5b233850c4215e"
dest_uuid: "ed955e6936204882a741c58f33790c5d"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:34586
I20260709 13:02:38.262480 10509 raft_consensus.cc:606] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:38.271976 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:38.272719 10586 raft_consensus.cc:606] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:38.276465 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:38.277138 10586 raft_consensus.cc:606] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:38.280169 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1f28de88884353873810960e00d35c"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:38.280874 10586 raft_consensus.cc:606] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:38.284129 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:38.285023 10586 raft_consensus.cc:606] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:38.289212 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:38.290041 10586 raft_consensus.cc:606] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:38.291851   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:38.293753   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:38.403743 10586 raft_consensus.cc:1275] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.405373 11522 consensus_queue.cc:1048] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:38.419409 10510 raft_consensus.cc:1275] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.421881 11568 consensus_queue.cc:1048] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:38.453835 11545 raft_consensus.cc:993] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.454532 11546 raft_consensus.cc:1081] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.456624 11374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:38.457350 11374 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.457785 11374 raft_consensus.cc:3060] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.464948 11374 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.467005 11374 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:38.468430 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:38.468688 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a096302f134e2bbd562968364f8d15" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:38.469178 10586 raft_consensus.cc:3055] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.469339 10434 raft_consensus.cc:3060] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.469519 10586 raft_consensus.cc:740] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:38.470577 10586 consensus_queue.cc:260] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.472198 10586 raft_consensus.cc:3060] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.478587 10434 raft_consensus.cc:2468] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.482632 11269 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:38.483771 11568 raft_consensus.cc:2804] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.484323 11568 raft_consensus.cc:697] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:38.485332 11568 consensus_queue.cc:237] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.505956 10586 raft_consensus.cc:2468] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.510677 10260 catalog_manager.cc:5697] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.513825 11545 raft_consensus.cc:993] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.514820 11543 raft_consensus.cc:1081] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.516870 11374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:38.517445 11374 raft_consensus.cc:493] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.517762 11374 raft_consensus.cc:3060] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.525612 11374 raft_consensus.cc:515] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.529528 11374 leader_election.cc:290] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:38.529788 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:38.530735 10586 raft_consensus.cc:3055] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.531234 10586 raft_consensus.cc:740] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:38.531682 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1de15bd8c8446e5a4a1ead763021708" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:38.532431 10434 raft_consensus.cc:3060] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.532401 10586 consensus_queue.cc:260] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.533963 10586 raft_consensus.cc:3060] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.542954 10434 raft_consensus.cc:2468] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.543289 10586 raft_consensus.cc:2468] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.544637 11269 leader_election.cc:304] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:38.546132 11568 raft_consensus.cc:2804] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.546732 11568 raft_consensus.cc:697] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:38.547956 11568 consensus_queue.cc:237] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.571291 10260 catalog_manager.cc:5697] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.634943 11543 raft_consensus.cc:993] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.635592 11543 raft_consensus.cc:1081] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.637871 11370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:38.638609 11370 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.638988 11370 raft_consensus.cc:3060] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.647403 11370 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.650705 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:38.650938 11370 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:38.651800 10510 raft_consensus.cc:3060] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.652074 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:38.652987 10588 raft_consensus.cc:3055] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.653620 10588 raft_consensus.cc:740] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:38.654544 10588 consensus_queue.cc:260] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.655818 10588 raft_consensus.cc:3060] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.660038 10510 raft_consensus.cc:2468] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.662084 11269 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:38.663174 11568 raft_consensus.cc:2804] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.664042 11568 raft_consensus.cc:697] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:38.664921 10588 raft_consensus.cc:2468] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.665241 11568 consensus_queue.cc:237] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.681808 10260 catalog_manager.cc:5697] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.683183 11546 raft_consensus.cc:993] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.683938 11543 raft_consensus.cc:1081] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.685786 11370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1f28de88884353873810960e00d35c"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:38.686457 11370 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.686872 11370 raft_consensus.cc:3060] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.697604 11370 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.701046 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:38.701870 10588 raft_consensus.cc:3055] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.702275 10588 raft_consensus.cc:740] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:38.702342 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f28de88884353873810960e00d35c" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:38.703438 10434 raft_consensus.cc:3060] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.703542 11370 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:38.703418 10588 consensus_queue.cc:260] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.708295 10588 raft_consensus.cc:3060] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.715728 10434 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.717154 11269 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:38.718320 11568 raft_consensus.cc:2804] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.719075 11568 raft_consensus.cc:697] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:38.719617 10588 raft_consensus.cc:2468] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.720125 11568 consensus_queue.cc:237] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:38.732944 10260 catalog_manager.cc:5697] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.779496 11516 raft_consensus.cc:993] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.780192 11516 raft_consensus.cc:1081] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.782262 11370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "293161fc043b46428f5b233850c4215e"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:02:38.782514 11545 raft_consensus.cc:993] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.782931 11370 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.783202 11543 raft_consensus.cc:1081] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:38.783366 11370 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.785441 11374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:38.786062 11374 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.786432 11374 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:38.792655 11370 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.796114 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:38.796254 11374 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.796823 10509 raft_consensus.cc:3055] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.797189 10509 raft_consensus.cc:740] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:38.797974 10509 consensus_queue.cc:260] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.799259 10509 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.800267 10510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:38.801007 10510 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:38.803936 11374 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:38.805650 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:38.806370 10586 raft_consensus.cc:3055] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:38.806689 10586 raft_consensus.cc:740] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:38.807513 10586 consensus_queue.cc:260] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.808979 10586 raft_consensus.cc:3060] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:38.819391 10586 raft_consensus.cc:2468] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 3.
I20260709 13:02:38.820827 11269 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:38.822830 11568 raft_consensus.cc:2804] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:38.823441 11568 raft_consensus.cc:697] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 3 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:38.824203 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:38.825114 10584 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.825744 11568 consensus_queue.cc:237] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.826834 11370 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:38.828281 10509 raft_consensus.cc:2468] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.825627 10510 raft_consensus.cc:2468] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 3.
I20260709 13:02:38.829653 11269 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:38.830778 11523 raft_consensus.cc:2804] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.831326 11523 raft_consensus.cc:697] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:38.832382 11523 consensus_queue.cc:237] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:38.847827 10584 raft_consensus.cc:2468] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:38.861537 10260 catalog_manager.cc:5697] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 2 to 3, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.893469 10260 catalog_manager.cc:5697] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from ed955e6936204882a741c58f33790c5d (127.0.107.195) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.049093 10584 raft_consensus.cc:1275] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.050655 11568 consensus_queue.cc:1048] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.063073 10588 raft_consensus.cc:1275] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.071619 11568 consensus_queue.cc:1048] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.073704 10509 raft_consensus.cc:1275] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.082430 11568 consensus_queue.cc:1048] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.088646 10434 raft_consensus.cc:1275] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.094658 11556 consensus_queue.cc:1048] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:02:39.150231 10584 raft_consensus.cc:1275] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.154239 11556 consensus_queue.cc:1048] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.172698 10436 raft_consensus.cc:1275] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.175591 11556 consensus_queue.cc:1048] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.217191 10509 raft_consensus.cc:1275] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:39.219281 11556 consensus_queue.cc:1048] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:39.246877 10584 raft_consensus.cc:1275] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:39.257894 10434 raft_consensus.cc:1275] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.262985 11556 consensus_queue.cc:1048] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:39.269330 11568 consensus_queue.cc:1048] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.294852   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.300616 10584 raft_consensus.cc:1275] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.308022 11568 consensus_queue.cc:1048] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.348542 10584 raft_consensus.cc:1275] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.359804 11568 consensus_queue.cc:1048] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:39.409444 10509 raft_consensus.cc:1275] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.412213 11523 consensus_queue.cc:1048] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.430202   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.486033 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "2fde7d06ee724b9bb005a69743b50211"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:39.486703 10586 raft_consensus.cc:606] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:39.490034 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:39.490641 10586 raft_consensus.cc:606] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:39.493781 10513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2"
dest_uuid: "ed955e6936204882a741c58f33790c5d"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:34586
I20260709 13:02:39.494421 10513 raft_consensus.cc:606] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:39.496299   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:39.497805   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:39.667332 11543 raft_consensus.cc:993] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower 2fde7d06ee724b9bb005a69743b50211 to start an election
I20260709 13:02:39.668232 11545 raft_consensus.cc:1081] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer 2fde7d06ee724b9bb005a69743b50211 to start an election
I20260709 13:02:39.672596 10436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
 from {username='slave'} at 127.0.0.1:35952
I20260709 13:02:39.673851 10436 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.674364 10436 raft_consensus.cc:3060] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.680991 10436 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:39.683794 10436 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:39.684612 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:39.684945 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0a40341f84bbc9d3356b9cf50f1fc" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:39.685359 10513 raft_consensus.cc:3060] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.685614 10586 raft_consensus.cc:3055] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.685992 10586 raft_consensus.cc:740] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:39.686681 10586 consensus_queue.cc:260] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:39.687845 10586 raft_consensus.cc:3060] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.694494 10586 raft_consensus.cc:2468] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:39.694494 10513 raft_consensus.cc:2468] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 2.
I20260709 13:02:39.696187 10405 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, 40a50bcbfe194a288c6b3333e6556a88; no voters: 
I20260709 13:02:39.697813 11542 raft_consensus.cc:2804] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.699622 11542 raft_consensus.cc:697] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:39.700803 11542 consensus_queue.cc:237] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:39.715735 11516 raft_consensus.cc:993] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:39.716677 11532 raft_consensus.cc:1081] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:39.719260 11370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:02:39.719991 11370 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.720355 11370 raft_consensus.cc:3060] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.721266 10259 catalog_manager.cc:5697] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.732172 11370 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:39.735492 11370 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:39.738513 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:39.739246 10588 raft_consensus.cc:3060] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.747146 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:39.748060 10513 raft_consensus.cc:3055] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.748399 10513 raft_consensus.cc:740] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:39.749178 10513 consensus_queue.cc:260] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:39.750453 10513 raft_consensus.cc:3060] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.751747 10588 raft_consensus.cc:2468] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:39.753232 11269 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:39.754495 11523 raft_consensus.cc:2804] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.755335 11523 raft_consensus.cc:697] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:39.757232 11523 consensus_queue.cc:237] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:39.763317 10513 raft_consensus.cc:2468] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:39.776899 10259 catalog_manager.cc:5697] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from ed955e6936204882a741c58f33790c5d (127.0.107.195) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.904913 11546 raft_consensus.cc:993] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:39.905582 11546 raft_consensus.cc:1081] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:39.908342 11374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:02:39.909097 11374 raft_consensus.cc:493] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.909511 11374 raft_consensus.cc:3060] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.926281 11374 raft_consensus.cc:515] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:39.930437 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:39.931332 10584 raft_consensus.cc:3055] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.931785 10584 raft_consensus.cc:740] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:39.931975 11374 leader_election.cc:290] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:39.933780 10437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89b77affa074e7a82bc912e20e383b0" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:39.933532 10584 consensus_queue.cc:260] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:39.934401 10437 raft_consensus.cc:3060] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.935122 10584 raft_consensus.cc:3060] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.945531 10437 raft_consensus.cc:2468] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:39.945297 10584 raft_consensus.cc:2468] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 2.
I20260709 13:02:39.947163 11269 leader_election.cc:304] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924; no voters: 
I20260709 13:02:39.948119 11523 raft_consensus.cc:2804] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.948683 11523 raft_consensus.cc:697] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:39.949622 11523 consensus_queue.cc:237] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:39.962044 10259 catalog_manager.cc:5697] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 1 to 2, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.188340 10509 raft_consensus.cc:1275] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.190003 11523 consensus_queue.cc:1048] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.202365 10584 raft_consensus.cc:1275] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.204391 11556 consensus_queue.cc:1048] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.264950 10584 raft_consensus.cc:1275] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.266731 11544 consensus_queue.cc:1048] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.272248 10513 raft_consensus.cc:1275] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.274472 11544 consensus_queue.cc:1048] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.498790   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:40.556913   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:40.559365 10437 raft_consensus.cc:1275] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.561793 11523 consensus_queue.cc:1048] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:40.573385 10586 raft_consensus.cc:1275] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.575301 11523 consensus_queue.cc:1048] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.632323 10437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "40a50bcbfe194a288c6b3333e6556a88"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:40.633468 10437 raft_consensus.cc:606] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Received request to transfer leadership to TS 40a50bcbfe194a288c6b3333e6556a88
I20260709 13:02:40.635268   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:40.637436   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:40.672158 11613 raft_consensus.cc:993] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower 40a50bcbfe194a288c6b3333e6556a88 to start an election
I20260709 13:02:40.672979 11542 raft_consensus.cc:1081] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Signalling peer 40a50bcbfe194a288c6b3333e6556a88 to start an election
I20260709 13:02:40.674750 10586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
 from {username='slave'} at 127.0.0.1:33138
I20260709 13:02:40.675347 10586 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.675827 10586 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.684257 10586 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:40.686936 10586 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:40.688257 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:40.688621 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "40a50bcbfe194a288c6b3333e6556a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:40.689112 10509 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.689299 10434 raft_consensus.cc:3055] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.689705 10434 raft_consensus.cc:740] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:40.690541 10434 consensus_queue.cc:260] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:40.692603 10434 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.697290 10509 raft_consensus.cc:2468] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 2.
I20260709 13:02:40.698997 10554 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:40.700084 11545 raft_consensus.cc:2804] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.700662 11545 raft_consensus.cc:697] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Becoming Leader. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:40.701695 11545 consensus_queue.cc:237] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:40.705868 10434 raft_consensus.cc:2468] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a50bcbfe194a288c6b3333e6556a88 in term 2.
I20260709 13:02:40.732177 10259 catalog_manager.cc:5697] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 reported cstate change: term changed from 1 to 2, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "40a50bcbfe194a288c6b3333e6556a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.168987 10509 raft_consensus.cc:1275] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Refusing update from remote peer 40a50bcbfe194a288c6b3333e6556a88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.170691 11616 consensus_queue.cc:1048] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.187748 10437 raft_consensus.cc:1275] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Refusing update from remote peer 40a50bcbfe194a288c6b3333e6556a88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.189791 11616 consensus_queue.cc:1048] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.638681   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.702155   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.750453 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55"
dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
mode: GRACEFUL
new_leader_uuid: "2fde7d06ee724b9bb005a69743b50211"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:02:41.751077 10586 raft_consensus.cc:606] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Received request to transfer leadership to TS 2fde7d06ee724b9bb005a69743b50211
I20260709 13:02:41.752538   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:41.754333   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:42.224253 11545 raft_consensus.cc:993] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: : Instructing follower 2fde7d06ee724b9bb005a69743b50211 to start an election
I20260709 13:02:42.224850 11543 raft_consensus.cc:1081] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Signalling peer 2fde7d06ee724b9bb005a69743b50211 to start an election
I20260709 13:02:42.226781 10434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
 from {username='slave'} at 127.0.0.1:35952
I20260709 13:02:42.227310 10434 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:42.227675 10434 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.235476 10434 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:42.238677 10434 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 election: Requested vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525)
I20260709 13:02:42.239365 10509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:42.240171 10509 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.243981 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e71410999946be9e5e39330a0b5d55" candidate_uuid: "2fde7d06ee724b9bb005a69743b50211" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:42.245077 10584 raft_consensus.cc:3055] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:42.245483 10584 raft_consensus.cc:740] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a50bcbfe194a288c6b3333e6556a88, State: Running, Role: LEADER
I20260709 13:02:42.247037 10584 consensus_queue.cc:260] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:42.248510 10584 raft_consensus.cc:3060] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.249581 10509 raft_consensus.cc:2468] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 3.
I20260709 13:02:42.250605 10513 raft_consensus.cc:1240] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Rejecting Update request from peer 40a50bcbfe194a288c6b3333e6556a88 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:42.254825 10405 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:42.255970 11542 raft_consensus.cc:2804] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.256597 11542 raft_consensus.cc:697] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 3 LEADER]: Becoming Leader. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:42.257700 11542 consensus_queue.cc:237] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:42.281261 10584 raft_consensus.cc:2468] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fde7d06ee724b9bb005a69743b50211 in term 3.
I20260709 13:02:42.281422 10259 catalog_manager.cc:5697] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 reported cstate change: term changed from 2 to 3, leader changed from 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196) to 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "2fde7d06ee724b9bb005a69743b50211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.652550 10584 raft_consensus.cc:1275] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:42.654263 11613 consensus_queue.cc:1048] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:42.684230 10509 raft_consensus.cc:1275] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Refusing update from remote peer 2fde7d06ee724b9bb005a69743b50211: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:42.687743 11613 consensus_queue.cc:1048] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:42.755719   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:42.821732   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:42.875404 10434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d"
dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
mode: GRACEFUL
new_leader_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:33588
I20260709 13:02:42.876312 10434 raft_consensus.cc:606] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Received request to transfer leadership to TS b4af86c3867e41659d5499027b08b924
I20260709 13:02:42.878031   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:42.880453   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:43.248725 11642 raft_consensus.cc:993] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: : Instructing follower b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:43.249368 11542 raft_consensus.cc:1081] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Signalling peer b4af86c3867e41659d5499027b08b924 to start an election
I20260709 13:02:43.251256 11374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d"
dest_uuid: "b4af86c3867e41659d5499027b08b924"
 from {username='slave'} at 127.0.0.1:39774
I20260709 13:02:43.252066 11374 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.252526 11374 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.261415 11374 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:43.265360 11374 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 election: Requested vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:43.265882 10513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed955e6936204882a741c58f33790c5d"
I20260709 13:02:43.266649 10513 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.276116 10513 raft_consensus.cc:2468] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 3.
I20260709 13:02:43.277788 11269 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d; no voters: 
I20260709 13:02:43.279122 11594 raft_consensus.cc:2804] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:43.280009 11594 raft_consensus.cc:697] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 3 LEADER]: Becoming Leader. State: Replica: b4af86c3867e41659d5499027b08b924, State: Running, Role: LEADER
I20260709 13:02:43.282236 11594 consensus_queue.cc:237] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:43.279032 10434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b9587e02da4951a1c992d06ee8006d" candidate_uuid: "b4af86c3867e41659d5499027b08b924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fde7d06ee724b9bb005a69743b50211"
I20260709 13:02:43.287153 10434 raft_consensus.cc:3055] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:43.287585 10434 raft_consensus.cc:740] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fde7d06ee724b9bb005a69743b50211, State: Running, Role: LEADER
I20260709 13:02:43.291989 10434 consensus_queue.cc:260] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:43.293795 10434 raft_consensus.cc:3060] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.310714 10262 catalog_manager.cc:5697] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 reported cstate change: term changed from 2 to 3, leader changed from 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194) to b4af86c3867e41659d5499027b08b924 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b4af86c3867e41659d5499027b08b924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.310899 10434 raft_consensus.cc:2468] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4af86c3867e41659d5499027b08b924 in term 3.
I20260709 13:02:43.780827 10509 raft_consensus.cc:1275] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:43.782943 11627 consensus_queue.cc:1048] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:43.795877 10437 raft_consensus.cc:1275] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Refusing update from remote peer b4af86c3867e41659d5499027b08b924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:43.797786 11643 consensus_queue.cc:1048] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:43.881619   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:43.928196   431 tablet_server.cc:179] TabletServer@127.0.107.193:41529 shutting down...
W20260709 13:02:43.953917 10478 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 260 similar messages]
W20260709 13:02:43.964049 10478 consensus_peers.cc:597] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.977176 10552 consensus_peers.cc:597] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.989861   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:43.991401 10403 consensus_peers.cc:597] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.991988   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:43.993340   431 raft_consensus.cc:2243] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.994035   431 raft_consensus.cc:2272] T 118b0cf2ac56453abf589a611a7d9c7d P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.997903   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:43.999024   431 raft_consensus.cc:2243] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:43.999572 10552 consensus_peers.cc:597] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.999720   431 raft_consensus.cc:2272] T 381f75d00c3144139bbb5c22358f074c P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.004052   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.005054   431 raft_consensus.cc:2243] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.005649   431 raft_consensus.cc:2272] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.008159   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.008847   431 raft_consensus.cc:2243] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.009737   431 raft_consensus.cc:2272] T b2456423bc7e4fd4988ce285a04ee8a1 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.012343   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.013056   431 raft_consensus.cc:2243] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.014204   431 raft_consensus.cc:2272] T 9a6aa222767c4a49a4e9bf41a65e1c30 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.017283   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.017952   431 raft_consensus.cc:2243] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.019121   431 raft_consensus.cc:2272] T ae1f28de88884353873810960e00d35c P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.022522   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.023443   431 raft_consensus.cc:2243] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.024187   431 raft_consensus.cc:2272] T 3f5fd742ea894da9b9667696dc71cf12 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.027824   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.028946   431 raft_consensus.cc:2243] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.029742   431 raft_consensus.cc:2272] T 9895e4e5d09f4753aa274460cf68c95d P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.033425   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.034487   431 raft_consensus.cc:2243] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.035789   431 raft_consensus.cc:2272] T 631a548ad91f4394897a0ef36cea3bdf P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.037109 10478 consensus_peers.cc:597] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.039234   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.040506   431 raft_consensus.cc:2243] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.041204   431 raft_consensus.cc:2272] T 1787e8259fbe45eca97480c9dacb51ff P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.045418   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.046514   431 raft_consensus.cc:2243] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.047814   431 raft_consensus.cc:2272] T 4db3331e816f4156a1d2bca954a3254a P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.051424 10552 consensus_peers.cc:597] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.051875   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:44.052735 10478 consensus_peers.cc:597] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.053421   431 raft_consensus.cc:2243] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.054173   431 raft_consensus.cc:2272] T 99a9b8a588f84978934f47ceffea9d2a P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.057837   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.058789   431 raft_consensus.cc:2243] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:02:44.059221 10478 consensus_peers.cc:597] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.060158   431 raft_consensus.cc:2272] T 50b9587e02da4951a1c992d06ee8006d P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.064155   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.065227   431 raft_consensus.cc:2243] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.066284   431 raft_consensus.cc:2272] T dcee36daa5d94e96826a33c6f6bc52b9 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.069401   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.070199   431 raft_consensus.cc:2243] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.070765   431 raft_consensus.cc:2272] T c8a410e026f642eb97377be90f0dc9ab P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.073362   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.074282   431 raft_consensus.cc:2243] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.074980   431 raft_consensus.cc:2272] T 83813c5ebc124df1a2eac0d37f2e6393 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.079808   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:44.081699 10552 consensus_peers.cc:597] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.081741   431 raft_consensus.cc:2243] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.082775   431 raft_consensus.cc:2272] T 4b4ae9839c944dbaa83cf17b5a5d5170 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.086496   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.087321   431 raft_consensus.cc:2243] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.088014   431 raft_consensus.cc:2272] T 0ce1ab0a022b49e09aa7b7a686bff66b P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.092151   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.093163   431 raft_consensus.cc:2243] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.093930   431 raft_consensus.cc:2272] T 9420094312cb4ae390240a2dafe35479 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.097000   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.098047   431 raft_consensus.cc:2243] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.098703   431 raft_consensus.cc:2272] T c547c7ecd9274a4fa127dcf61445590a P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.101218 10403 consensus_peers.cc:597] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.102126   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.103176   431 raft_consensus.cc:2243] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.103989   431 raft_consensus.cc:2272] T 864793e789784a5dac120669f112203e P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.107513   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.108572   431 raft_consensus.cc:2243] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:44.108768 10552 consensus_peers.cc:597] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.109818   431 raft_consensus.cc:2272] T c1de15bd8c8446e5a4a1ead763021708 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.112885   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.113831   431 raft_consensus.cc:2243] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.114396   431 raft_consensus.cc:2272] T 02a30d488569446dbc9a32630b2e3094 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.117318   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.118280   431 raft_consensus.cc:2243] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.119253   431 raft_consensus.cc:2272] T deea6823d2534b959728fc210dd07642 P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.120389 10478 consensus_peers.cc:597] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.123760   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.125101   431 raft_consensus.cc:2243] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.126120   431 raft_consensus.cc:2272] T 37a9031573e34c528ad0e50e5bde3015 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.129458   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.130471   431 raft_consensus.cc:2243] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.131084   431 raft_consensus.cc:2272] T 0dc89042adb84e11abc2a012b5c30358 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.134747   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.135594   431 raft_consensus.cc:2243] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.136170   431 raft_consensus.cc:2272] T ed55aa25a52d4bfe80269832e6be5f47 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.138700   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.139503   431 raft_consensus.cc:2243] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.140210   431 raft_consensus.cc:2272] T 6301e11540ca4c42bddb309293400170 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.143916   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.145026   431 raft_consensus.cc:2243] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.146345   431 raft_consensus.cc:2272] T d9a096302f134e2bbd562968364f8d15 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.150761   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:44.151001 10552 consensus_peers.cc:597] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.151867   431 raft_consensus.cc:2243] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:44.153067 10403 consensus_peers.cc:597] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.153707   431 raft_consensus.cc:2272] T 293161fc043b46428f5b233850c4215e P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.157403   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.158423   431 raft_consensus.cc:2243] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.159107   431 raft_consensus.cc:2272] T 36a8d77410064b2298c3e33291b7ea3b P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.162758   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.163870   431 raft_consensus.cc:2243] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.165103   431 raft_consensus.cc:2272] T e0d3e1641b72401f95b94e0484eb0aa2 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.167359 10478 consensus_peers.cc:597] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.168282 10478 consensus_peers.cc:597] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.168681   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:44.169188 10478 consensus_peers.cc:597] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.169713   431 raft_consensus.cc:2243] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.170601   431 raft_consensus.cc:2272] T 0a946d8672ce4315b453f1d418d5f197 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.170845 10552 consensus_peers.cc:597] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.173545   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.174533   431 raft_consensus.cc:2243] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.175146   431 raft_consensus.cc:2272] T 581df3f2a4a94df5adb7fc58515064fb P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.178521   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.179533   431 raft_consensus.cc:2243] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.180429   431 raft_consensus.cc:2272] T 0dfbdc170b3548d0bf43c26db2aa84d0 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.183784 10403 consensus_peers.cc:597] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.184655   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.185595   431 raft_consensus.cc:2243] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.186333   431 raft_consensus.cc:2272] T 6ed66d8d97d2426a851e3fcccde152e5 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.189863   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.190650   431 raft_consensus.cc:2243] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.191408   431 raft_consensus.cc:2272] T 011d181df5e24eca9a3124fa9442fe94 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.195235   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.196395   431 raft_consensus.cc:2243] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.197395   431 raft_consensus.cc:2272] T ade59aed1b7f49f2ae404b4f1f714521 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.200716   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.201452   431 raft_consensus.cc:2243] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.202405   431 raft_consensus.cc:2272] T c89b77affa074e7a82bc912e20e383b0 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.205190   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.205945   431 raft_consensus.cc:2243] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.206632   431 raft_consensus.cc:2272] T 55bc1796a9a64f4ba15df6480a21b893 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.210355   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.211359   431 raft_consensus.cc:2243] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.212141   431 raft_consensus.cc:2272] T 72a5e078776b4a799080a281d489ff87 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.215094   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.215874   431 raft_consensus.cc:2243] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.216756   431 raft_consensus.cc:2272] T d8efb10cd18e427c897514fa94979888 P b4af86c3867e41659d5499027b08b924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.219596   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.220256   431 raft_consensus.cc:2243] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.220791   431 raft_consensus.cc:2272] T 132b7f2c040940b0898fde87b644800c P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.223456   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.224145   431 raft_consensus.cc:2243] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.225232   431 raft_consensus.cc:2272] T 6866a2c25fa64b6987b969ccaf9ce324 P b4af86c3867e41659d5499027b08b924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.228082   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:44.228727   431 raft_consensus.cc:2243] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.229636   431 raft_consensus.cc:2272] T 87f93f10ffda421f83d5b217d03a8288 P b4af86c3867e41659d5499027b08b924 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.269649 10552 consensus_peers.cc:597] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.286708 10403 consensus_peers.cc:597] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.316987 10552 consensus_peers.cc:597] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.327229 10478 consensus_peers.cc:597] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.331419 10478 consensus_peers.cc:597] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.334087   431 tablet_server.cc:196] TabletServer@127.0.107.193:41529 shutdown complete.
W20260709 13:02:44.375509 10403 consensus_peers.cc:597] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.396898 10552 consensus_peers.cc:597] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.400985 10552 consensus_peers.cc:597] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.406656 10478 consensus_peers.cc:597] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.427630 10403 consensus_peers.cc:597] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.455681 10403 consensus_peers.cc:597] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.468564   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:44.480963 10552 consensus_peers.cc:597] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Couldn't send request to peer b4af86c3867e41659d5499027b08b924. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.487234 10554 consensus_peers.cc:597] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.498967 10480 consensus_peers.cc:597] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.503038 10554 consensus_peers.cc:597] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.533142 10554 consensus_peers.cc:597] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.587217 10480 consensus_peers.cc:597] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.612352   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:44.613657   431 tablet_replica.cc:333] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.614701   431 raft_consensus.cc:2243] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.615445   431 raft_consensus.cc:2272] T d9a096302f134e2bbd562968364f8d15 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.617671 10480 consensus_peers.cc:597] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.618343   431 tablet_replica.cc:333] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.619176   431 raft_consensus.cc:2243] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.620160   431 raft_consensus.cc:2272] T c2b0a40341f84bbc9d3356b9cf50f1fc P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.623176   431 tablet_replica.cc:333] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.624222   431 raft_consensus.cc:2243] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.625663   431 raft_consensus.cc:2272] T 32ab34f9dee040f1a9711e01915f2048 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.628952   431 tablet_replica.cc:333] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.629875   431 raft_consensus.cc:2243] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.631178   431 raft_consensus.cc:2272] T 1eb87559b16a496fba5bb8b6fb3248a5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.634577   431 tablet_replica.cc:333] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.635700   431 raft_consensus.cc:2243] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.636389   431 raft_consensus.cc:2272] T 6ed66d8d97d2426a851e3fcccde152e5 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.639794   431 tablet_replica.cc:333] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.640717   431 raft_consensus.cc:2243] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.641772   431 raft_consensus.cc:2272] T 011d181df5e24eca9a3124fa9442fe94 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.645531   431 tablet_replica.cc:333] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.646539   431 raft_consensus.cc:2243] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.647176   431 raft_consensus.cc:2272] T ade59aed1b7f49f2ae404b4f1f714521 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.650849   431 tablet_replica.cc:333] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.652217   431 raft_consensus.cc:2243] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.653062   431 raft_consensus.cc:2272] T dcee36daa5d94e96826a33c6f6bc52b9 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.656358   431 tablet_replica.cc:333] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.657326   431 raft_consensus.cc:2243] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.657976   431 raft_consensus.cc:2272] T 50b9587e02da4951a1c992d06ee8006d P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.664233   431 tablet_replica.cc:333] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
W20260709 13:02:44.664260 10554 consensus_peers.cc:597] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.665709   431 raft_consensus.cc:2243] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.667073   431 raft_consensus.cc:2272] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.670583   431 tablet_replica.cc:333] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.671597   431 raft_consensus.cc:2243] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.672271   431 raft_consensus.cc:2272] T ae1f28de88884353873810960e00d35c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.675567   431 tablet_replica.cc:333] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.676440   431 raft_consensus.cc:2243] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.677663   431 raft_consensus.cc:2272] T 0dc89042adb84e11abc2a012b5c30358 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.680464   431 tablet_replica.cc:333] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.681370   431 raft_consensus.cc:2243] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.682354   431 raft_consensus.cc:2272] T 02a30d488569446dbc9a32630b2e3094 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.685423   431 tablet_replica.cc:333] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.686197   431 raft_consensus.cc:2243] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.686774   431 raft_consensus.cc:2272] T 8888b8a7dea849eeb0d1a87c9a347e9c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.689854   431 tablet_replica.cc:333] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.690618   431 raft_consensus.cc:2243] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.691262   431 raft_consensus.cc:2272] T deea6823d2534b959728fc210dd07642 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.693660   431 tablet_replica.cc:333] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.694393   431 raft_consensus.cc:2243] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.695009   431 raft_consensus.cc:2272] T bd989738e393402cbf22e78c22cde23d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.698395   431 tablet_replica.cc:333] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.699347   431 raft_consensus.cc:2243] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.700022   431 raft_consensus.cc:2272] T c8a410e026f642eb97377be90f0dc9ab P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.700455 10480 consensus_peers.cc:597] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.703603   431 tablet_replica.cc:333] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.704704   431 raft_consensus.cc:2243] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.705776   431 raft_consensus.cc:2272] T 83813c5ebc124df1a2eac0d37f2e6393 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.708829   431 tablet_replica.cc:333] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.709568   431 raft_consensus.cc:2243] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.710681   431 raft_consensus.cc:2272] T 9420094312cb4ae390240a2dafe35479 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.714057   431 tablet_replica.cc:333] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.715054   431 raft_consensus.cc:2243] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.716326   431 raft_consensus.cc:2272] T 57e71410999946be9e5e39330a0b5d55 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.717451 10554 consensus_peers.cc:597] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.719087   431 tablet_replica.cc:333] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.720189   431 raft_consensus.cc:2243] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.721527   431 raft_consensus.cc:2272] T c37a3271e472433d9feb62b8343643e7 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.722972 10554 consensus_peers.cc:597] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.724794   431 tablet_replica.cc:333] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.725719   431 raft_consensus.cc:2243] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.726354   431 raft_consensus.cc:2272] T 6866a2c25fa64b6987b969ccaf9ce324 P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.729501   431 tablet_replica.cc:333] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
W20260709 13:02:44.730387 10480 consensus_peers.cc:597] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.730470   431 raft_consensus.cc:2243] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.731375   431 raft_consensus.cc:2272] T 118b0cf2ac56453abf589a611a7d9c7d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.734390   431 tablet_replica.cc:333] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.735092   431 raft_consensus.cc:2243] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.735836   431 raft_consensus.cc:2272] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.738828   431 tablet_replica.cc:333] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.739894   431 raft_consensus.cc:2243] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.741402   431 raft_consensus.cc:2272] T 55bc1796a9a64f4ba15df6480a21b893 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.745355   431 tablet_replica.cc:333] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.746333   431 raft_consensus.cc:2243] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.747045   431 raft_consensus.cc:2272] T c89b77affa074e7a82bc912e20e383b0 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.750157   431 tablet_replica.cc:333] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.751178   431 raft_consensus.cc:2243] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.751870   431 raft_consensus.cc:2272] T 1787e8259fbe45eca97480c9dacb51ff P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.754256   431 tablet_replica.cc:333] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.755005   431 raft_consensus.cc:2243] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.755635   431 raft_consensus.cc:2272] T 674a2e3712f54be4898228175becf617 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.758507   431 tablet_replica.cc:333] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.759362   431 raft_consensus.cc:2243] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.759987   431 raft_consensus.cc:2272] T 4db3331e816f4156a1d2bca954a3254a P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.762573   431 tablet_replica.cc:333] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.763392   431 raft_consensus.cc:2243] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.764073   431 raft_consensus.cc:2272] T 381f75d00c3144139bbb5c22358f074c P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.767743   431 tablet_replica.cc:333] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.768652   431 raft_consensus.cc:2243] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.770035   431 raft_consensus.cc:2272] T d50fb1dd837e4c39b8f6f5fa40e3002d P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.773198   431 tablet_replica.cc:333] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.774080   431 raft_consensus.cc:2243] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.774645   431 raft_consensus.cc:2272] T ed55aa25a52d4bfe80269832e6be5f47 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.775391 10554 consensus_peers.cc:597] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.777628   431 tablet_replica.cc:333] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.778398   431 raft_consensus.cc:2243] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.779211   431 raft_consensus.cc:2272] T 6301e11540ca4c42bddb309293400170 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.782004   431 tablet_replica.cc:333] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.782806   431 raft_consensus.cc:2243] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.783291   431 raft_consensus.cc:2272] T e35e1c88c6584293ac3dcd5eafc80a3e P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.785723   431 tablet_replica.cc:333] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.786476   431 raft_consensus.cc:2243] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.787017   431 raft_consensus.cc:2272] T 36a8d77410064b2298c3e33291b7ea3b P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.789472   431 tablet_replica.cc:333] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.790160   431 raft_consensus.cc:2243] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.791348   431 raft_consensus.cc:2272] T 9860e256ccdf41ad8f40aee782e8dac8 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.794647   431 tablet_replica.cc:333] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.795465   431 raft_consensus.cc:2243] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:44.795676 10480 consensus_peers.cc:597] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.796180   431 raft_consensus.cc:2272] T f4eaf8c0162a428796c30899aa6e302a P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.799463   431 tablet_replica.cc:333] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.800294   431 raft_consensus.cc:2243] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.800951   431 raft_consensus.cc:2272] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.802448 10480 consensus_peers.cc:597] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.804107   431 tablet_replica.cc:333] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.804790   431 raft_consensus.cc:2243] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.805315   431 raft_consensus.cc:2272] T 581df3f2a4a94df5adb7fc58515064fb P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.807847   431 tablet_replica.cc:333] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.808413   431 raft_consensus.cc:2243] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.808877   431 raft_consensus.cc:2272] T c1de15bd8c8446e5a4a1ead763021708 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.811230   431 tablet_replica.cc:333] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.811933   431 raft_consensus.cc:2243] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.812548   431 raft_consensus.cc:2272] T c547c7ecd9274a4fa127dcf61445590a P 2fde7d06ee724b9bb005a69743b50211 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.815862   431 tablet_replica.cc:333] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.816687   431 raft_consensus.cc:2243] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.817209   431 raft_consensus.cc:2272] T 56f8cd4bda3c413c90061d4f6488adc4 P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.817636 10554 consensus_peers.cc:597] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.820307   431 tablet_replica.cc:333] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.821239   431 raft_consensus.cc:2243] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.822582   431 raft_consensus.cc:2272] T c7974ab2c9b84e089e68b0dbd4927373 P 2fde7d06ee724b9bb005a69743b50211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.825879   431 tablet_replica.cc:333] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211: stopping tablet replica
I20260709 13:02:44.826639   431 raft_consensus.cc:2243] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.827754   431 raft_consensus.cc:2272] T 132b7f2c040940b0898fde87b644800c P 2fde7d06ee724b9bb005a69743b50211 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.836047 10480 consensus_peers.cc:597] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.850319 10554 consensus_peers.cc:597] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.854053 10480 consensus_peers.cc:597] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.903193 10402 connection.cc:466] server connection from 127.0.0.1:35952 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35952 (request call id 860) could send its response
I20260709 13:02:44.933575   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:44.946972 10554 consensus_peers.cc:597] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.960414 10480 consensus_peers.cc:597] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.023167 10480 consensus_peers.cc:597] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d -> Peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Couldn't send request to peer 2fde7d06ee724b9bb005a69743b50211. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.048382   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:45.082052 11666 raft_consensus.cc:493] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.082989 11666 raft_consensus.cc:515] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:45.087391 11666 leader_election.cc:290] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:45.104203 10554 leader_election.cc:336] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
W20260709 13:02:45.112553 10552 leader_election.cc:336] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.113241 10552 leader_election.cc:304] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.114269 11666 raft_consensus.cc:2749] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.179831   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:45.182212 11668 raft_consensus.cc:493] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.184818 11668 raft_consensus.cc:515] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:45.196168 11667 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.201717 11634 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.203199 11634 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.206821 11668 leader_election.cc:290] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.197414 11667 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.211474 11634 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:45.214407 10552 leader_election.cc:336] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.210434 11667 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.217062   431 tablet_replica.cc:333] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.221856   431 raft_consensus.cc:2243] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.228008 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f93f10ffda421f83d5b217d03a8288" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:45.228749 10478 leader_election.cc:336] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.232193   431 raft_consensus.cc:2272] T 9895e4e5d09f4753aa274460cf68c95d P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.236778 10552 leader_election.cc:336] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.239681   431 tablet_replica.cc:333] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.243973   431 raft_consensus.cc:2243] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:45.248974 10554 consensus_peers.cc:597] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.250054 10554 leader_election.cc:336] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.250597 10554 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.252003 11666 raft_consensus.cc:2749] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.252992 10480 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
W20260709 13:02:45.255502 10554 leader_election.cc:336] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.255970 11664 raft_consensus.cc:2749] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.256289 10554 leader_election.cc:304] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.257424 11666 raft_consensus.cc:2749] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:45.272421 10554 consensus_peers.cc:597] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.277004 11621 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.283641   431 raft_consensus.cc:2272] T 55bc1796a9a64f4ba15df6480a21b893 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.278146 11621 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.293433 11621 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.295704 11634 raft_consensus.cc:493] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.296803   431 tablet_replica.cc:333] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.296821 11634 raft_consensus.cc:515] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:45.299834 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d3e1641b72401f95b94e0484eb0aa2" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:45.300318   431 raft_consensus.cc:2243] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.301492 11634 leader_election.cc:290] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.301687   431 raft_consensus.cc:2272] T 32ab34f9dee040f1a9711e01915f2048 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.303081 10478 leader_election.cc:336] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.307641 11543 raft_consensus.cc:493] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
W20260709 13:02:45.308916 10478 leader_election.cc:336] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.308660 11543 raft_consensus.cc:515] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:45.307924   431 tablet_replica.cc:333] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.311767 10480 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.312122   431 raft_consensus.cc:2243] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.312806 11621 raft_consensus.cc:2749] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.315081   431 raft_consensus.cc:2272] T 0a946d8672ce4315b453f1d418d5f197 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.318127 10552 leader_election.cc:336] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.319720 11621 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.320815   431 tablet_replica.cc:333] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.320778 11621 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.323220   431 raft_consensus.cc:2243] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.324581   431 raft_consensus.cc:2272] T 1eb87559b16a496fba5bb8b6fb3248a5 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.325263 11621 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:45.327610 10554 leader_election.cc:336] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.328375 10554 leader_election.cc:304] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.330057   431 tablet_replica.cc:333] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.330010 11674 raft_consensus.cc:2749] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.331564 11621 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.332048   431 raft_consensus.cc:2243] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.332556 11621 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.333241 11674 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.334307 11674 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:45.319129 10480 leader_election.cc:336] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.336083 11543 leader_election.cc:290] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.337590 11674 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.335610   431 raft_consensus.cc:2272] T 0ce1ab0a022b49e09aa7b7a686bff66b P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.344266 10478 leader_election.cc:336] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.345978 11621 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:45.347863 10552 leader_election.cc:336] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.335595 10480 leader_election.cc:304] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.352494   431 tablet_replica.cc:333] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.352852 11621 raft_consensus.cc:2749] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:45.353679 11634 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
W20260709 13:02:45.352623 10478 leader_election.cc:336] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.354888   431 raft_consensus.cc:2243] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.354740 11634 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:45.357903 10554 leader_election.cc:336] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.357913 11634 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.372720 10554 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.373642 11543 raft_consensus.cc:2749] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.356570   431 raft_consensus.cc:2272] T c2b0a40341f84bbc9d3356b9cf50f1fc P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.366030 11669 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
W20260709 13:02:45.371786 10478 leader_election.cc:336] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.374766 11669 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.375417 11634 raft_consensus.cc:493] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.376243 11634 raft_consensus.cc:515] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:45.377821 11669 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.379119 11634 leader_election.cc:290] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.382757   431 tablet_replica.cc:333] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.384164   431 raft_consensus.cc:2243] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.385555 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631a548ad91f4394897a0ef36cea3bdf" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:45.386236 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:45.386898 10586 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:45.387080 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6aa222767c4a49a4e9bf41a65e1c30" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
W20260709 13:02:45.388132 10480 leader_election.cc:336] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.391894 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88" is_pre_election: true
I20260709 13:02:45.392818 10586 raft_consensus.cc:2468] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 2.
I20260709 13:02:45.393512   431 raft_consensus.cc:2272] T ade59aed1b7f49f2ae404b4f1f714521 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.393869 10478 leader_election.cc:336] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.393960 10480 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.394812 11543 raft_consensus.cc:493] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.395051 11634 raft_consensus.cc:2749] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:45.395434 10480 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.395599 11543 raft_consensus.cc:515] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.396535 11634 raft_consensus.cc:2804] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:45.396956 10480 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 40a50bcbfe194a288c6b3333e6556a88, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.397017 11634 raft_consensus.cc:493] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.397873 11664 raft_consensus.cc:2749] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.398044 11543 leader_election.cc:290] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
W20260709 13:02:45.394634 10478 leader_election.cc:336] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.399206 10478 leader_election.cc:304] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.400241 10480 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.400803 11669 raft_consensus.cc:2749] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.401279 11664 raft_consensus.cc:2804] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:45.401732 11664 raft_consensus.cc:493] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.402204 11664 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:45.405257 10554 consensus_peers.cc:597] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.407953   431 tablet_replica.cc:333] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.410420   431 raft_consensus.cc:2243] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.411283   431 raft_consensus.cc:2272] T e0d3e1641b72401f95b94e0484eb0aa2 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.398100 11634 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:45.416265 11664 raft_consensus.cc:515] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.417021   431 tablet_replica.cc:333] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.417039 10552 leader_election.cc:336] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.418769   431 raft_consensus.cc:2243] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:02:45.423473 10554 consensus_peers.cc:597] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.424265   431 raft_consensus.cc:2272] T f1d5c2fee8bc4c7cb4ec2dceb9b5ca36 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.424032 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293161fc043b46428f5b233850c4215e" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
W20260709 13:02:45.424531 10554 leader_election.cc:336] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.424983 10583 raft_consensus.cc:3060] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:45.428932   431 tablet_replica.cc:333] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.430606 11664 leader_election.cc:290] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.434872 10554 leader_election.cc:304] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
W20260709 13:02:45.435236 10478 leader_election.cc:336] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.436229 11543 raft_consensus.cc:493] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.437155 11674 raft_consensus.cc:2749] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.436878 11634 raft_consensus.cc:515] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.436928 11543 raft_consensus.cc:515] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.438163   431 raft_consensus.cc:2243] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.439746 11543 leader_election.cc:290] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.442269   431 raft_consensus.cc:2272] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.443224 10583 raft_consensus.cc:2468] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 3.
I20260709 13:02:45.444857 11634 leader_election.cc:290] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: Requested vote from peers 40a50bcbfe194a288c6b3333e6556a88 (127.0.107.196:37525), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.447183 11674 raft_consensus.cc:493] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.448098 11674 raft_consensus.cc:515] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
W20260709 13:02:45.447358 10552 leader_election.cc:336] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.450618 11674 leader_election.cc:290] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.451985 10480 leader_election.cc:304] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.452739   431 tablet_replica.cc:333] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.452945 10478 leader_election.cc:336] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.453986 11664 raft_consensus.cc:2804] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:45.454768 11664 raft_consensus.cc:697] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 3 LEADER]: Becoming Leader. State: Replica: ed955e6936204882a741c58f33790c5d, State: Running, Role: LEADER
I20260709 13:02:45.455042   431 raft_consensus.cc:2243] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.456106   431 raft_consensus.cc:2272] T 9420094312cb4ae390240a2dafe35479 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.461668   431 tablet_replica.cc:333] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.462285 10552 leader_election.cc:336] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.462632 10583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2456423bc7e4fd4988ce285a04ee8a1" candidate_uuid: "ed955e6936204882a741c58f33790c5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a50bcbfe194a288c6b3333e6556a88"
I20260709 13:02:45.464124 10583 raft_consensus.cc:3060] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:45.465463 10554 consensus_peers.cc:597] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.465029 11664 consensus_queue.cc:237] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
W20260709 13:02:45.466184 10554 consensus_peers.cc:597] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.466823 10554 consensus_peers.cc:597] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.467450 10554 leader_election.cc:336] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.467906 10554 leader_election.cc:304] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.468662 11543 raft_consensus.cc:2749] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:45.462989   431 raft_consensus.cc:2243] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.471760 11675 raft_consensus.cc:493] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.472524   431 raft_consensus.cc:2272] T 57e71410999946be9e5e39330a0b5d55 P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.472667 11675 raft_consensus.cc:515] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } }
I20260709 13:02:45.475932 11675 leader_election.cc:290] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.477116   431 tablet_replica.cc:333] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.478370   431 raft_consensus.cc:2243] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.479229   431 raft_consensus.cc:2272] T c37a3271e472433d9feb62b8343643e7 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.480293 10554 leader_election.cc:336] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.481016 10554 leader_election.cc:304] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
W20260709 13:02:45.482829 10480 leader_election.cc:336] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.483067 11543 raft_consensus.cc:2749] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.484163   431 tablet_replica.cc:333] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.485509 10478 leader_election.cc:336] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.485553   431 raft_consensus.cc:2243] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.486150 10478 leader_election.cc:304] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed955e6936204882a741c58f33790c5d; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.486472 10583 raft_consensus.cc:2468] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed955e6936204882a741c58f33790c5d in term 3.
I20260709 13:02:45.487282 11664 raft_consensus.cc:2749] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.487480   431 raft_consensus.cc:2272] T bd989738e393402cbf22e78c22cde23d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.489096 10480 leader_election.cc:304] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88, ed955e6936204882a741c58f33790c5d; no voters: b4af86c3867e41659d5499027b08b924
W20260709 13:02:45.489936 10480 raft_consensus.cc:2686] T b2456423bc7e4fd4988ce285a04ee8a1 P ed955e6936204882a741c58f33790c5d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:45.493078   431 tablet_replica.cc:333] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.494522   431 raft_consensus.cc:2243] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.496567   431 raft_consensus.cc:2272] T c8a410e026f642eb97377be90f0dc9ab P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.499614 11543 raft_consensus.cc:493] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.500278 11543 raft_consensus.cc:515] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.501116   431 tablet_replica.cc:333] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.502534 11543 leader_election.cc:290] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.502638   431 raft_consensus.cc:2243] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.503979   431 raft_consensus.cc:2272] T 83813c5ebc124df1a2eac0d37f2e6393 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.506408 10554 leader_election.cc:336] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.508327   431 tablet_replica.cc:333] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.508876 10552 leader_election.cc:336] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.509696   431 raft_consensus.cc:2243] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.510946   431 raft_consensus.cc:2272] T 864793e789784a5dac120669f112203e P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.509447 10552 leader_election.cc:304] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.513640 11543 raft_consensus.cc:2749] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.516537   431 tablet_replica.cc:333] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.517648   431 raft_consensus.cc:2243] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.519098   431 raft_consensus.cc:2272] T 1787e8259fbe45eca97480c9dacb51ff P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.521950   431 tablet_replica.cc:333] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.522960   431 raft_consensus.cc:2243] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.524726   431 raft_consensus.cc:2272] T 674a2e3712f54be4898228175becf617 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.528723   431 tablet_replica.cc:333] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.529781   431 raft_consensus.cc:2243] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.530725   431 raft_consensus.cc:2272] T 631a548ad91f4394897a0ef36cea3bdf P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.533631   431 tablet_replica.cc:333] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.534539   431 raft_consensus.cc:2243] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.535229   431 raft_consensus.cc:2272] T 4db3331e816f4156a1d2bca954a3254a P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.537949   431 tablet_replica.cc:333] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.538694   431 raft_consensus.cc:2243] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.539875   431 raft_consensus.cc:2272] T 3f5fd742ea894da9b9667696dc71cf12 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.543870   431 tablet_replica.cc:333] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.544844   431 raft_consensus.cc:2243] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.546619   431 raft_consensus.cc:2272] T 56f8cd4bda3c413c90061d4f6488adc4 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.551973   431 tablet_replica.cc:333] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.552918   431 raft_consensus.cc:2243] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.553670   431 raft_consensus.cc:2272] T 9a6aa222767c4a49a4e9bf41a65e1c30 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.558090   431 tablet_replica.cc:333] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.559051   431 raft_consensus.cc:2243] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.559927   431 raft_consensus.cc:2272] T c7974ab2c9b84e089e68b0dbd4927373 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.563947   431 tablet_replica.cc:333] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.565394   431 raft_consensus.cc:2243] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:45.566009 10554 consensus_peers.cc:597] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 -> Peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Couldn't send request to peer ed955e6936204882a741c58f33790c5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.566198   431 raft_consensus.cc:2272] T dcee36daa5d94e96826a33c6f6bc52b9 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.570348   431 tablet_replica.cc:333] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.571224   431 raft_consensus.cc:2243] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.572270   431 raft_consensus.cc:2272] T 99a9b8a588f84978934f47ceffea9d2a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.575834   431 tablet_replica.cc:333] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.576598   431 raft_consensus.cc:2243] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.577296   431 raft_consensus.cc:2272] T 50b9587e02da4951a1c992d06ee8006d P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.581151   431 tablet_replica.cc:333] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.581156 11543 raft_consensus.cc:493] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.582370   431 raft_consensus.cc:2243] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.582805 11543 raft_consensus.cc:515] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } }
I20260709 13:02:45.583359   431 raft_consensus.cc:2272] T d8efb10cd18e427c897514fa94979888 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.585307 11543 leader_election.cc:290] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed955e6936204882a741c58f33790c5d (127.0.107.195:41119), b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529)
I20260709 13:02:45.587590   431 tablet_replica.cc:333] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.588541 10554 leader_election.cc:336] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.588625   431 raft_consensus.cc:2243] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.590008   431 raft_consensus.cc:2272] T 72a5e078776b4a799080a281d489ff87 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.591619 10552 leader_election.cc:336] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.592206 10552 leader_election.cc:304] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: b4af86c3867e41659d5499027b08b924, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.593045 11543 raft_consensus.cc:2749] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.593943   431 tablet_replica.cc:333] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.594817   431 raft_consensus.cc:2243] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.595446   431 raft_consensus.cc:2272] T 132b7f2c040940b0898fde87b644800c P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.598127 11543 raft_consensus.cc:493] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b4af86c3867e41659d5499027b08b924)
I20260709 13:02:45.598510   431 tablet_replica.cc:333] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.598889 11543 raft_consensus.cc:515] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:45.599470   431 raft_consensus.cc:2243] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.601001   431 raft_consensus.cc:2272] T ed55aa25a52d4bfe80269832e6be5f47 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.601313 11543 leader_election.cc:290] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.605361   431 tablet_replica.cc:333] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
W20260709 13:02:45.606371 10552 leader_election.cc:336] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
I20260709 13:02:45.606742   431 raft_consensus.cc:2243] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:45.607383 10554 leader_election.cc:336] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.607868 10554 leader_election.cc:304] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.608282   431 raft_consensus.cc:2272] T 6301e11540ca4c42bddb309293400170 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.608599 11543 raft_consensus.cc:2749] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.611878   431 tablet_replica.cc:333] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.613149   431 raft_consensus.cc:2243] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.614050   431 raft_consensus.cc:2272] T d50fb1dd837e4c39b8f6f5fa40e3002d P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.618484   431 tablet_replica.cc:333] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.619266   431 raft_consensus.cc:2243] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.620347   431 pending_rounds.cc:70] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: Trying to abort 1 pending ops.
I20260709 13:02:45.620633   431 pending_rounds.cc:77] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634469764804608 op_type: NO_OP noop_request { }
I20260709 13:02:45.621130   431 raft_consensus.cc:2889] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:45.621527   431 raft_consensus.cc:2272] T 293161fc043b46428f5b233850c4215e P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.627033   431 tablet_replica.cc:333] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.628093   431 raft_consensus.cc:2243] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.629559   431 raft_consensus.cc:2272] T 36a8d77410064b2298c3e33291b7ea3b P ed955e6936204882a741c58f33790c5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.633877   431 tablet_replica.cc:333] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.634737   431 raft_consensus.cc:2243] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.636052   431 raft_consensus.cc:2272] T e35e1c88c6584293ac3dcd5eafc80a3e P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.639228   431 tablet_replica.cc:333] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.640136   431 raft_consensus.cc:2243] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.640867   431 raft_consensus.cc:2272] T 9860e256ccdf41ad8f40aee782e8dac8 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.643450   431 tablet_replica.cc:333] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.644184   431 raft_consensus.cc:2243] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.645221   431 raft_consensus.cc:2272] T 87f93f10ffda421f83d5b217d03a8288 P ed955e6936204882a741c58f33790c5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.648730   431 tablet_replica.cc:333] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.649395   431 raft_consensus.cc:2243] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.650884   431 raft_consensus.cc:2272] T f4eaf8c0162a428796c30899aa6e302a P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.653820   431 tablet_replica.cc:333] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.654464 11674 raft_consensus.cc:493] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fde7d06ee724b9bb005a69743b50211)
I20260709 13:02:45.654754   431 raft_consensus.cc:2243] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.655148 11674 raft_consensus.cc:515] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:45.656085   431 raft_consensus.cc:2272] T 0dc89042adb84e11abc2a012b5c30358 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.657799 11674 leader_election.cc:290] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
I20260709 13:02:45.660930   431 tablet_replica.cc:333] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.662029   431 raft_consensus.cc:2243] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.662912   431 raft_consensus.cc:2272] T 8888b8a7dea849eeb0d1a87c9a347e9c P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.663734 10552 leader_election.cc:336] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:45.665023 10554 leader_election.cc:336] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.665606 10554 leader_election.cc:304] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.666484 11674 raft_consensus.cc:2749] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.667249   431 tablet_replica.cc:333] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d: stopping tablet replica
I20260709 13:02:45.668322   431 raft_consensus.cc:2243] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.669066   431 raft_consensus.cc:2272] T 37a9031573e34c528ad0e50e5bde3015 P ed955e6936204882a741c58f33790c5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.760615   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:45.812225 11674 raft_consensus.cc:493] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fde7d06ee724b9bb005a69743b50211)
I20260709 13:02:45.813251 11674 raft_consensus.cc:515] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:45.815623 11674 leader_election.cc:290] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
W20260709 13:02:45.823310 10554 leader_election.cc:336] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41119: connect: Connection refused (error 111)
W20260709 13:02:45.825135 10554 leader_election.cc:336] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.825739 10554 leader_election.cc:304] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.826697 11674 raft_consensus.cc:2749] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:45.853523 11674 raft_consensus.cc:493] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fde7d06ee724b9bb005a69743b50211)
I20260709 13:02:45.854229 11674 raft_consensus.cc:515] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } } peers { permanent_uuid: "b4af86c3867e41659d5499027b08b924" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41529 } } peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } }
I20260709 13:02:45.856920 11674 leader_election.cc:290] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529), 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833)
W20260709 13:02:45.863374 10552 leader_election.cc:336] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b4af86c3867e41659d5499027b08b924 (127.0.107.193:41529): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41529: connect: Connection refused (error 111)
W20260709 13:02:45.864645 10554 leader_election.cc:336] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.865170 10554 leader_election.cc:304] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, b4af86c3867e41659d5499027b08b924
I20260709 13:02:45.866226 11667 raft_consensus.cc:2749] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.884879   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:02:45.949944 11667 raft_consensus.cc:493] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fde7d06ee724b9bb005a69743b50211)
I20260709 13:02:45.950995 11667 raft_consensus.cc:515] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:45.953794   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:45.954638 11667 leader_election.cc:290] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:45.955897   431 tablet_replica.cc:333] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.958382   431 raft_consensus.cc:2243] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.960033   431 raft_consensus.cc:2272] T d9a096302f134e2bbd562968364f8d15 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.961475 10554 leader_election.cc:336] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:45.965378   431 tablet_replica.cc:333] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
W20260709 13:02:45.964942 10554 leader_election.cc:336] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41119: connect: Connection refused (error 111)
I20260709 13:02:45.966352 10554 leader_election.cc:304] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
I20260709 13:02:45.966697   431 raft_consensus.cc:2243] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.967348 11667 raft_consensus.cc:2706] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Received pre-election callback for term 3 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:02:45.968222   431 raft_consensus.cc:2272] T c2b0a40341f84bbc9d3356b9cf50f1fc P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.971494   431 tablet_replica.cc:333] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.972640   431 raft_consensus.cc:2243] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.973898   431 raft_consensus.cc:2272] T 32ab34f9dee040f1a9711e01915f2048 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.976787   431 tablet_replica.cc:333] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.977731   431 raft_consensus.cc:2243] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.978391   431 raft_consensus.cc:2272] T 9895e4e5d09f4753aa274460cf68c95d P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.980901   431 tablet_replica.cc:333] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.981791   431 raft_consensus.cc:2243] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.982431   431 raft_consensus.cc:2272] T 011d181df5e24eca9a3124fa9442fe94 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.986090   431 tablet_replica.cc:333] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.986990   431 raft_consensus.cc:2243] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.988247   431 raft_consensus.cc:2272] T 6ed66d8d97d2426a851e3fcccde152e5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.991995   431 tablet_replica.cc:333] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.993347   431 raft_consensus.cc:2243] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.994136   431 raft_consensus.cc:2272] T 1eb87559b16a496fba5bb8b6fb3248a5 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.997846   431 tablet_replica.cc:333] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:45.999011   431 raft_consensus.cc:2243] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.999892   431 raft_consensus.cc:2272] T 0ce1ab0a022b49e09aa7b7a686bff66b P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.002962   431 tablet_replica.cc:333] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.003906   431 raft_consensus.cc:2243] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.004518   431 raft_consensus.cc:2272] T 4b4ae9839c944dbaa83cf17b5a5d5170 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.007174   431 tablet_replica.cc:333] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.008000   431 raft_consensus.cc:2243] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.008553   431 raft_consensus.cc:2272] T e0d3e1641b72401f95b94e0484eb0aa2 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.011168   431 tablet_replica.cc:333] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.012287   431 raft_consensus.cc:2243] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.013082   431 raft_consensus.cc:2272] T c89b77affa074e7a82bc912e20e383b0 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.016484   431 tablet_replica.cc:333] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.017719   431 raft_consensus.cc:2243] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.018467   431 raft_consensus.cc:2272] T 3f5fd742ea894da9b9667696dc71cf12 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.022470   431 tablet_replica.cc:333] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.023361   431 raft_consensus.cc:2243] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.024226   431 raft_consensus.cc:2272] T ae1f28de88884353873810960e00d35c P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.027675   431 tablet_replica.cc:333] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.028659   431 raft_consensus.cc:2243] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.030059   431 raft_consensus.cc:2272] T b2456423bc7e4fd4988ce285a04ee8a1 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.033300   431 tablet_replica.cc:333] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.034397   431 raft_consensus.cc:2243] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.035115   431 raft_consensus.cc:2272] T 56f8cd4bda3c413c90061d4f6488adc4 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.039392   431 tablet_replica.cc:333] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.040242   431 raft_consensus.cc:2243] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.040802   431 raft_consensus.cc:2272] T 9a6aa222767c4a49a4e9bf41a65e1c30 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.043653 11543 raft_consensus.cc:493] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fde7d06ee724b9bb005a69743b50211)
I20260709 13:02:46.044296 11543 raft_consensus.cc:515] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fde7d06ee724b9bb005a69743b50211" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36833 } } peers { permanent_uuid: "ed955e6936204882a741c58f33790c5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41119 } } peers { permanent_uuid: "40a50bcbfe194a288c6b3333e6556a88" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37525 } }
I20260709 13:02:46.044420   431 tablet_replica.cc:333] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.045596   431 raft_consensus.cc:2243] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.046303   431 raft_consensus.cc:2272] T c7974ab2c9b84e089e68b0dbd4927373 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.046747 11543 leader_election.cc:290] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833), ed955e6936204882a741c58f33790c5d (127.0.107.195:41119)
I20260709 13:02:46.050029   431 tablet_replica.cc:333] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.051120   431 raft_consensus.cc:2243] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:46.051669 10554 leader_election.cc:336] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2fde7d06ee724b9bb005a69743b50211 (127.0.107.194:36833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36833: connect: Connection refused (error 111)
I20260709 13:02:46.052058   431 raft_consensus.cc:2272] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:46.052424 10554 leader_election.cc:336] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed955e6936204882a741c58f33790c5d (127.0.107.195:41119): Network error: Client connection negotiation failed: client connection to 127.0.107.195:41119: connect: Connection refused (error 111)
I20260709 13:02:46.052883 10554 leader_election.cc:304] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a50bcbfe194a288c6b3333e6556a88; no voters: 2fde7d06ee724b9bb005a69743b50211, ed955e6936204882a741c58f33790c5d
W20260709 13:02:46.053440 10554 raft_consensus.cc:2686] T 9860e256ccdf41ad8f40aee782e8dac8 P 40a50bcbfe194a288c6b3333e6556a88: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:46.055629   431 tablet_replica.cc:333] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.056416   431 raft_consensus.cc:2243] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.056965   431 raft_consensus.cc:2272] T 87f93f10ffda421f83d5b217d03a8288 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.059213   431 tablet_replica.cc:333] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.060196   431 raft_consensus.cc:2243] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.060959   431 raft_consensus.cc:2272] T f4eaf8c0162a428796c30899aa6e302a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.063632   431 tablet_replica.cc:333] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.064519   431 raft_consensus.cc:2243] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.065984   431 raft_consensus.cc:2272] T 8888b8a7dea849eeb0d1a87c9a347e9c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.070127   431 tablet_replica.cc:333] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.070988   431 raft_consensus.cc:2243] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.071714   431 raft_consensus.cc:2272] T 02a30d488569446dbc9a32630b2e3094 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.074401   431 tablet_replica.cc:333] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.075140   431 raft_consensus.cc:2243] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.076289   431 raft_consensus.cc:2272] T 37a9031573e34c528ad0e50e5bde3015 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.078974   431 tablet_replica.cc:333] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.079754   431 raft_consensus.cc:2243] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.080794   431 raft_consensus.cc:2272] T deea6823d2534b959728fc210dd07642 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.083191   431 tablet_replica.cc:333] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.083971   431 raft_consensus.cc:2243] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.084488   431 raft_consensus.cc:2272] T 674a2e3712f54be4898228175becf617 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.086968   431 tablet_replica.cc:333] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.087667   431 raft_consensus.cc:2243] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.088187   431 raft_consensus.cc:2272] T 631a548ad91f4394897a0ef36cea3bdf P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.090845   431 tablet_replica.cc:333] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.091502   431 raft_consensus.cc:2243] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.092602   431 raft_consensus.cc:2272] T d8efb10cd18e427c897514fa94979888 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.095106   431 tablet_replica.cc:333] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.095852   431 raft_consensus.cc:2243] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.096886   431 raft_consensus.cc:2272] T 72a5e078776b4a799080a281d489ff87 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.099263   431 tablet_replica.cc:333] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.099998   431 raft_consensus.cc:2243] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.100517   431 raft_consensus.cc:2272] T d50fb1dd837e4c39b8f6f5fa40e3002d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.102995   431 tablet_replica.cc:333] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.103701   431 raft_consensus.cc:2243] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.104802   431 raft_consensus.cc:2272] T 381f75d00c3144139bbb5c22358f074c P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.108024   431 tablet_replica.cc:333] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.108801   431 raft_consensus.cc:2243] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.109524   431 raft_consensus.cc:2272] T 57e71410999946be9e5e39330a0b5d55 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.112645   431 tablet_replica.cc:333] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.113281   431 raft_consensus.cc:2243] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.113780   431 raft_consensus.cc:2272] T c37a3271e472433d9feb62b8343643e7 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.116184   431 tablet_replica.cc:333] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.116777   431 raft_consensus.cc:2243] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.117288   431 raft_consensus.cc:2272] T 6866a2c25fa64b6987b969ccaf9ce324 P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.119676   431 tablet_replica.cc:333] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.120297   431 raft_consensus.cc:2243] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.121258   431 raft_consensus.cc:2272] T 0dfbdc170b3548d0bf43c26db2aa84d0 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.123899   431 tablet_replica.cc:333] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.124542   431 raft_consensus.cc:2243] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.125054   431 raft_consensus.cc:2272] T 0a946d8672ce4315b453f1d418d5f197 P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.127775   431 tablet_replica.cc:333] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.128417   431 raft_consensus.cc:2243] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.129429   431 raft_consensus.cc:2272] T 581df3f2a4a94df5adb7fc58515064fb P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.132639   431 tablet_replica.cc:333] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.133335   431 raft_consensus.cc:2243] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.134544   431 raft_consensus.cc:2272] T 118b0cf2ac56453abf589a611a7d9c7d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.137632   431 tablet_replica.cc:333] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.138407   431 raft_consensus.cc:2243] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.139189   431 raft_consensus.cc:2272] T 293161fc043b46428f5b233850c4215e P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.142845   431 tablet_replica.cc:333] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.143715   431 raft_consensus.cc:2243] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.144707   431 raft_consensus.cc:2272] T e35e1c88c6584293ac3dcd5eafc80a3e P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.147492   431 tablet_replica.cc:333] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.148252   431 raft_consensus.cc:2243] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.148757   431 raft_consensus.cc:2272] T c1de15bd8c8446e5a4a1ead763021708 P 40a50bcbfe194a288c6b3333e6556a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.151533   431 tablet_replica.cc:333] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.152328   431 raft_consensus.cc:2243] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.153335   431 raft_consensus.cc:2272] T 864793e789784a5dac120669f112203e P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.156179   431 tablet_replica.cc:333] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.156731   431 raft_consensus.cc:2243] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.157606   431 raft_consensus.cc:2272] T c547c7ecd9274a4fa127dcf61445590a P 40a50bcbfe194a288c6b3333e6556a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.160650   431 tablet_replica.cc:333] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.161233   431 raft_consensus.cc:2243] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.162182   431 raft_consensus.cc:2272] T 99a9b8a588f84978934f47ceffea9d2a P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.165628   431 tablet_replica.cc:333] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88: stopping tablet replica
I20260709 13:02:46.166297   431 raft_consensus.cc:2243] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.167383   431 raft_consensus.cc:2272] T bd989738e393402cbf22e78c22cde23d P 40a50bcbfe194a288c6b3333e6556a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.253849   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:02:46.347241   431 master.cc:562] Master@127.0.107.254:46067 shutting down...
W20260709 13:02:46.398219 10309 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:02:46.400095   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.400882   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.401239   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P aa260d0b25dc48cdb34631970851f914: stopping tablet replica
I20260709 13:02:46.430172   431 master.cc:584] Master@127.0.107.254:46067 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (42486 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:02:46.561939   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45963
I20260709 13:02:46.564168   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:46.571259 11677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:46.572286 11678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:46.573573 11680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:46.574410   431 server_base.cc:1061] running on GCE node
I20260709 13:02:46.575917   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:46.576133   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:46.576385   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602166576342 us; error 0 us; skew 500 ppm
I20260709 13:02:46.576998   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:46.580742   431 webserver.cc:533] Webserver started at http://127.0.107.254:43367/ using document root <none> and password file <none>
I20260709 13:02:46.581394   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:46.581616   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:46.581964   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:46.583499   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "e6b59a7246e84cccbc13a671058fb075"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-fc6v"
I20260709 13:02:46.590178   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:46.595104 11685 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.596385   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:46.596835   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "e6b59a7246e84cccbc13a671058fb075"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-fc6v"
I20260709 13:02:46.597163   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:46.610445   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:46.612093   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:46.666520   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45963
I20260709 13:02:46.666726 11736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45963 every 8 connection(s)
I20260709 13:02:46.672145 11737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.686645 11737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075: Bootstrap starting.
I20260709 13:02:46.693697 11737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.699798 11737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075: No bootstrap required, opened a new log
I20260709 13:02:46.702706 11737 raft_consensus.cc:359] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6b59a7246e84cccbc13a671058fb075" member_type: VOTER }
I20260709 13:02:46.703238 11737 raft_consensus.cc:385] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.703439 11737 raft_consensus.cc:740] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b59a7246e84cccbc13a671058fb075, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.704248 11737 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6b59a7246e84cccbc13a671058fb075" member_type: VOTER }
I20260709 13:02:46.704758 11737 raft_consensus.cc:399] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:46.704960 11737 raft_consensus.cc:493] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:46.705183 11737 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.710920 11737 raft_consensus.cc:515] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6b59a7246e84cccbc13a671058fb075" member_type: VOTER }
I20260709 13:02:46.711629 11737 leader_election.cc:304] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6b59a7246e84cccbc13a671058fb075; no voters: 
I20260709 13:02:46.712998 11737 leader_election.cc:290] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:46.713454 11740 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.715050 11740 raft_consensus.cc:697] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 1 LEADER]: Becoming Leader. State: Replica: e6b59a7246e84cccbc13a671058fb075, State: Running, Role: LEADER
I20260709 13:02:46.715998 11740 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6b59a7246e84cccbc13a671058fb075" member_type: VOTER }
I20260709 13:02:46.716492 11737 sys_catalog.cc:565] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:46.721764 11741 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6b59a7246e84cccbc13a671058fb075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6b59a7246e84cccbc13a671058fb075" member_type: VOTER } }
I20260709 13:02:46.722745 11741 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:46.722820 11742 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6b59a7246e84cccbc13a671058fb075. Latest consensus state: current_term: 1 leader_uuid: "e6b59a7246e84cccbc13a671058fb075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6b59a7246e84cccbc13a671058fb075" member_type: VOTER } }
I20260709 13:02:46.724325 11742 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:46.728576 11747 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:46.739100 11747 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:46.740566   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:46.750819 11747 catalog_manager.cc:1383] Generated new cluster ID: f5c4a39580b94c6ba1f4e6cb0f0db93d
I20260709 13:02:46.751210 11747 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:46.806878 11747 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:46.808472 11747 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:46.834188 11747 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075: Generated new TSK 0
I20260709 13:02:46.834962 11747 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:46.872972   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:46.880421 11758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:46.882102 11759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:46.884102 11761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:46.884730   431 server_base.cc:1061] running on GCE node
I20260709 13:02:46.886010   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:46.886364   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:46.886533   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602166886518 us; error 0 us; skew 500 ppm
I20260709 13:02:46.887145   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:46.890767   431 webserver.cc:533] Webserver started at http://127.0.107.193:37719/ using document root <none> and password file <none>
I20260709 13:02:46.891688   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:46.891906   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:46.892166   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:46.893441   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "667dc4151b7b455b9434a014c3d5831c"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-fc6v"
I20260709 13:02:46.900135   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:02:46.904636 11766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.905709   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:02:46.906169   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "667dc4151b7b455b9434a014c3d5831c"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-fc6v"
I20260709 13:02:46.906580   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:46.924973   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:46.926852   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:46.929203   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:46.933313   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:46.933671   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.933961   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:46.934238   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.988699   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40099
I20260709 13:02:46.988811 11828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40099 every 8 connection(s)
I20260709 13:02:46.995711   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:47.006961 11833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:47.007180 11834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:47.012326 11836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:47.013571   431 server_base.cc:1061] running on GCE node
I20260709 13:02:47.015080   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:47.015445   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:47.015777   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602167015724 us; error 0 us; skew 500 ppm
I20260709 13:02:47.016395   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:47.019929 11829 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45963
I20260709 13:02:47.020653 11829 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:47.021260   431 webserver.cc:533] Webserver started at http://127.0.107.194:39031/ using document root <none> and password file <none>
I20260709 13:02:47.021792 11829 heartbeater.cc:507] Master 127.0.107.254:45963 requested a full tablet report, sending...
I20260709 13:02:47.021975   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:47.022392   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:47.022696   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:47.024261   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
format_stamp: "Formatted at 2026-07-09 13:02:47 on dist-test-slave-fc6v"
I20260709 13:02:47.024897 11702 ts_manager.cc:194] Registered new tserver with Master: 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099)
I20260709 13:02:47.027154 11702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55344
I20260709 13:02:47.030320   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:47.035250 11841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.036437   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:47.036864   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
format_stamp: "Formatted at 2026-07-09 13:02:47 on dist-test-slave-fc6v"
I20260709 13:02:47.037266   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:47.059587   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:47.060978   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:47.062620   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:47.065547   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:47.065830   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.066188   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:47.066376   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.120972   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36139
I20260709 13:02:47.121141 11903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36139 every 8 connection(s)
I20260709 13:02:47.126731   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:47.136175 11907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:47.137179 11908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:47.143057   431 server_base.cc:1061] running on GCE node
I20260709 13:02:47.143807 11904 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45963
W20260709 13:02:47.143105 11911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:47.144626 11904 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:47.145851 11904 heartbeater.cc:507] Master 127.0.107.254:45963 requested a full tablet report, sending...
I20260709 13:02:47.146298   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:47.146844   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:47.147087   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602167147063 us; error 0 us; skew 500 ppm
I20260709 13:02:47.148362   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:47.150485 11702 ts_manager.cc:194] Registered new tserver with Master: ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:47.152047   431 webserver.cc:533] Webserver started at http://127.0.107.195:42049/ using document root <none> and password file <none>
I20260709 13:02:47.152952   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:47.152902 11702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55346
I20260709 13:02:47.153777   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:47.154265   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:47.156119   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
format_stamp: "Formatted at 2026-07-09 13:02:47 on dist-test-slave-fc6v"
I20260709 13:02:47.162465   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:47.168532 11915 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.169652   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:02:47.170006   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
format_stamp: "Formatted at 2026-07-09 13:02:47 on dist-test-slave-fc6v"
I20260709 13:02:47.170325   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:47.190238   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:47.191651   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:47.193536   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:47.196744   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:47.197057   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.197331   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:47.197515   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.256685   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34033
I20260709 13:02:47.256808 11977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34033 every 8 connection(s)
I20260709 13:02:47.279151 11978 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45963
I20260709 13:02:47.279692 11978 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:47.280498 11978 heartbeater.cc:507] Master 127.0.107.254:45963 requested a full tablet report, sending...
I20260709 13:02:47.282954 11702 ts_manager.cc:194] Registered new tserver with Master: dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:47.283514   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021757227s
I20260709 13:02:47.284962 11702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55348
I20260709 13:02:47.322322 11702 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55352:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:47.326856 11702 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:47.429674 11794 tablet_service.cc:1511] Processing CreateTablet for tablet 6b20b8b9a451408eb852d77e0eb9e630 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:47.431404 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b20b8b9a451408eb852d77e0eb9e630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.433393 11869 tablet_service.cc:1511] Processing CreateTablet for tablet 6b20b8b9a451408eb852d77e0eb9e630 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:47.435258 11869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b20b8b9a451408eb852d77e0eb9e630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.435406 11793 tablet_service.cc:1511] Processing CreateTablet for tablet 1af25e663eb64fdaa97fd3e9bcc22093 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:47.437672 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af25e663eb64fdaa97fd3e9bcc22093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.449723 11868 tablet_service.cc:1511] Processing CreateTablet for tablet 1af25e663eb64fdaa97fd3e9bcc22093 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:47.451328 11868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af25e663eb64fdaa97fd3e9bcc22093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.455998 11792 tablet_service.cc:1511] Processing CreateTablet for tablet 3a9baa5e81334089beec28feb8de421e (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:47.451392 11943 tablet_service.cc:1511] Processing CreateTablet for tablet 6b20b8b9a451408eb852d77e0eb9e630 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:47.459141 11943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b20b8b9a451408eb852d77e0eb9e630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.459683 11942 tablet_service.cc:1511] Processing CreateTablet for tablet 1af25e663eb64fdaa97fd3e9bcc22093 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:47.461969 11942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af25e663eb64fdaa97fd3e9bcc22093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.463860 11792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a9baa5e81334089beec28feb8de421e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.468672 11867 tablet_service.cc:1511] Processing CreateTablet for tablet 3a9baa5e81334089beec28feb8de421e (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:47.470943 11867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a9baa5e81334089beec28feb8de421e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.473995 11791 tablet_service.cc:1511] Processing CreateTablet for tablet 86b84c2b6c6c49b7a3d62deacb9251fa (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:47.476657 11941 tablet_service.cc:1511] Processing CreateTablet for tablet 3a9baa5e81334089beec28feb8de421e (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:47.478313 11941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a9baa5e81334089beec28feb8de421e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.480480 11939 tablet_service.cc:1511] Processing CreateTablet for tablet 585f463389d34b7fa4e21584926d3130 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:47.482730 11939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585f463389d34b7fa4e21584926d3130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.485353 11940 tablet_service.cc:1511] Processing CreateTablet for tablet 86b84c2b6c6c49b7a3d62deacb9251fa (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:47.487746 11866 tablet_service.cc:1511] Processing CreateTablet for tablet 86b84c2b6c6c49b7a3d62deacb9251fa (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:47.489616 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b84c2b6c6c49b7a3d62deacb9251fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.490078 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 585f463389d34b7fa4e21584926d3130 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:47.492739 11789 tablet_service.cc:1511] Processing CreateTablet for tablet c2e0b85a18d648009b6ff5f220264339 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:47.498539 11788 tablet_service.cc:1511] Processing CreateTablet for tablet c8ca8912d5a34ff1ae00114fbd176620 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:47.500108 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b84c2b6c6c49b7a3d62deacb9251fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.502614 11938 tablet_service.cc:1511] Processing CreateTablet for tablet c2e0b85a18d648009b6ff5f220264339 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:47.504068 11865 tablet_service.cc:1511] Processing CreateTablet for tablet 585f463389d34b7fa4e21584926d3130 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:47.504617 11789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e0b85a18d648009b6ff5f220264339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.504617 11787 tablet_service.cc:1511] Processing CreateTablet for tablet 79d4b7daf9414564b07594628075aeab (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:47.505970 11865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585f463389d34b7fa4e21584926d3130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.506400 11787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d4b7daf9414564b07594628075aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.507869 11940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b84c2b6c6c49b7a3d62deacb9251fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.509351 11788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ca8912d5a34ff1ae00114fbd176620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.512074 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585f463389d34b7fa4e21584926d3130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.512074 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e0b85a18d648009b6ff5f220264339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.526670 11864 tablet_service.cc:1511] Processing CreateTablet for tablet c2e0b85a18d648009b6ff5f220264339 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:47.528331 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e0b85a18d648009b6ff5f220264339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.537602 11937 tablet_service.cc:1511] Processing CreateTablet for tablet c8ca8912d5a34ff1ae00114fbd176620 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:47.539654 11786 tablet_service.cc:1511] Processing CreateTablet for tablet 74af904bb996489bb3b4f76453d2b697 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:47.541105 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74af904bb996489bb3b4f76453d2b697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.534219 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 79d4b7daf9414564b07594628075aeab (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:47.544440 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ca8912d5a34ff1ae00114fbd176620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.548305 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d4b7daf9414564b07594628075aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.594683 11996 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:47.604921 11997 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:47.636988 11998 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:47.648027 11861 tablet_service.cc:1511] Processing CreateTablet for tablet 08f6945c769c4dd89aa05840c35b83a7 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:47.649636 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f6945c769c4dd89aa05840c35b83a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.652276 11862 tablet_service.cc:1511] Processing CreateTablet for tablet 74af904bb996489bb3b4f76453d2b697 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:47.652618 11793 tablet_service.cc:1511] Processing CreateTablet for tablet 08f6945c769c4dd89aa05840c35b83a7 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:47.653826 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74af904bb996489bb3b4f76453d2b697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.653831 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f6945c769c4dd89aa05840c35b83a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.660071 11867 tablet_service.cc:1511] Processing CreateTablet for tablet c8ca8912d5a34ff1ae00114fbd176620 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:47.660948 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 79d4b7daf9414564b07594628075aeab (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:47.661892 11867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ca8912d5a34ff1ae00114fbd176620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.662988 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d4b7daf9414564b07594628075aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.636063 11996 tablet_bootstrap.cc:654] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.674469 11940 tablet_service.cc:1511] Processing CreateTablet for tablet 08f6945c769c4dd89aa05840c35b83a7 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:47.676002 11940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f6945c769c4dd89aa05840c35b83a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.690790 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 74af904bb996489bb3b4f76453d2b697 (DEFAULT_TABLE table=test-workload [id=df4d759f655948f992f6f69950dddfde]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:47.693306 11997 tablet_bootstrap.cc:654] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.693682 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74af904bb996489bb3b4f76453d2b697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.717378 11998 tablet_bootstrap.cc:654] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:47.737962 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:47.763520 11996 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:47.764303 11996 ts_tablet_manager.cc:1403] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.170s	user 0.019s	sys 0.011s
I20260709 13:02:47.771871 11996 raft_consensus.cc:359] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.772766 11996 raft_consensus.cc:385] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.773092 11996 raft_consensus.cc:740] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.773904 11996 consensus_queue.cc:260] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.785418 11997 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:47.786412 11997 ts_tablet_manager.cc:1403] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.182s	user 0.032s	sys 0.026s
I20260709 13:02:47.791189 11997 raft_consensus.cc:359] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.800164 11997 raft_consensus.cc:385] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.800509 11997 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.801307 11997 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.802479 11996 ts_tablet_manager.cc:1434] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.019s
I20260709 13:02:47.807106 11829 heartbeater.cc:499] Master 127.0.107.254:45963 was elected leader, sending a full tablet report...
I20260709 13:02:47.807617 11996 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:47.809329 11978 heartbeater.cc:499] Master 127.0.107.254:45963 was elected leader, sending a full tablet report...
I20260709 13:02:47.818769 11998 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:47.819419 11998 ts_tablet_manager.cc:1403] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.004s
I20260709 13:02:47.828524 11996 tablet_bootstrap.cc:654] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.828663 11998 raft_consensus.cc:359] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.829608 11998 raft_consensus.cc:385] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.829975 11998 raft_consensus.cc:740] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.830818 11998 consensus_queue.cc:260] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.833000 11997 ts_tablet_manager.cc:1434] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.005s
I20260709 13:02:47.834784 11997 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:47.847252 11996 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:47.848300 11996 ts_tablet_manager.cc:1403] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.003s
I20260709 13:02:47.852906 11904 heartbeater.cc:499] Master 127.0.107.254:45963 was elected leader, sending a full tablet report...
I20260709 13:02:47.853811 11998 ts_tablet_manager.cc:1434] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.033s	user 0.017s	sys 0.007s
I20260709 13:02:47.853906 11996 raft_consensus.cc:359] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.855039 11996 raft_consensus.cc:385] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.855361 11996 raft_consensus.cc:740] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.855665 11998 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:47.856360 11996 consensus_queue.cc:260] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.858882 11997 tablet_bootstrap.cc:654] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.859081 11996 ts_tablet_manager.cc:1434] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:02:47.860384 11996 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:47.864043 11998 tablet_bootstrap.cc:654] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.867080 11996 tablet_bootstrap.cc:654] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.867010 11997 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:47.868057 11997 ts_tablet_manager.cc:1403] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.000s
I20260709 13:02:47.873347 11997 raft_consensus.cc:359] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.874442 11997 raft_consensus.cc:385] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.874857 11997 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.876142 11997 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.878324 11997 ts_tablet_manager.cc:1434] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:47.878695 11998 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
W20260709 13:02:47.878876 11905 tablet.cc:2406] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:47.879336 11997 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:47.879758 11998 ts_tablet_manager.cc:1403] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:02:47.883708 11998 raft_consensus.cc:359] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.884867 11998 raft_consensus.cc:385] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.885289 11998 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.885413 11996 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:47.886090 11996 ts_tablet_manager.cc:1403] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:02:47.887028 11997 tablet_bootstrap.cc:654] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.886533 11998 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.889493 11998 ts_tablet_manager.cc:1434] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:47.889503 11996 raft_consensus.cc:359] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.890590 11996 raft_consensus.cc:385] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.891001 11996 raft_consensus.cc:740] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.891314 11998 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:47.892166 11996 consensus_queue.cc:260] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.896034 11996 ts_tablet_manager.cc:1434] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:02:47.898422 11996 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:47.899597 11997 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:47.900204 11997 ts_tablet_manager.cc:1403] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.016s
I20260709 13:02:47.900565 11998 tablet_bootstrap.cc:654] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.904495 11997 raft_consensus.cc:359] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.905618 11997 raft_consensus.cc:385] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.906013 11997 raft_consensus.cc:740] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.907495 11996 tablet_bootstrap.cc:654] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.907018 11997 consensus_queue.cc:260] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.910550 11997 ts_tablet_manager.cc:1434] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:02:47.912396 11997 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:47.921643 12001 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.921978 11996 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:47.922746 11996 ts_tablet_manager.cc:1403] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:02:47.922250 12001 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.922963 11997 tablet_bootstrap.cc:654] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.930744 12001 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:47.938448 12005 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.939248 12005 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.941421 11998 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:47.942359 11998 ts_tablet_manager.cc:1403] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.006s
I20260709 13:02:47.948277 12005 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:47.943822 11996 raft_consensus.cc:359] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.963990 11996 raft_consensus.cc:385] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.964488 11996 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.965488 11996 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.965612 11998 raft_consensus.cc:359] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.966630 12001 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.966910 11998 raft_consensus.cc:385] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.967289 12001 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.968447 11997 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:47.969216 11997 ts_tablet_manager.cc:1403] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.011s
I20260709 13:02:47.983156 11996 ts_tablet_manager.cc:1434] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.009s
I20260709 13:02:47.986240 11996 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:47.967294 11998 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.987848 11998 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:47.991400 11998 ts_tablet_manager.cc:1434] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.007s
I20260709 13:02:47.993496 11998 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:48.004990 12001 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.006388 12001 raft_consensus.cc:493] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.007653 11996 tablet_bootstrap.cc:654] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.006990 12001 raft_consensus.cc:515] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.017441 12001 leader_election.cc:290] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.020255 12005 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.022109 11998 tablet_bootstrap.cc:654] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.021677 12005 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.025655 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.026341 11952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.028028 11952 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 0.
I20260709 13:02:48.027899 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.031776 11768 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:48.033090 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
W20260709 13:02:48.034011 11768 leader_election.cc:343] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.036518 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.038206 11878 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 0.
I20260709 13:02:48.040696 11877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.034026 11879 raft_consensus.cc:2468] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 0.
I20260709 13:02:48.049448 12005 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.044339 12001 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.050804 12001 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.036584 11997 raft_consensus.cc:359] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.051295 12001 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.051363 11997 raft_consensus.cc:385] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.051961 11997 raft_consensus.cc:740] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
W20260709 13:02:48.052945 11769 leader_election.cc:343] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.053021 11997 consensus_queue.cc:260] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.053687 11769 leader_election.cc:304] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c; no voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3
W20260709 13:02:48.035329 11768 leader_election.cc:343] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.055408 11769 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:48.056380 12019 raft_consensus.cc:2749] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.057317 12019 raft_consensus.cc:2804] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.057845 12019 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.058375 12019 raft_consensus.cc:3060] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.062947 11997 ts_tablet_manager.cc:1434] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.093s	user 0.010s	sys 0.001s
I20260709 13:02:48.063625 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.064466 11953 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 0.
I20260709 13:02:48.064693 11997 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:48.066496 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.070024 12019 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.070606 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.071254 11843 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:48.072129 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
W20260709 13:02:48.072613 11843 leader_election.cc:343] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.073257 11803 raft_consensus.cc:2393] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in current term 1: Already voted for candidate 667dc4151b7b455b9434a014c3d5831c in this term.
I20260709 13:02:48.073637 12005 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.074117 12005 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.074272 11996 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:48.074625 12005 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.075162 11996 ts_tablet_manager.cc:1403] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.019s
I20260709 13:02:48.078328 12001 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.079911 12003 raft_consensus.cc:493] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.080602 12003 raft_consensus.cc:515] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.081015 11996 raft_consensus.cc:359] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.082261 11996 raft_consensus.cc:385] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.082758 11996 raft_consensus.cc:740] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.080116 11804 raft_consensus.cc:2393] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in current term 1: Already voted for candidate 667dc4151b7b455b9434a014c3d5831c in this term.
I20260709 13:02:48.083312 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.085031 12001 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Requested vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.087703 11877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.088670 11877 raft_consensus.cc:3060] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.089064 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:48.089841 11951 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.090020 11998 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.090766 11998 ts_tablet_manager.cc:1403] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.020s
I20260709 13:02:48.092294 11845 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:48.094889 11998 raft_consensus.cc:359] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.096071 11998 raft_consensus.cc:385] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.096437 11998 raft_consensus.cc:740] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.097651 11998 consensus_queue.cc:260] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.101660 11877 raft_consensus.cc:2468] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 1.
I20260709 13:02:48.104450 11769 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:48.103974 11996 consensus_queue.cc:260] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.107698 12003 leader_election.cc:290] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.107493 12020 raft_consensus.cc:2804] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.109923 11996 ts_tablet_manager.cc:1434] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 13:02:48.117607 11997 tablet_bootstrap.cc:654] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.119309 12023 raft_consensus.cc:2749] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.112030 12019 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Requested vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.120324 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
W20260709 13:02:48.125649 11768 leader_election.cc:343] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.127152 11951 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 1.
I20260709 13:02:48.140722 11996 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:48.140915 11768 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:48.142226 12001 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.143151 12001 raft_consensus.cc:697] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 LEADER]: Becoming Leader. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Running, Role: LEADER
I20260709 13:02:48.144387 12001 consensus_queue.cc:237] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.130403 12003 raft_consensus.cc:493] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.146026 12003 raft_consensus.cc:515] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.139132 12005 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.153261 11879 raft_consensus.cc:2393] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 667dc4151b7b455b9434a014c3d5831c in current term 1: Already voted for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in this term.
I20260709 13:02:48.159512 11998 ts_tablet_manager.cc:1434] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.003s
I20260709 13:02:48.154160 12020 raft_consensus.cc:697] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 LEADER]: Becoming Leader. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Running, Role: LEADER
I20260709 13:02:48.160988 12019 raft_consensus.cc:493] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.161720 12019 raft_consensus.cc:515] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.162199 12020 consensus_queue.cc:237] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.164070 12019 leader_election.cc:290] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.165421 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.167593 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.170548 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
W20260709 13:02:48.172211 11769 leader_election.cc:343] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.159772 12003 leader_election.cc:290] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
W20260709 13:02:48.174073 11768 leader_election.cc:343] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.175618 11768 leader_election.cc:304] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c; no voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.176477 11996 tablet_bootstrap.cc:654] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.168133 11998 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:48.181221 12026 raft_consensus.cc:2749] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.184022 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.187088 11998 tablet_bootstrap.cc:654] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.184684 11997 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:48.188504 11997 ts_tablet_manager.cc:1403] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.004s
I20260709 13:02:48.188922 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.189967 12003 raft_consensus.cc:493] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.197199 12003 raft_consensus.cc:515] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
W20260709 13:02:48.190948 11919 leader_election.cc:343] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.200866 11997 raft_consensus.cc:359] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.202014 12003 leader_election.cc:290] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.202121 11997 raft_consensus.cc:385] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.190938 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:48.203265 11997 raft_consensus.cc:740] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.203920 11951 raft_consensus.cc:2393] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in current term 1: Already voted for candidate 667dc4151b7b455b9434a014c3d5831c in this term.
I20260709 13:02:48.203670 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.192245 12005 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.193181 11996 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:48.204573 11997 consensus_queue.cc:260] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.205523 11996 ts_tablet_manager.cc:1403] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.005s
W20260709 13:02:48.207270 11919 leader_election.cc:343] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.207664 11997 ts_tablet_manager.cc:1434] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:02:48.207964 11877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
W20260709 13:02:48.208310 11919 leader_election.cc:343] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.208711 11877 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.209827 11843 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:48.209908 11996 raft_consensus.cc:359] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.210855 11996 raft_consensus.cc:385] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.211236 11996 raft_consensus.cc:740] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.211659 12027 raft_consensus.cc:2749] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.212201 11996 consensus_queue.cc:260] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.210364 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.214433 11878 raft_consensus.cc:2468] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.212704 11997 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:48.216243 11996 ts_tablet_manager.cc:1434] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:48.216711 11918 leader_election.cc:304] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:48.217789 11996 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:48.218384 12003 raft_consensus.cc:2804] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.219411 12003 raft_consensus.cc:493] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.220113 12003 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.221902 11918 leader_election.cc:304] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:48.212657 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.224486 11998 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.225310 11998 ts_tablet_manager.cc:1403] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.000s
I20260709 13:02:48.227802 11997 tablet_bootstrap.cc:654] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.231353 11998 raft_consensus.cc:359] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.232657 11998 raft_consensus.cc:385] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.233047 11998 raft_consensus.cc:740] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.235720 11998 consensus_queue.cc:260] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.237047 12003 raft_consensus.cc:515] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.242900 12003 leader_election.cc:290] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.243847 12003 raft_consensus.cc:2804] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.244307 12003 raft_consensus.cc:493] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.244714 12003 raft_consensus.cc:3060] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.245028 11996 tablet_bootstrap.cc:654] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.245478 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.247840 11998 ts_tablet_manager.cc:1434] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:02:48.249372 11998 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
W20260709 13:02:48.254593 11919 leader_election.cc:343] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.263353 11997 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:48.264847 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.265717 11879 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.262161 11701 catalog_manager.cc:5697] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c reported cstate change: term changed from 0 to 1, leader changed from <none> to 667dc4151b7b455b9434a014c3d5831c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "667dc4151b7b455b9434a014c3d5831c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.264904 11997 ts_tablet_manager.cc:1403] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.002s
I20260709 13:02:48.274376 12003 raft_consensus.cc:515] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.276854 11701 catalog_manager.cc:5697] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c reported cstate change: term changed from 0 to 1, leader changed from <none> to 667dc4151b7b455b9434a014c3d5831c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "667dc4151b7b455b9434a014c3d5831c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:48.283134 11918 leader_election.cc:343] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.290364 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.284108 11997 raft_consensus.cc:359] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.292062 11879 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:48.292611 11996 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:48.293326 11996 ts_tablet_manager.cc:1403] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.013s
I20260709 13:02:48.292654 11997 raft_consensus.cc:385] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.294061 11997 raft_consensus.cc:740] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
W20260709 13:02:48.294426 11919 leader_election.cc:343] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.291072 12003 leader_election.cc:290] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.295025 11997 consensus_queue.cc:260] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.295595 11918 leader_election.cc:304] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.298126 11997 ts_tablet_manager.cc:1434] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:02:48.297588 11996 raft_consensus.cc:359] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.298796 11996 raft_consensus.cc:385] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.299098 12003 raft_consensus.cc:2749] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.299423 11996 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.300979 11998 tablet_bootstrap.cc:654] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.301803 12033 raft_consensus.cc:493] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.302661 12033 raft_consensus.cc:515] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.300967 11996 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.307350 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.307790 11996 ts_tablet_manager.cc:1434] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 13:02:48.308436 11804 raft_consensus.cc:2468] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.307410 11918 leader_election.cc:304] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:48.309885 11996 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:48.310588 12003 raft_consensus.cc:2804] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.310500 11919 leader_election.cc:304] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:48.311414 12003 raft_consensus.cc:697] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:48.313493 12003 consensus_queue.cc:237] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.314309 12033 leader_election.cc:290] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.315313 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.316431 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.320709 11997 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:48.320878 11998 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.324703 11879 raft_consensus.cc:3060] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.325282 11998 ts_tablet_manager.cc:1403] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.008s
W20260709 13:02:48.326020 11918 leader_election.cc:343] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.323715 12033 raft_consensus.cc:2804] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.325331 11996 tablet_bootstrap.cc:654] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.329514 12033 raft_consensus.cc:493] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.331218 11998 raft_consensus.cc:359] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.338994 11998 raft_consensus.cc:385] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.339067 12033 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.339464 11998 raft_consensus.cc:740] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.341742 11998 consensus_queue.cc:260] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.343770 11879 raft_consensus.cc:2468] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:48.344686 11998 ts_tablet_manager.cc:1434] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:02:48.345526 11918 leader_election.cc:304] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:48.346109 11998 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:48.347570 12038 raft_consensus.cc:2804] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.348426 11997 tablet_bootstrap.cc:654] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.348269 12038 raft_consensus.cc:697] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:48.349653 12038 consensus_queue.cc:237] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.358937 11998 tablet_bootstrap.cc:654] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.365700 12033 raft_consensus.cc:515] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.369905 11996 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:48.371515 11996 ts_tablet_manager.cc:1403] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.004s
I20260709 13:02:48.378809 11996 raft_consensus.cc:359] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.380185 11996 raft_consensus.cc:385] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.384748 11996 raft_consensus.cc:740] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.384989 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.386020 11804 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.392130 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.393944 12033 leader_election.cc:290] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
W20260709 13:02:48.394603 11918 leader_election.cc:343] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.386762 11996 consensus_queue.cc:260] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.404239 11997 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:48.405191 11996 ts_tablet_manager.cc:1434] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:02:48.405107 11997 ts_tablet_manager.cc:1403] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.007s
I20260709 13:02:48.410267 11997 raft_consensus.cc:359] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.412070 11997 raft_consensus.cc:385] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.412540 11997 raft_consensus.cc:740] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.413949 11998 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.413690 11997 consensus_queue.cc:260] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.414196 12020 raft_consensus.cc:493] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.414726 11998 ts_tablet_manager.cc:1403] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.037s
I20260709 13:02:48.414794 12020 raft_consensus.cc:515] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.416558 11997 ts_tablet_manager.cc:1434] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 13:02:48.418263 11997 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:48.418746 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ca8912d5a34ff1ae00114fbd176620" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.419051 11702 catalog_manager.cc:5697] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 0 to 1, leader changed from <none> to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.421264 11702 catalog_manager.cc:5697] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 0 to 1, leader changed from <none> to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.423358 11804 raft_consensus.cc:2468] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
W20260709 13:02:48.424336 11769 leader_election.cc:343] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.426410 11919 leader_election.cc:304] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.428555 11997 tablet_bootstrap.cc:654] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.428406 12026 raft_consensus.cc:493] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.429585 11996 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:48.429446 12026 raft_consensus.cc:515] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.433296 12033 raft_consensus.cc:2804] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.433970 12033 raft_consensus.cc:697] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:48.435022 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.436532 12033 consensus_queue.cc:237] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.432343 11998 raft_consensus.cc:359] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.442121 12020 leader_election.cc:290] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.439525 11998 raft_consensus.cc:385] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.444157 12026 leader_election.cc:290] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.444890 11996 tablet_bootstrap.cc:654] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.445719 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ca8912d5a34ff1ae00114fbd176620" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.444190 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
W20260709 13:02:48.448246 11768 leader_election.cc:343] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.448853 11768 leader_election.cc:304] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c; no voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.449060 11879 raft_consensus.cc:2393] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667dc4151b7b455b9434a014c3d5831c in current term 1: Already voted for candidate dbab3b47fdc64b5a9ba664ef3563e22e in this term.
I20260709 13:02:48.450266 12026 raft_consensus.cc:2749] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.451681 11769 leader_election.cc:304] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c; no voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.453125 12026 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.444345 11998 raft_consensus.cc:740] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.455484 11998 consensus_queue.cc:260] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.457249 11997 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:48.457932 11997 ts_tablet_manager.cc:1403] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.010s
I20260709 13:02:48.461294 11998 ts_tablet_manager.cc:1434] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 13:02:48.461906 11997 raft_consensus.cc:359] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.465721 11997 raft_consensus.cc:385] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.466358 11997 raft_consensus.cc:740] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.467515 11997 consensus_queue.cc:260] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.469182 11998 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:48.471427 11997 ts_tablet_manager.cc:1434] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:02:48.473546 11997 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:48.480335 11998 tablet_bootstrap.cc:654] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.483911 11997 tablet_bootstrap.cc:654] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.487524 12020 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.488550 12020 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.490283 12027 raft_consensus.cc:493] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.490985 12027 raft_consensus.cc:515] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.493706 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.494863 12027 leader_election.cc:290] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.495971 12033 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.496408 11769 leader_election.cc:343] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.496747 12033 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.497639 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.499202 12038 raft_consensus.cc:493] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.500178 11845 leader_election.cc:343] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.499996 12038 raft_consensus.cc:515] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.503383 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.504065 12038 leader_election.cc:290] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.504987 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
W20260709 13:02:48.505434 11768 leader_election.cc:343] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.505892 12033 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.506042 11768 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c; no voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.506098 11879 raft_consensus.cc:2468] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.507519 12001 raft_consensus.cc:2749] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.509011 12001 raft_consensus.cc:493] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.509395 11918 leader_election.cc:304] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:48.509877 12001 raft_consensus.cc:515] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.510792 12033 raft_consensus.cc:2804] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.511238 12033 raft_consensus.cc:493] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.497641 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.511652 12033 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.512476 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.514966 12001 leader_election.cc:290] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.516239 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.517046 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.517867 11953 raft_consensus.cc:2468] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 0.
I20260709 13:02:48.518476 12020 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
W20260709 13:02:48.520933 11919 leader_election.cc:343] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.521549 12033 raft_consensus.cc:515] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.500447 11700 catalog_manager.cc:5697] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 0 to 1, leader changed from <none> to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.528134 11951 raft_consensus.cc:2393] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in current term 1: Already voted for candidate dbab3b47fdc64b5a9ba664ef3563e22e in this term.
I20260709 13:02:48.530699 12033 leader_election.cc:290] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.485845 12026 raft_consensus.cc:2749] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.532023 11768 leader_election.cc:304] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:48.535137 12020 raft_consensus.cc:2804] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.535795 12020 raft_consensus.cc:493] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.536257 12020 raft_consensus.cc:3060] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.539120 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
W20260709 13:02:48.540707 12048 log.cc:927] Time spent T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:48.544984 12033 raft_consensus.cc:493] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.545989 12033 raft_consensus.cc:515] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.549814 12033 leader_election.cc:290] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
W20260709 13:02:48.551977 11919 leader_election.cc:343] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.554239 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.555598 11803 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.557658 11919 leader_election.cc:304] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:48.558102 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.559083 11878 raft_consensus.cc:2393] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbab3b47fdc64b5a9ba664ef3563e22e in current term 1: Already voted for candidate 667dc4151b7b455b9434a014c3d5831c in this term.
I20260709 13:02:48.560464 12033 raft_consensus.cc:2804] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.560448 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.561102 12033 raft_consensus.cc:493] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.567032 11996 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:48.567653 11996 ts_tablet_manager.cc:1403] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.138s	user 0.041s	sys 0.052s
I20260709 13:02:48.567992 11953 raft_consensus.cc:3060] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.573235 11996 raft_consensus.cc:359] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.573961 11996 raft_consensus.cc:385] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.566566 12033 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.574199 11996 raft_consensus.cc:740] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.563248 11918 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.578016 11998 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.578838 12020 raft_consensus.cc:515] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.584622 11998 ts_tablet_manager.cc:1403] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.016s
I20260709 13:02:48.571069 11843 leader_election.cc:304] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:48.588738 12033 raft_consensus.cc:515] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.589412 12027 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.590557 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.591387 12033 leader_election.cc:290] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.593788 11877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.593883 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.594575 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.595100 11803 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.594703 11877 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.566679 11879 raft_consensus.cc:2468] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 0.
I20260709 13:02:48.599612 12027 raft_consensus.cc:2749] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.600961 11998 raft_consensus.cc:359] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.601985 11998 raft_consensus.cc:385] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.602481 11998 raft_consensus.cc:740] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.605873 11998 consensus_queue.cc:260] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.606554 12038 raft_consensus.cc:2749] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.605819 11996 consensus_queue.cc:260] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.604962 11803 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:48.608505 12020 leader_election.cc:290] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Requested vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.610105 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:48.610903 11997 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:48.610958 11951 raft_consensus.cc:3060] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.612927 11919 leader_election.cc:304] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.616305 12038 raft_consensus.cc:2804] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.616905 12038 raft_consensus.cc:697] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:48.617048 11998 ts_tablet_manager.cc:1434] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:02:48.617923 11997 ts_tablet_manager.cc:1403] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.032s
I20260709 13:02:48.618582 11998 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:48.619192 11996 ts_tablet_manager.cc:1434] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:02:48.620484 11996 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:48.621362 11997 raft_consensus.cc:359] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.622237 11997 raft_consensus.cc:385] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.622574 11997 raft_consensus.cc:740] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.623950 12038 consensus_queue.cc:237] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.626398 11998 tablet_bootstrap.cc:654] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.627372 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.628288 11879 raft_consensus.cc:3060] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.632505 12020 consensus_queue.cc:1048] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.635938 11997 consensus_queue.cc:260] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.647897 11951 raft_consensus.cc:2468] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 1.
I20260709 13:02:48.649575 11768 leader_election.cc:304] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:48.649930 11997 ts_tablet_manager.cc:1434] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:02:48.637061 11998 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.640039 12026 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.650767 12020 raft_consensus.cc:2804] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.651355 11997 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e: Bootstrap starting.
I20260709 13:02:48.642493 11878 raft_consensus.cc:2468] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:48.651350 12020 raft_consensus.cc:697] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 LEADER]: Becoming Leader. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Running, Role: LEADER
I20260709 13:02:48.651278 11702 catalog_manager.cc:5697] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 0 to 1, leader changed from <none> to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.653585 12020 consensus_queue.cc:237] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.654069 11918 leader_election.cc:304] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:48.655128 12033 raft_consensus.cc:2804] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.627449 11996 tablet_bootstrap.cc:654] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.656576 11998 ts_tablet_manager.cc:1403] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.003s
I20260709 13:02:48.655701 12033 raft_consensus.cc:697] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:48.660331 12033 consensus_queue.cc:237] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.672631 11879 raft_consensus.cc:2468] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667dc4151b7b455b9434a014c3d5831c in term 1.
I20260709 13:02:48.685580 11700 catalog_manager.cc:5697] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c reported cstate change: term changed from 0 to 1, leader changed from <none> to 667dc4151b7b455b9434a014c3d5831c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "667dc4151b7b455b9434a014c3d5831c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.718621 12027 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.719697 12027 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.743763 12038 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.744760 12038 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.755242 11998 raft_consensus.cc:359] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.757666 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.757515 11998 raft_consensus.cc:385] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.758852 12038 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.769177 12026 consensus_queue.cc:1048] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:02:48.781116 11997 tablet_bootstrap.cc:654] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.774499 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.812896 11953 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 0.
I20260709 13:02:48.775053 12027 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.768357 11803 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 0.
I20260709 13:02:48.815588 11843 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:48.764166 12020 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:02:48.810890 11998 raft_consensus.cc:740] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.820330 11998 consensus_queue.cc:260] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.787158 11996 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: No bootstrap required, opened a new log
I20260709 13:02:48.822099 11996 ts_tablet_manager.cc:1403] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.017s
I20260709 13:02:48.828399 12038 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.758373 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.831944 11879 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.832981 12027 raft_consensus.cc:2804] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.833463 12027 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.833847 12027 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.834663 11918 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
W20260709 13:02:48.761734 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:48.835924 12038 raft_consensus.cc:2804] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.768890 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:48.836406 12038 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.836794 12038 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.836869 11804 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 0.
I20260709 13:02:48.866797 11996 raft_consensus.cc:359] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.868494 11996 raft_consensus.cc:385] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.868975 11996 raft_consensus.cc:740] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.872581 11997 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e: No bootstrap required, opened a new log
I20260709 13:02:48.873574 11997 ts_tablet_manager.cc:1403] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent bootstrapping tablet: real 0.222s	user 0.008s	sys 0.023s
I20260709 13:02:48.875263 11996 consensus_queue.cc:260] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.880626 11998 ts_tablet_manager.cc:1434] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.224s	user 0.013s	sys 0.006s
I20260709 13:02:48.882031 11998 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: Bootstrap starting.
I20260709 13:02:48.885938 12033 consensus_queue.cc:1048] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.891700 11996 ts_tablet_manager.cc:1434] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 13:02:48.902668 12064 raft_consensus.cc:493] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.901539 12038 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.903288 12064 raft_consensus.cc:515] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.905699 12064 leader_election.cc:290] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.908463 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ca8912d5a34ff1ae00114fbd176620" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.909435 12027 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.908378 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.907238 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ca8912d5a34ff1ae00114fbd176620" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
W20260709 13:02:48.911664 11843 leader_election.cc:343] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.902168 11998 tablet_bootstrap.cc:654] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.920694 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.914072 11997 raft_consensus.cc:359] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.926162 11997 raft_consensus.cc:385] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.926522 11997 raft_consensus.cc:740] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.905054 12038 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:48.920740 12027 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.928328 12033 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.930130 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:48.931465 11951 raft_consensus.cc:2393] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in current term 1: Already voted for candidate dbab3b47fdc64b5a9ba664ef3563e22e in this term.
I20260709 13:02:48.923236 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:48.932884 11876 raft_consensus.cc:2393] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbab3b47fdc64b5a9ba664ef3563e22e in current term 1: Already voted for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in this term.
I20260709 13:02:48.921169 11804 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.921608 11803 raft_consensus.cc:2468] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 0.
I20260709 13:02:48.938648 11699 catalog_manager.cc:5697] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 0 to 1, leader changed from <none> to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.940279 11845 leader_election.cc:304] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:48.941862 12027 raft_consensus.cc:2804] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.942330 12027 raft_consensus.cc:493] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.942708 12027 raft_consensus.cc:3060] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.950574 11843 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:48.927372 11997 consensus_queue.cc:260] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.920617 12061 raft_consensus.cc:493] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.952404 12064 raft_consensus.cc:2749] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.952806 12061 raft_consensus.cc:515] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.955531 12061 leader_election.cc:290] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.957877 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:48.959053 11804 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:48.960813 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "667dc4151b7b455b9434a014c3d5831c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:48.961568 11997 ts_tablet_manager.cc:1434] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.003s
W20260709 13:02:48.964478 11918 consensus_peers.cc:597] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Couldn't send request to peer ea5c74e7c5e24ba89e57c326f23fdeb3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.965207 12038 consensus_queue.cc:1048] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.964520 11769 leader_election.cc:304] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c; no voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.969604 12001 raft_consensus.cc:2749] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.965484 11919 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:48.971033 11804 raft_consensus.cc:3060] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.971140 12038 raft_consensus.cc:2804] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.972091 12038 raft_consensus.cc:697] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:48.973184 12038 consensus_queue.cc:237] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.975741 12027 raft_consensus.cc:515] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:48.979460 12027 leader_election.cc:290] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:48.981871 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ca8912d5a34ff1ae00114fbd176620" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:48.987824 11801 raft_consensus.cc:3060] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.995285 11998 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: No bootstrap required, opened a new log
I20260709 13:02:48.996215 11998 ts_tablet_manager.cc:1403] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.005s
I20260709 13:02:49.000288 11998 raft_consensus.cc:359] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:49.002147 11998 raft_consensus.cc:385] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.002467 11998 raft_consensus.cc:740] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.004527 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ca8912d5a34ff1ae00114fbd176620" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:49.005345 11953 raft_consensus.cc:3060] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.003284 11998 consensus_queue.cc:260] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:49.027233 11953 raft_consensus.cc:2468] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 1.
I20260709 13:02:49.029732 11998 ts_tablet_manager.cc:1434] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:02:49.029340 12036 consensus_queue.cc:1048] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.032589 11843 leader_election.cc:304] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:49.033782 12064 raft_consensus.cc:2804] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.034410 12064 raft_consensus.cc:697] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:49.035460 12064 consensus_queue.cc:237] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:49.038286 11801 raft_consensus.cc:2468] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 1.
I20260709 13:02:49.058173 11700 catalog_manager.cc:5697] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 0 to 1, leader changed from <none> to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.074812 11702 catalog_manager.cc:5697] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.120436 12076 consensus_queue.cc:1048] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.132905 11878 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.145794 12036 consensus_queue.cc:1048] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.172631 12001 consensus_queue.cc:1048] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.187624 12001 consensus_queue.cc:1048] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.208927 12064 raft_consensus.cc:493] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.209719 12064 raft_consensus.cc:515] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:49.211499 12036 consensus_queue.cc:1048] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.212671 12064 leader_election.cc:290] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:49.213968 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:49.213934 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667dc4151b7b455b9434a014c3d5831c" is_pre_election: true
I20260709 13:02:49.216569 11845 leader_election.cc:304] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:49.217567 12064 raft_consensus.cc:2749] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.225258 11804 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.237129 12076 consensus_queue.cc:1048] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.390215   431 ts_manager.cc:295] Set tserver state for 667dc4151b7b455b9434a014c3d5831c to MAINTENANCE_MODE
I20260709 13:02:49.391192   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:49.429786 12064 consensus_queue.cc:1048] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:49.442332 11878 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.442665   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:49.444638   431 tablet_replica.cc:333] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.445668   431 raft_consensus.cc:2243] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.446382   431 raft_consensus.cc:2272] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:49.451323 11845 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 216 similar messages]
W20260709 13:02:49.456183 11845 consensus_peers.cc:597] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.459710   431 tablet_replica.cc:333] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.460943   431 raft_consensus.cc:2243] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.461632   431 raft_consensus.cc:2272] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.468976   431 tablet_replica.cc:333] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.470086   431 raft_consensus.cc:2243] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.470799   431 raft_consensus.cc:2272] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.475097   431 tablet_replica.cc:333] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.476112   431 raft_consensus.cc:2243] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:49.477540   431 raft_consensus.cc:2272] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.483724   431 tablet_replica.cc:333] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.484580   431 raft_consensus.cc:2243] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:49.484483 11919 consensus_peers.cc:597] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.485301   431 raft_consensus.cc:2272] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:49.487178 11919 consensus_peers.cc:597] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.488576   431 tablet_replica.cc:333] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.489853   431 raft_consensus.cc:2243] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.490502   431 raft_consensus.cc:2272] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.493223   431 tablet_replica.cc:333] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.493891   431 raft_consensus.cc:2243] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.494381   431 raft_consensus.cc:2272] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.497586   431 tablet_replica.cc:333] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.498183   431 raft_consensus.cc:2243] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.498595   431 raft_consensus.cc:2272] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.501394   431 tablet_replica.cc:333] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.502333   431 raft_consensus.cc:2243] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:49.503228   431 raft_consensus.cc:2272] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.506397   431 tablet_replica.cc:333] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: stopping tablet replica
I20260709 13:02:49.507126   431 raft_consensus.cc:2243] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:49.508260   431 raft_consensus.cc:2272] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:49.519881 11919 consensus_peers.cc:597] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.522361 12076 consensus_queue.cc:1048] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:49.562060 11919 consensus_peers.cc:597] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.563023   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:49.631837 11919 consensus_peers.cc:597] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:49.729195 11919 consensus_peers.cc:597] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:49.836843 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:50.685927 12027 raft_consensus.cc:493] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.686554 12027 raft_consensus.cc:515] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.688575 12027 leader_election.cc:290] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:50.690063 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:50.692020 12093 raft_consensus.cc:493] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.692556 12093 raft_consensus.cc:515] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
W20260709 13:02:50.693549 11845 leader_election.cc:336] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.694244 11845 leader_election.cc:304] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:50.695190 12093 leader_election.cc:290] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:50.695966 12027 raft_consensus.cc:2749] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:50.696539 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:50.697363 11878 raft_consensus.cc:2468] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:50.698695 11918 leader_election.cc:304] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:50.699642 12093 raft_consensus.cc:2804] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:50.699878 11919 leader_election.cc:336] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.700049 12093 raft_consensus.cc:493] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.700479 12093 raft_consensus.cc:3060] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.706398 12093 raft_consensus.cc:515] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.708212 12093 leader_election.cc:290] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:50.709506 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e0b85a18d648009b6ff5f220264339" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:50.710173 11878 raft_consensus.cc:3060] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:50.712904 11919 leader_election.cc:336] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.716514 11878 raft_consensus.cc:2468] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 2.
I20260709 13:02:50.718294 11918 leader_election.cc:304] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:50.719367 12093 raft_consensus.cc:2804] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:50.720228 12093 raft_consensus.cc:697] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:50.721150 12093 consensus_queue.cc:237] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.731489 11699 catalog_manager.cc:5697] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 1 to 2, leader changed from 667dc4151b7b455b9434a014c3d5831c (127.0.107.193) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.778241 12093 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.778967 12093 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.781071 12093 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:50.782280 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
W20260709 13:02:50.785660 11919 leader_election.cc:336] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.786159 11919 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:50.786926 12093 raft_consensus.cc:2749] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:50.838356 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:50.839622 12096 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.840262 12096 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.842303 12096 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:50.844467 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
W20260709 13:02:50.846721 11845 leader_election.cc:336] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.847142 11845 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:50.847842 12096 raft_consensus.cc:2749] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:50.858237 12093 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.858868 12093 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.860955 12093 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:50.862411 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" is_pre_election: true
I20260709 13:02:50.863121 11878 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 1.
I20260709 13:02:50.864408 11918 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:50.865371 12093 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.865800 12093 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
W20260709 13:02:50.865975 11919 leader_election.cc:336] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.866114 12093 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.872273 12093 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.874364 12093 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:50.876058 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:50.876957 11878 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:50.878674 11919 leader_election.cc:336] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.884562 11878 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 2.
I20260709 13:02:50.886955 11918 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:50.888693 12093 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:50.889287 12093 raft_consensus.cc:697] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:50.890100 12093 consensus_queue.cc:237] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.900758 11699 catalog_manager.cc:5697] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 1 to 2, leader changed from 667dc4151b7b455b9434a014c3d5831c (127.0.107.193) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.970988 12096 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.971855 12096 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.976076 12096 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:50.977501 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" is_pre_election: true
I20260709 13:02:50.978423 11951 raft_consensus.cc:2468] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 1.
I20260709 13:02:50.979691 11843 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:50.980885 12096 raft_consensus.cc:2804] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:50.981009 11845 leader_election.cc:336] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:50.981524 12096 raft_consensus.cc:493] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 667dc4151b7b455b9434a014c3d5831c)
I20260709 13:02:50.981994 12096 raft_consensus.cc:3060] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.990099 12096 raft_consensus.cc:515] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:50.992204 12096 leader_election.cc:290] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:50.993500 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af25e663eb64fdaa97fd3e9bcc22093" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:50.994261 11951 raft_consensus.cc:3060] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:50.997189 11845 leader_election.cc:336] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111)
I20260709 13:02:51.002334 11951 raft_consensus.cc:2468] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:51.004033 11843 leader_election.cc:304] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 667dc4151b7b455b9434a014c3d5831c
I20260709 13:02:51.005411 12096 raft_consensus.cc:2804] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.006031 12096 raft_consensus.cc:697] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:51.007184 12096 consensus_queue.cc:237] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:51.016943 11699 catalog_manager.cc:5697] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from 667dc4151b7b455b9434a014c3d5831c (127.0.107.193) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.106069 11878 raft_consensus.cc:1275] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.107963 12033 consensus_queue.cc:1048] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:51.130218 11919 consensus_peers.cc:597] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:51.294600 11919 consensus_peers.cc:597] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.395938 11878 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.397691 12093 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:51.540931 11951 raft_consensus.cc:1275] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.542668 12027 consensus_queue.cc:1048] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:51.559934 11845 consensus_peers.cc:597] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:51.721146 11919 consensus_peers.cc:597] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.741361 11845 consensus_peers.cc:597] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.840058 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:51.960515 11919 consensus_peers.cc:597] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:52.084282 11919 consensus_peers.cc:597] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:52.086531 11919 consensus_peers.cc:597] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:52.247175 11919 consensus_peers.cc:597] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:52.578013 11919 consensus_peers.cc:597] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:52.841357 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:53.649422 11919 consensus_peers.cc:597] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:53.838145 11845 consensus_peers.cc:597] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:53.842653 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:53.884179 11919 consensus_peers.cc:597] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:54.217480 11919 consensus_peers.cc:597] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.427474 11845 consensus_peers.cc:597] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.429111 11919 consensus_peers.cc:597] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.453526 11919 consensus_peers.cc:597] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.456374 11845 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111) [suppressed 100 similar messages]
W20260709 13:02:54.468305 11919 consensus_peers.cc:597] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:54.587642   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:54.597198 12116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:54.598825 12118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:54.598946 12115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:54.602476   431 server_base.cc:1061] running on GCE node
I20260709 13:02:54.605093   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:54.605443   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:54.605693   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602174605661 us; error 0 us; skew 500 ppm
I20260709 13:02:54.606431   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:54.609707   431 webserver.cc:533] Webserver started at http://127.0.107.193:37719/ using document root <none> and password file <none>
I20260709 13:02:54.610350   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:54.610528   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:54.616321   431 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:02:54.621372 12123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:54.622649   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:02:54.623052   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "667dc4151b7b455b9434a014c3d5831c"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-fc6v"
I20260709 13:02:54.623354   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:54.663247   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:54.664433   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:54.666066   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:54.669975 12130 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:02:54.752175   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:02:54.752518   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:02:54.752902   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:02:54.758023 12130 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
W20260709 13:02:54.765921 11919 consensus_peers.cc:597] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:54.775465 12130 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.776754 12130 tablet_bootstrap.cc:492] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.777508 12130 ts_tablet_manager.cc:1403] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:02:54.780226 12130 raft_consensus.cc:359] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.780963 12130 raft_consensus.cc:740] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.781731 12130 consensus_queue.cc:260] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.784521 12130 ts_tablet_manager.cc:1434] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:54.785507 12130 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.796630   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:02:54.796962   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.042s	sys 0.001s
I20260709 13:02:54.804895 12130 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.806897 12130 tablet_bootstrap.cc:492] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.808085 12130 ts_tablet_manager.cc:1403] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 13:02:54.811091 12130 raft_consensus.cc:359] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.812101 12130 raft_consensus.cc:740] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.813436 12130 consensus_queue.cc:260] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.815835 12130 ts_tablet_manager.cc:1434] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:02:54.817942 12130 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.838358 12130 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.839725 12130 tablet_bootstrap.cc:492] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.840680 12130 ts_tablet_manager.cc:1403] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
W20260709 13:02:54.844026 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:54.844311 12130 raft_consensus.cc:359] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.845392 12130 raft_consensus.cc:740] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.846364 12130 consensus_queue.cc:260] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.848505 12130 ts_tablet_manager.cc:1434] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:54.849619 12130 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
W20260709 13:02:54.851163 11919 consensus_peers.cc:597] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:54.861788   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40099
I20260709 13:02:54.862064 12190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40099 every 8 connection(s)
I20260709 13:02:54.867504   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:54.868382 12130 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.869494 12130 tablet_bootstrap.cc:492] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.872219 12130 ts_tablet_manager.cc:1403] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:02:54.875588 12130 raft_consensus.cc:359] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.876432 12130 raft_consensus.cc:740] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.877224 12130 consensus_queue.cc:260] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.879933 12130 ts_tablet_manager.cc:1434] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:02:54.881083 12130 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.898276 12192 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45963
I20260709 13:02:54.898895 12192 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:54.899922 12130 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.899994 12192 heartbeater.cc:507] Master 127.0.107.254:45963 requested a full tablet report, sending...
I20260709 13:02:54.900967 12130 tablet_bootstrap.cc:492] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.901388 11953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:54.901856 12130 ts_tablet_manager.cc:1403] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:02:54.902101 11953 raft_consensus.cc:606] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:54.904937 11953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:54.904918 12130 raft_consensus.cc:359] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.905850 12130 raft_consensus.cc:740] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.905839 11953 raft_consensus.cc:606] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:54.907027 12130 consensus_queue.cc:260] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.907960 11700 ts_manager.cc:194] Re-registered known tserver with Master: 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099)
I20260709 13:02:54.909723 12130 ts_tablet_manager.cc:1434] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:54.911144 12130 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.910954 11953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:54.911944 11953 raft_consensus.cc:606] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:54.915236 11951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:54.915812 11951 raft_consensus.cc:606] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:54.917129   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:54.918035   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:54.918915   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:54.922832 11700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47740
I20260709 13:02:54.926995 12192 heartbeater.cc:499] Master 127.0.107.254:45963 was elected leader, sending a full tablet report...
I20260709 13:02:54.932211 12130 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.933089 12130 tablet_bootstrap.cc:492] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.933982 12130 ts_tablet_manager.cc:1403] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:02:54.936404 12130 raft_consensus.cc:359] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.937009 12130 raft_consensus.cc:740] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.937860 12130 consensus_queue.cc:260] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.939780 12130 ts_tablet_manager.cc:1434] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:54.940465 12130 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.951138 12130 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.952033 12130 tablet_bootstrap.cc:492] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.952775 12130 ts_tablet_manager.cc:1403] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:02:54.954882 12130 raft_consensus.cc:359] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.955380 12130 raft_consensus.cc:740] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.956018 12130 consensus_queue.cc:260] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.957597 12130 ts_tablet_manager.cc:1434] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:02:54.958642 12130 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.974457 12130 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.975208 12130 tablet_bootstrap.cc:492] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.975834 12130 ts_tablet_manager.cc:1403] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:02:54.978199 12130 raft_consensus.cc:359] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.978905 12130 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.979640 12130 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.981290 12130 ts_tablet_manager.cc:1434] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:02:54.981985 12130 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:54.994673 12130 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.995395 12130 tablet_bootstrap.cc:492] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:54.995986 12130 ts_tablet_manager.cc:1403] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:02:54.997766 12130 raft_consensus.cc:359] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:54.998225 12130 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:54.998879 12130 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.000970 12130 ts_tablet_manager.cc:1434] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:55.001991 12130 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap starting.
I20260709 13:02:55.016064 12130 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.016805 12130 tablet_bootstrap.cc:492] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Bootstrap complete.
I20260709 13:02:55.017347 12130 ts_tablet_manager.cc:1403] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:02:55.019481 12130 raft_consensus.cc:359] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.020177 12130 raft_consensus.cc:740] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667dc4151b7b455b9434a014c3d5831c, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.020874 12130 consensus_queue.cc:260] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.022017 12165 raft_consensus.cc:3060] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.022719 12130 ts_tablet_manager.cc:1434] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:55.038400 12112 raft_consensus.cc:993] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.039053 12208 raft_consensus.cc:1081] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.041415 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:55.042145 11878 raft_consensus.cc:493] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.042487 11878 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.048035 11878 raft_consensus.cc:515] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.049710 11878 leader_election.cc:290] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:55.051054 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:55.051486 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:55.051827 11951 raft_consensus.cc:3055] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.052337 11951 raft_consensus.cc:740] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:55.052380 12165 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.053279 11951 consensus_queue.cc:260] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.054432 11951 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.060209 12165 raft_consensus.cc:2468] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:55.060235 11951 raft_consensus.cc:2468] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:55.061848 11845 leader_election.cc:304] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:55.062767 12110 raft_consensus.cc:2804] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.064235 12110 raft_consensus.cc:697] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:55.065243 12110 consensus_queue.cc:237] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.074365 11700 catalog_manager.cc:5697] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.183456 12112 raft_consensus.cc:993] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.184389 12208 raft_consensus.cc:1081] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.187108 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:55.187808 11878 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.188458 11878 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.197088 11878 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.200026 11878 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:55.200752 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:55.201576 12165 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.203964 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:55.204761 11951 raft_consensus.cc:3055] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.205106 11951 raft_consensus.cc:740] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:55.206205 12208 raft_consensus.cc:993] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.206061 11951 consensus_queue.cc:260] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.206979 12112 raft_consensus.cc:1081] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.207682 11951 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.210026 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:55.210888 11878 raft_consensus.cc:493] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.211354 11878 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.212250 12165 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:55.214437 11845 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:55.215489 12110 raft_consensus.cc:2804] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.216167 12110 raft_consensus.cc:697] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:55.217206 12110 consensus_queue.cc:237] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.218787 11951 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:55.220477 11878 raft_consensus.cc:515] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.274012 11878 leader_election.cc:290] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:55.281471 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:55.289218 11951 raft_consensus.cc:3055] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.290062 11951 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:55.292366 11951 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.295981 11951 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.293335 12166 raft_consensus.cc:3060] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.301143 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:55.302569 12165 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.302834 11700 catalog_manager.cc:5697] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.319653 12165 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:55.321832 11845 leader_election.cc:304] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:55.322034 11951 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:55.325749 12110 raft_consensus.cc:2804] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.326431 12110 raft_consensus.cc:697] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:55.328064 12110 consensus_queue.cc:237] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.341087 11700 catalog_manager.cc:5697] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.389343 12166 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.444272 12220 raft_consensus.cc:993] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.445590 12112 raft_consensus.cc:1081] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:55.448041 11879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:55.449028 11879 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.449601 11879 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.462939 11879 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.465073 11879 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 3 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:55.466490 12166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:55.466490 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:55.467655 12166 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.467657 11951 raft_consensus.cc:3055] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.468287 11951 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:55.469506 11951 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.471295 11951 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.478470 12166 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 3.
I20260709 13:02:55.480278 11845 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:55.481678 12221 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.482236 12221 raft_consensus.cc:697] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:55.482761 11951 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 3.
I20260709 13:02:55.483382 12221 consensus_queue.cc:237] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.493607 11700 catalog_manager.cc:5697] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 2 to 3, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.629659 11951 raft_consensus.cc:1275] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.631423 12221 consensus_queue.cc:1048] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:55.638514 12166 raft_consensus.cc:1275] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.640586 12221 consensus_queue.cc:1048] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:55.657557 12165 raft_consensus.cc:1275] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.661582 12221 consensus_queue.cc:1048] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:55.668004 11951 raft_consensus.cc:1275] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.674414 12221 consensus_queue.cc:1048] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.762984 12165 raft_consensus.cc:1275] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.764605 12221 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.776999 11951 raft_consensus.cc:1275] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.779246 12209 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:55.845571 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:55.930742   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.940667 12165 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.942658 12209 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:02:55.959175 11951 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.961205 12209 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:55.964301 11879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
mode: GRACEFUL
new_leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:54734
I20260709 13:02:55.965119 11879 raft_consensus.cc:606] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Received request to transfer leadership to TS dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:55.969539 11879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
mode: GRACEFUL
new_leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:54734
I20260709 13:02:55.970252 11879 raft_consensus.cc:606] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 LEADER]: Received request to transfer leadership to TS dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:55.971576   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:55.971824 12221 raft_consensus.cc:993] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: : Instructing follower dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:55.972383   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:55.972496 12221 raft_consensus.cc:1081] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 LEADER]: Signalling peer dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:55.973692   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.974619 11951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:02:55.975306 11951 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.975800 11951 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.986794 11951 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.990154 11951 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 4 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:55.990680 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:55.991127 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:55.991518 12165 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.991937 11879 raft_consensus.cc:3055] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:55.992370 11879 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:55.993453 11879 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:55.995102 11879 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.000576 12165 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 4.
I20260709 13:02:56.002394 11919 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:56.003435 12112 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:56.004050 12112 raft_consensus.cc:697] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:56.004663 11879 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 4.
I20260709 13:02:56.004905 12112 consensus_queue.cc:237] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:56.014158 11702 catalog_manager.cc:5697] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 3 to 4, leader changed from ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 4 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.153442 12221 raft_consensus.cc:993] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: : Instructing follower dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:56.154317 12209 raft_consensus.cc:1081] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Signalling peer dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:56.156315 11951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:02:56.156942 11951 raft_consensus.cc:493] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.157259 11951 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.164184 11951 raft_consensus.cc:515] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:56.166283 11951 leader_election.cc:290] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:56.167591 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:56.167932 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f6945c769c4dd89aa05840c35b83a7" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:56.168390 12165 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.168613 11879 raft_consensus.cc:3055] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:56.169075 11879 raft_consensus.cc:740] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:56.169909 11879 consensus_queue.cc:260] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:56.171104 11879 raft_consensus.cc:3060] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.175930 12165 raft_consensus.cc:2468] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:56.177383 11919 leader_election.cc:304] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:56.178328 12112 raft_consensus.cc:2804] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.178960 12112 raft_consensus.cc:697] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:56.180261 12112 consensus_queue.cc:237] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:56.180553 11879 raft_consensus.cc:2468] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:56.187886 11702 catalog_manager.cc:5697] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 2 to 3, leader changed from ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.387125 11879 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:56.388981 12112 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.400905 12165 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:56.402895 12237 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:56.700032 11879 raft_consensus.cc:1275] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.701649 12237 consensus_queue.cc:1048] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.714893 12165 raft_consensus.cc:1275] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.718091 12220 consensus_queue.cc:1048] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:56.846953 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:56.985632   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:56.994709 11951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:56.995450 11951 raft_consensus.cc:606] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:56.998782 11951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d4b7daf9414564b07594628075aeab"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:56.999399 11951 raft_consensus.cc:606] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:57.002826 11879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
mode: GRACEFUL
new_leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:54734
I20260709 13:02:57.003654 11879 raft_consensus.cc:606] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Received request to transfer leadership to TS dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:57.005158   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:57.005810   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:57.006541   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:57.059638 12240 raft_consensus.cc:993] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: : Instructing follower dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:57.060411 12221 raft_consensus.cc:1081] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Signalling peer dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:57.062337 11951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:02:57.062896 11951 raft_consensus.cc:493] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.063167 11951 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.069986 11951 raft_consensus.cc:515] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.071769 11951 leader_election.cc:290] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:57.072990 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:57.072983 11879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:57.074045 12165 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.074111 11879 raft_consensus.cc:3055] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:57.074648 11879 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:57.075713 11879 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.077189 11879 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.084120 12165 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:57.085960 11919 leader_election.cc:304] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:57.086802 12220 raft_consensus.cc:2804] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:57.086797 11879 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:57.087726 12220 raft_consensus.cc:697] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:57.088778 12220 consensus_queue.cc:237] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.097904 11699 catalog_manager.cc:5697] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 2 to 3, leader changed from ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.317356 12220 raft_consensus.cc:993] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:57.317888 12237 raft_consensus.cc:1081] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:57.320420 11879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:57.321198 11879 raft_consensus.cc:493] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.321703 11879 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.324469 12220 raft_consensus.cc:993] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:57.325155 12220 raft_consensus.cc:1081] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:57.327152 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d4b7daf9414564b07594628075aeab"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:57.327730 11878 raft_consensus.cc:493] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.328063 11878 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.331490 11879 raft_consensus.cc:515] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.334344 11879 leader_election.cc:290] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:57.335911 11951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:57.335750 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:57.336908 11951 raft_consensus.cc:3055] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.337008 12165 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.337396 11951 raft_consensus.cc:740] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:57.338020 11878 raft_consensus.cc:515] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.338721 11951 consensus_queue.cc:260] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.340353 11878 leader_election.cc:290] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:57.340500 11951 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.341796 12166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:57.342567 12166 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.345116 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:57.345922 11953 raft_consensus.cc:3055] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.346318 11953 raft_consensus.cc:740] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:57.347375 11953 consensus_queue.cc:260] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.348948 11953 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.349489 11951 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:57.349489 12165 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:57.351267 11845 leader_election.cc:304] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:57.352367 12166 raft_consensus.cc:2468] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:57.352408 12221 raft_consensus.cc:2804] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.353541 12221 raft_consensus.cc:697] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:57.355125 11845 leader_election.cc:304] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:57.355234 12221 consensus_queue.cc:237] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.356998 12240 raft_consensus.cc:2804] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.358565 12240 raft_consensus.cc:697] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:57.360083 12240 consensus_queue.cc:237] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:57.361195 11953 raft_consensus.cc:2468] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:57.368858 11699 catalog_manager.cc:5697] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.385212 11699 catalog_manager.cc:5697] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.546806 11878 raft_consensus.cc:1275] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:57.548480 12237 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:57.560714 12166 raft_consensus.cc:1275] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:57.562603 12220 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:57.769224 11953 raft_consensus.cc:1275] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.770874 12240 consensus_queue.cc:1048] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.777313 11951 raft_consensus.cc:1275] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.778963 12221 consensus_queue.cc:1048] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:57.783056 12166 raft_consensus.cc:1275] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.785167 12255 consensus_queue.cc:1048] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:57.794641 12165 raft_consensus.cc:1275] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.796685 12255 consensus_queue.cc:1048] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:57.848217 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:58.014757   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:58.024499 11953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "585f463389d34b7fa4e21584926d3130"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:58.025609 11953 raft_consensus.cc:606] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:58.028780 11878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
mode: GRACEFUL
new_leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:54734
I20260709 13:02:58.029318 11878 raft_consensus.cc:606] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Received request to transfer leadership to TS dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:58.032258 11878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d4b7daf9414564b07594628075aeab"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
mode: GRACEFUL
new_leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:54734
I20260709 13:02:58.032753 11878 raft_consensus.cc:606] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Received request to transfer leadership to TS dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:58.033978   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:58.034580   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:58.035374   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:58.205942 12259 raft_consensus.cc:993] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:58.206568 12259 raft_consensus.cc:1081] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:58.208612 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "585f463389d34b7fa4e21584926d3130"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:58.209316 11878 raft_consensus.cc:493] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.209782 11878 raft_consensus.cc:3060] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.216038 11878 raft_consensus.cc:515] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.217723 11878 leader_election.cc:290] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:58.218994 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:58.219074 12166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585f463389d34b7fa4e21584926d3130" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:58.219687 11953 raft_consensus.cc:3055] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.219961 12166 raft_consensus.cc:3060] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.220100 11953 raft_consensus.cc:740] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:58.221104 11953 consensus_queue.cc:260] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.222277 11953 raft_consensus.cc:3060] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.229104 12166 raft_consensus.cc:2468] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:58.229301 11953 raft_consensus.cc:2468] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 2.
I20260709 13:02:58.230707 11843 leader_election.cc:304] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:58.231566 12245 raft_consensus.cc:2804] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.232015 12245 raft_consensus.cc:697] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:58.232818 12245 consensus_queue.cc:237] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.241771 11699 catalog_manager.cc:5697] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 1 to 2, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.258303 12255 raft_consensus.cc:993] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: : Instructing follower dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:58.259104 12245 raft_consensus.cc:1081] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Signalling peer dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:58.261096 11953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d4b7daf9414564b07594628075aeab"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:02:58.261677 11953 raft_consensus.cc:493] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.261989 11953 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.267212 11953 raft_consensus.cc:515] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.270284 12166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:58.270820 11953 leader_election.cc:290] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:58.270964 12166 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.270402 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d4b7daf9414564b07594628075aeab" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:58.272975 11878 raft_consensus.cc:3055] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.273339 11878 raft_consensus.cc:740] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:58.274143 11878 consensus_queue.cc:260] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.275594 11878 raft_consensus.cc:3060] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.278281 12166 raft_consensus.cc:2468] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:58.279532 11919 leader_election.cc:304] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:58.280313 12259 raft_consensus.cc:2804] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.280755 12259 raft_consensus.cc:697] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:58.281534 12259 consensus_queue.cc:237] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.282579 11878 raft_consensus.cc:2468] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:58.288678 11699 catalog_manager.cc:5697] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 2 to 3, leader changed from ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.529575 12255 raft_consensus.cc:993] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: : Instructing follower dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:58.530040 12245 raft_consensus.cc:1081] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Signalling peer dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:58.531738 11953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:02:58.532258 11953 raft_consensus.cc:493] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.532572 11953 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.538254 11953 raft_consensus.cc:515] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.540278 11953 leader_election.cc:290] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:58.541230 12166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:58.541380 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74af904bb996489bb3b4f76453d2b697" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:58.541975 12166 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.542078 11878 raft_consensus.cc:3055] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.542527 11878 raft_consensus.cc:740] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:58.543308 11878 consensus_queue.cc:260] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.544394 11878 raft_consensus.cc:3060] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.547895 12166 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:58.549240 11919 leader_election.cc:304] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, dbab3b47fdc64b5a9ba664ef3563e22e; no voters: 
I20260709 13:02:58.550209 12259 raft_consensus.cc:2804] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.550365 11878 raft_consensus.cc:2468] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:58.550773 12259 raft_consensus.cc:697] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:58.552023 12259 consensus_queue.cc:237] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:58.559906 11699 catalog_manager.cc:5697] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 2 to 3, leader changed from ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.617256 12166 raft_consensus.cc:1275] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.618965 12245 consensus_queue.cc:1048] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.630728 11953 raft_consensus.cc:1275] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.633237 12245 consensus_queue.cc:1048] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.711256 12166 raft_consensus.cc:1275] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.712986 12259 consensus_queue.cc:1048] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.721756 11878 raft_consensus.cc:1275] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.723379 12271 consensus_queue.cc:1048] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:58.849412 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:58.938963 12166 raft_consensus.cc:1275] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.940975 12259 consensus_queue.cc:1048] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.952566 11878 raft_consensus.cc:1275] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.954784 12259 consensus_queue.cc:1048] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:59.044377   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:59.052230 11953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:59.053256 11953 raft_consensus.cc:606] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:59.056938 11878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
mode: GRACEFUL
new_leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:54734
I20260709 13:02:59.057574 11878 raft_consensus.cc:606] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Received request to transfer leadership to TS dbab3b47fdc64b5a9ba664ef3563e22e
I20260709 13:02:59.060729 11953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
mode: GRACEFUL
new_leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:59.061363 11953 raft_consensus.cc:606] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Received request to transfer leadership to TS ea5c74e7c5e24ba89e57c326f23fdeb3
I20260709 13:02:59.062891   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:59.063604   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:59.064359   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:59.271301 12271 raft_consensus.cc:993] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:59.271921 12271 raft_consensus.cc:1081] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:59.273696 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:59.274294 11878 raft_consensus.cc:493] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.274575 11878 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.281080 11878 raft_consensus.cc:515] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.283007 11878 leader_election.cc:290] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 5 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:59.284029 12166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:59.284893 12166 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.285000 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9baa5e81334089beec28feb8de421e" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:59.285640 11953 raft_consensus.cc:3055] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:59.285877 11953 raft_consensus.cc:740] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:59.286710 11953 consensus_queue.cc:260] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.287946 11953 raft_consensus.cc:3060] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.292198 12166 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 5.
I20260709 13:02:59.293885 11845 leader_election.cc:304] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:59.294947 12245 raft_consensus.cc:2804] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:59.295019 11953 raft_consensus.cc:2468] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 5.
I20260709 13:02:59.295660 12245 raft_consensus.cc:697] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 5 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:59.296733 12245 consensus_queue.cc:237] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.307019 11699 catalog_manager.cc:5697] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 4 to 5, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.424837 12245 raft_consensus.cc:993] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: : Instructing follower dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:59.425621 12240 raft_consensus.cc:1081] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Signalling peer dbab3b47fdc64b5a9ba664ef3563e22e to start an election
I20260709 13:02:59.427312 11953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630"
dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:02:59.427959 11953 raft_consensus.cc:493] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.428292 11953 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.435298 11953 raft_consensus.cc:515] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.437386 11953 leader_election.cc:290] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139)
I20260709 13:02:59.438541 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:59.438565 11878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b20b8b9a451408eb852d77e0eb9e630" candidate_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
I20260709 13:02:59.439390 12165 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.439447 11878 raft_consensus.cc:3055] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:59.439978 11878 raft_consensus.cc:740] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:59.440737 11878 consensus_queue.cc:260] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.441779 11878 raft_consensus.cc:3060] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.447336 11878 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:59.447799 12165 raft_consensus.cc:2468] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbab3b47fdc64b5a9ba664ef3563e22e in term 3.
I20260709 13:02:59.448963 11918 leader_election.cc:304] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbab3b47fdc64b5a9ba664ef3563e22e, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:59.449993 12259 raft_consensus.cc:2804] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:59.450583 12259 raft_consensus.cc:697] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Becoming Leader. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:59.451514 12259 consensus_queue.cc:237] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.460084 11699 catalog_manager.cc:5697] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e reported cstate change: term changed from 2 to 3, leader changed from ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194) to dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.615625 12271 raft_consensus.cc:993] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: : Instructing follower ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:59.622292 12259 raft_consensus.cc:1081] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Signalling peer ea5c74e7c5e24ba89e57c326f23fdeb3 to start an election
I20260709 13:02:59.625487 11878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa"
dest_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:02:59.626315 11878 raft_consensus.cc:493] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.626873 11878 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.634305 11878 raft_consensus.cc:515] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.636107 11878 leader_election.cc:290] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 4 election: Requested vote from peers 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099), dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195:34033)
I20260709 13:02:59.637104 11953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e"
I20260709 13:02:59.637099 12165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b84c2b6c6c49b7a3d62deacb9251fa" candidate_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "667dc4151b7b455b9434a014c3d5831c"
I20260709 13:02:59.637887 11953 raft_consensus.cc:3055] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:59.637984 12165 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.638175 11953 raft_consensus.cc:740] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbab3b47fdc64b5a9ba664ef3563e22e, State: Running, Role: LEADER
I20260709 13:02:59.639052 11953 consensus_queue.cc:260] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.640268 11953 raft_consensus.cc:3060] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.645864 12165 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 4.
I20260709 13:02:59.646243 11953 raft_consensus.cc:2468] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5c74e7c5e24ba89e57c326f23fdeb3 in term 4.
I20260709 13:02:59.647362 11845 leader_election.cc:304] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667dc4151b7b455b9434a014c3d5831c, ea5c74e7c5e24ba89e57c326f23fdeb3; no voters: 
I20260709 13:02:59.648267 12240 raft_consensus.cc:2804] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:59.648751 12240 raft_consensus.cc:697] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 LEADER]: Becoming Leader. State: Replica: ea5c74e7c5e24ba89e57c326f23fdeb3, State: Running, Role: LEADER
I20260709 13:02:59.649598 12240 consensus_queue.cc:237] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } }
I20260709 13:02:59.657524 11699 catalog_manager.cc:5697] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 reported cstate change: term changed from 3 to 4, leader changed from dbab3b47fdc64b5a9ba664ef3563e22e (127.0.107.195) to ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.676070 12165 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 5 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:59.677510 12240 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.690306 11953 raft_consensus.cc:1275] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 5 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:59.692068 12284 consensus_queue.cc:1048] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:59.850594 11750 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:59.915462 12165 raft_consensus.cc:1275] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:59.917169 12259 consensus_queue.cc:1048] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.928045 11878 raft_consensus.cc:1275] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Refusing update from remote peer dbab3b47fdc64b5a9ba664ef3563e22e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:59.930063 12259 consensus_queue.cc:1048] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5c74e7c5e24ba89e57c326f23fdeb3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:00.067962 12165 raft_consensus.cc:1275] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:00.069720 12284 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667dc4151b7b455b9434a014c3d5831c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.073717   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.081130 11953 raft_consensus.cc:1275] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Refusing update from remote peer ea5c74e7c5e24ba89e57c326f23fdeb3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:00.084622 12240 consensus_queue.cc:1048] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbab3b47fdc64b5a9ba664ef3563e22e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:00.128742   431 tablet_server.cc:179] TabletServer@127.0.107.193:40099 shutting down...
W20260709 13:03:00.154289 11919 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 13:03:00.160652 11919 consensus_peers.cc:597] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.171007   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:00.172322   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.173307   431 raft_consensus.cc:2243] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.173957   431 raft_consensus.cc:2272] T 1af25e663eb64fdaa97fd3e9bcc22093 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.176975   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.177812   431 raft_consensus.cc:2243] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.178382   431 raft_consensus.cc:2272] T 86b84c2b6c6c49b7a3d62deacb9251fa P 667dc4151b7b455b9434a014c3d5831c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.181803   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.182752   431 raft_consensus.cc:2243] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.183418   431 raft_consensus.cc:2272] T 74af904bb996489bb3b4f76453d2b697 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.186292   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.186978   431 raft_consensus.cc:2243] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.187585   431 raft_consensus.cc:2272] T 79d4b7daf9414564b07594628075aeab P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.190187   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.190930   431 raft_consensus.cc:2243] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.191644   431 raft_consensus.cc:2272] T c8ca8912d5a34ff1ae00114fbd176620 P 667dc4151b7b455b9434a014c3d5831c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.194840   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.195631   431 raft_consensus.cc:2243] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.196408   431 raft_consensus.cc:2272] T c2e0b85a18d648009b6ff5f220264339 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.198429 11919 consensus_peers.cc:597] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.199932   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.200738   431 raft_consensus.cc:2243] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.201264   431 raft_consensus.cc:2272] T 08f6945c769c4dd89aa05840c35b83a7 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.204193   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.205006   431 raft_consensus.cc:2243] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.205624   431 raft_consensus.cc:2272] T 3a9baa5e81334089beec28feb8de421e P 667dc4151b7b455b9434a014c3d5831c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.209287   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:00.210261 11845 consensus_peers.cc:597] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.210323   431 raft_consensus.cc:2243] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.211349   431 raft_consensus.cc:2272] T 6b20b8b9a451408eb852d77e0eb9e630 P 667dc4151b7b455b9434a014c3d5831c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.215430   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:00.216485   431 raft_consensus.cc:2243] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.217257   431 raft_consensus.cc:2272] T 585f463389d34b7fa4e21584926d3130 P 667dc4151b7b455b9434a014c3d5831c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.230875 11845 consensus_peers.cc:597] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.260823   431 tablet_server.cc:196] TabletServer@127.0.107.193:40099 shutdown complete.
W20260709 13:03:00.282598 11919 consensus_peers.cc:597] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.296954   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:00.329893 11918 consensus_peers.cc:597] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Couldn't send request to peer ea5c74e7c5e24ba89e57c326f23fdeb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.334316   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:00.335928   431 tablet_replica.cc:333] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.336999   431 raft_consensus.cc:2243] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.337589   431 raft_consensus.cc:2272] T 79d4b7daf9414564b07594628075aeab P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.340611   431 tablet_replica.cc:333] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.341769   431 raft_consensus.cc:2243] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.342329   431 raft_consensus.cc:2272] T 74af904bb996489bb3b4f76453d2b697 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.345343   431 tablet_replica.cc:333] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.346959   431 raft_consensus.cc:2243] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.347703   431 raft_consensus.cc:2272] T 08f6945c769c4dd89aa05840c35b83a7 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.351846   431 tablet_replica.cc:333] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
W20260709 13:03:00.352523 11918 consensus_peers.cc:597] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Couldn't send request to peer ea5c74e7c5e24ba89e57c326f23fdeb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.352931   431 raft_consensus.cc:2243] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.354599   431 raft_consensus.cc:2272] T c8ca8912d5a34ff1ae00114fbd176620 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.358691   431 tablet_replica.cc:333] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.359952   431 raft_consensus.cc:2243] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.361119   431 raft_consensus.cc:2272] T c2e0b85a18d648009b6ff5f220264339 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.361297 11918 consensus_peers.cc:597] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Couldn't send request to peer ea5c74e7c5e24ba89e57c326f23fdeb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:00.365869 11918 consensus_peers.cc:597] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Couldn't send request to peer ea5c74e7c5e24ba89e57c326f23fdeb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.366127   431 tablet_replica.cc:333] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
W20260709 13:03:00.368191 11918 consensus_peers.cc:597] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer ea5c74e7c5e24ba89e57c326f23fdeb3 (127.0.107.194:36139): Couldn't send request to peer ea5c74e7c5e24ba89e57c326f23fdeb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.368628   431 raft_consensus.cc:2243] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.370086   431 raft_consensus.cc:2272] T 3a9baa5e81334089beec28feb8de421e P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.374228 11919 consensus_peers.cc:597] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.374572   431 tablet_replica.cc:333] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.375658   431 raft_consensus.cc:2243] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.376252   431 raft_consensus.cc:2272] T 6b20b8b9a451408eb852d77e0eb9e630 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.379436 11919 consensus_peers.cc:597] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e -> Peer 667dc4151b7b455b9434a014c3d5831c (127.0.107.193:40099): Couldn't send request to peer 667dc4151b7b455b9434a014c3d5831c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.380337   431 tablet_replica.cc:333] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.381059   431 raft_consensus.cc:2243] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.382575   431 raft_consensus.cc:2272] T 585f463389d34b7fa4e21584926d3130 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.385777   431 tablet_replica.cc:333] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.386566   431 raft_consensus.cc:2243] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.387854   431 raft_consensus.cc:2272] T 86b84c2b6c6c49b7a3d62deacb9251fa P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.390966   431 tablet_replica.cc:333] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3: stopping tablet replica
I20260709 13:03:00.391721   431 raft_consensus.cc:2243] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.392838   431 raft_consensus.cc:2272] T 1af25e663eb64fdaa97fd3e9bcc22093 P ea5c74e7c5e24ba89e57c326f23fdeb3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.437060   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:00.469756   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:00.509637   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:00.510561   431 tablet_replica.cc:333] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.512005   431 raft_consensus.cc:2243] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.513610   431 raft_consensus.cc:2272] T 74af904bb996489bb3b4f76453d2b697 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.516561   431 tablet_replica.cc:333] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.517341   431 raft_consensus.cc:2243] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.518487   431 raft_consensus.cc:2272] T 08f6945c769c4dd89aa05840c35b83a7 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.521217   431 tablet_replica.cc:333] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.521934   431 raft_consensus.cc:2243] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.522696   431 raft_consensus.cc:2272] T 1af25e663eb64fdaa97fd3e9bcc22093 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.525314   431 tablet_replica.cc:333] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.525899   431 raft_consensus.cc:2243] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.526676   431 raft_consensus.cc:2272] T 79d4b7daf9414564b07594628075aeab P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.529873   431 tablet_replica.cc:333] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.530609   431 raft_consensus.cc:2243] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.531150   431 raft_consensus.cc:2272] T 585f463389d34b7fa4e21584926d3130 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.534770   431 tablet_replica.cc:333] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.535486   431 raft_consensus.cc:2243] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.536065   431 raft_consensus.cc:2272] T c8ca8912d5a34ff1ae00114fbd176620 P dbab3b47fdc64b5a9ba664ef3563e22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.538414   431 tablet_replica.cc:333] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.538880   431 raft_consensus.cc:2243] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.540320   431 raft_consensus.cc:2272] T c2e0b85a18d648009b6ff5f220264339 P dbab3b47fdc64b5a9ba664ef3563e22e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.543941   431 tablet_replica.cc:333] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.544715   431 raft_consensus.cc:2243] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.545764   431 raft_consensus.cc:2272] T 6b20b8b9a451408eb852d77e0eb9e630 P dbab3b47fdc64b5a9ba664ef3563e22e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.549062   431 tablet_replica.cc:333] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.549722   431 raft_consensus.cc:2243] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.550284   431 raft_consensus.cc:2272] T 3a9baa5e81334089beec28feb8de421e P dbab3b47fdc64b5a9ba664ef3563e22e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.553872   431 tablet_replica.cc:333] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e: stopping tablet replica
I20260709 13:03:00.554503   431 raft_consensus.cc:2243] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.554975   431 raft_consensus.cc:2272] T 86b84c2b6c6c49b7a3d62deacb9251fa P dbab3b47fdc64b5a9ba664ef3563e22e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.597244   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:00.631065   431 master.cc:562] Master@127.0.107.254:45963 shutting down...
I20260709 13:03:00.663185   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.663971   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.664338   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P e6b59a7246e84cccbc13a671058fb075: stopping tablet replica
I20260709 13:03:00.689677   431 master.cc:584] Master@127.0.107.254:45963 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14183 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:03:00.744307   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:44019
I20260709 13:03:00.745643   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:00.753666 12299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:00.753711 12298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:00.754511 12301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:00.756217   431 server_base.cc:1061] running on GCE node
I20260709 13:03:00.757542   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:00.757807   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:00.758034   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602180758014 us; error 0 us; skew 500 ppm
I20260709 13:03:00.758721   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:00.762346   431 webserver.cc:533] Webserver started at http://127.0.107.254:35387/ using document root <none> and password file <none>
I20260709 13:03:00.763090   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:00.763280   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:00.763666   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:00.765316   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "b994feebb2024b67ab9bade65831d789"
format_stamp: "Formatted at 2026-07-09 13:03:00 on dist-test-slave-fc6v"
I20260709 13:03:00.771106   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:03:00.775508 12306 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:00.776822   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:00.777451   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "b994feebb2024b67ab9bade65831d789"
format_stamp: "Formatted at 2026-07-09 13:03:00 on dist-test-slave-fc6v"
I20260709 13:03:00.778139   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:00.800014   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:00.801865   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:00.855278   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:44019
I20260709 13:03:00.855465 12357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:44019 every 8 connection(s)
I20260709 13:03:00.860358 12358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.876978 12358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789: Bootstrap starting.
I20260709 13:03:00.883325 12358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:00.889793 12358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789: No bootstrap required, opened a new log
I20260709 13:03:00.892632 12358 raft_consensus.cc:359] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b994feebb2024b67ab9bade65831d789" member_type: VOTER }
I20260709 13:03:00.893147 12358 raft_consensus.cc:385] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:00.893453 12358 raft_consensus.cc:740] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b994feebb2024b67ab9bade65831d789, State: Initialized, Role: FOLLOWER
I20260709 13:03:00.894172 12358 consensus_queue.cc:260] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b994feebb2024b67ab9bade65831d789" member_type: VOTER }
I20260709 13:03:00.894760 12358 raft_consensus.cc:399] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:00.895012 12358 raft_consensus.cc:493] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:00.895349 12358 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:00.902652 12358 raft_consensus.cc:515] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b994feebb2024b67ab9bade65831d789" member_type: VOTER }
I20260709 13:03:00.903643 12358 leader_election.cc:304] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b994feebb2024b67ab9bade65831d789; no voters: 
I20260709 13:03:00.905131 12358 leader_election.cc:290] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:00.905622 12361 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:00.907325 12361 raft_consensus.cc:697] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 1 LEADER]: Becoming Leader. State: Replica: b994feebb2024b67ab9bade65831d789, State: Running, Role: LEADER
I20260709 13:03:00.908222 12361 consensus_queue.cc:237] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b994feebb2024b67ab9bade65831d789" member_type: VOTER }
I20260709 13:03:00.909410 12358 sys_catalog.cc:565] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:00.914327 12362 sys_catalog.cc:455] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b994feebb2024b67ab9bade65831d789" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b994feebb2024b67ab9bade65831d789" member_type: VOTER } }
I20260709 13:03:00.915532 12362 sys_catalog.cc:458] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:00.915035 12363 sys_catalog.cc:455] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b994feebb2024b67ab9bade65831d789. Latest consensus state: current_term: 1 leader_uuid: "b994feebb2024b67ab9bade65831d789" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b994feebb2024b67ab9bade65831d789" member_type: VOTER } }
I20260709 13:03:00.916350 12363 sys_catalog.cc:458] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:00.924326 12368 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:00.930255 12368 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:00.932756   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:00.942710 12368 catalog_manager.cc:1383] Generated new cluster ID: a9eb7e9aa9624dc5a31cb5bab88fb3ca
I20260709 13:03:00.943142 12368 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:00.974611 12368 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:00.976338 12368 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:00.995705 12368 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789: Generated new TSK 0
I20260709 13:03:00.996416 12368 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:01.065269   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:01.073002 12379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.074440 12380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.076810 12382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.076946   431 server_base.cc:1061] running on GCE node
I20260709 13:03:01.078382   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:01.078687   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:01.078912   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602181078882 us; error 0 us; skew 500 ppm
I20260709 13:03:01.079640   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:01.083366   431 webserver.cc:533] Webserver started at http://127.0.107.193:37223/ using document root <none> and password file <none>
I20260709 13:03:01.084249   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:01.084522   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:01.084868   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:01.086349   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "a9b4951f54814c19b17d0fdc60d79d06"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-fc6v"
I20260709 13:03:01.092375   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:03:01.097393 12387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.098625   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:03:01.099076   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "a9b4951f54814c19b17d0fdc60d79d06"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-fc6v"
I20260709 13:03:01.099444   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:01.113781   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:01.115723   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:01.117686   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:01.121026   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:01.121276   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.121652   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:01.121838   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.183985   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38257
I20260709 13:03:01.184130 12449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38257 every 8 connection(s)
I20260709 13:03:01.190268   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:01.199805 12454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.201563 12455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.204833   431 server_base.cc:1061] running on GCE node
W20260709 13:03:01.205307 12458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.206681 12450 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44019
I20260709 13:03:01.207309   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:01.207326 12450 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:01.207882   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:01.208122   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602181208101 us; error 0 us; skew 500 ppm
I20260709 13:03:01.208771 12450 heartbeater.cc:507] Master 127.0.107.254:44019 requested a full tablet report, sending...
I20260709 13:03:01.208982   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:01.212345 12323 ts_manager.cc:194] Registered new tserver with Master: a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257)
I20260709 13:03:01.212807   431 webserver.cc:533] Webserver started at http://127.0.107.194:41313/ using document root <none> and password file <none>
I20260709 13:03:01.213611   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:01.213846   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:01.214176   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:01.214985 12323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43032
I20260709 13:03:01.215886   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-fc6v"
I20260709 13:03:01.223165   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:01.227728 12462 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.228835   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:01.229205   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-fc6v"
I20260709 13:03:01.230038   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:01.250502   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:01.252311   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:01.254449   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:01.257586   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:01.257911   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.258203   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:01.258402   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.320103   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39669
I20260709 13:03:01.320333 12524 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39669 every 8 connection(s)
I20260709 13:03:01.326056   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:01.336720 12528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.337150 12529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.340865 12531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.341804   431 server_base.cc:1061] running on GCE node
I20260709 13:03:01.343127 12525 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44019
I20260709 13:03:01.343228   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:01.343976   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:01.344103 12525 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:01.344215   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602181344192 us; error 0 us; skew 500 ppm
I20260709 13:03:01.345314   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:01.345439 12525 heartbeater.cc:507] Master 127.0.107.254:44019 requested a full tablet report, sending...
I20260709 13:03:01.348852 12323 ts_manager.cc:194] Registered new tserver with Master: c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:01.349198   431 webserver.cc:533] Webserver started at http://127.0.107.195:39453/ using document root <none> and password file <none>
I20260709 13:03:01.349951   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:01.350203   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:01.350504   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:01.350893 12323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43042
I20260709 13:03:01.352022   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-fc6v"
I20260709 13:03:01.358215   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:01.363197 12536 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.364567   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:03:01.364998   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-fc6v"
I20260709 13:03:01.365361   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:01.377995   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:01.379733   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:01.381996   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:01.385421   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:01.385763   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.386051   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:01.386261   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.441862   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41703
I20260709 13:03:01.441977 12598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41703 every 8 connection(s)
I20260709 13:03:01.459334 12599 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44019
I20260709 13:03:01.459960 12599 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:01.460924 12599 heartbeater.cc:507] Master 127.0.107.254:44019 requested a full tablet report, sending...
I20260709 13:03:01.463505 12323 ts_manager.cc:194] Registered new tserver with Master: ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703)
I20260709 13:03:01.463869   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017955615s
I20260709 13:03:01.465284 12323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43044
I20260709 13:03:01.499105 12323 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43054:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:01.502341 12323 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:01.574496 12564 tablet_service.cc:1511] Processing CreateTablet for tablet b9fe3c34857d4c5db87643d9b8167dfb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8579faacce6245f88e3fc4034fc6e11f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:01.576414 12564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fe3c34857d4c5db87643d9b8167dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.576629 12415 tablet_service.cc:1511] Processing CreateTablet for tablet b9fe3c34857d4c5db87643d9b8167dfb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8579faacce6245f88e3fc4034fc6e11f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:01.578239 12415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fe3c34857d4c5db87643d9b8167dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.578434 12414 tablet_service.cc:1511] Processing CreateTablet for tablet c3db860bdf3f457781a3b6769189ba57 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8579faacce6245f88e3fc4034fc6e11f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:01.574713 12563 tablet_service.cc:1511] Processing CreateTablet for tablet c3db860bdf3f457781a3b6769189ba57 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8579faacce6245f88e3fc4034fc6e11f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:01.579742 12414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3db860bdf3f457781a3b6769189ba57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.580677 12563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3db860bdf3f457781a3b6769189ba57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.596498 12490 tablet_service.cc:1511] Processing CreateTablet for tablet b9fe3c34857d4c5db87643d9b8167dfb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8579faacce6245f88e3fc4034fc6e11f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:01.597723 12489 tablet_service.cc:1511] Processing CreateTablet for tablet c3db860bdf3f457781a3b6769189ba57 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8579faacce6245f88e3fc4034fc6e11f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:01.598439 12490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fe3c34857d4c5db87643d9b8167dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.599191 12489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3db860bdf3f457781a3b6769189ba57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.616712 12617 tablet_bootstrap.cc:492] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: Bootstrap starting.
I20260709 13:03:01.628599 12617 tablet_bootstrap.cc:654] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.628569 12618 tablet_bootstrap.cc:492] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06: Bootstrap starting.
I20260709 13:03:01.639604 12618 tablet_bootstrap.cc:654] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.644469 12617 tablet_bootstrap.cc:492] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: No bootstrap required, opened a new log
I20260709 13:03:01.645303 12617 ts_tablet_manager.cc:1403] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.009s
I20260709 13:03:01.651845 12620 tablet_bootstrap.cc:492] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f: Bootstrap starting.
I20260709 13:03:01.650612 12617 raft_consensus.cc:359] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.652444 12617 raft_consensus.cc:385] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.652802 12617 raft_consensus.cc:740] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.654318 12618 tablet_bootstrap.cc:492] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06: No bootstrap required, opened a new log
I20260709 13:03:01.654014 12617 consensus_queue.cc:260] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.654956 12618 ts_tablet_manager.cc:1403] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.003s
I20260709 13:03:01.658421 12599 heartbeater.cc:499] Master 127.0.107.254:44019 was elected leader, sending a full tablet report...
I20260709 13:03:01.658850 12617 ts_tablet_manager.cc:1434] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:03:01.659327 12618 raft_consensus.cc:359] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.660089 12617 tablet_bootstrap.cc:492] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9: Bootstrap starting.
I20260709 13:03:01.660205 12618 raft_consensus.cc:385] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.660651 12618 raft_consensus.cc:740] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.661738 12618 consensus_queue.cc:260] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.662151 12620 tablet_bootstrap.cc:654] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.662221 12622 raft_consensus.cc:493] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.668449 12622 raft_consensus.cc:515] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.683943 12622 leader_election.cc:290] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:01.689466 12617 tablet_bootstrap.cc:654] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.700752 12618 ts_tablet_manager.cc:1434] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06: Time spent starting tablet: real 0.045s	user 0.016s	sys 0.028s
I20260709 13:03:01.701782 12450 heartbeater.cc:499] Master 127.0.107.254:44019 was elected leader, sending a full tablet report...
I20260709 13:03:01.704494 12620 tablet_bootstrap.cc:492] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f: No bootstrap required, opened a new log
I20260709 13:03:01.708194 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06" is_pre_election: true
I20260709 13:03:01.709295 12425 raft_consensus.cc:2468] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 0.
I20260709 13:03:01.710546 12620 ts_tablet_manager.cc:1403] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.021s
I20260709 13:03:01.712751 12538 leader_election.cc:304] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, ad0700e0d82b43e2a267fd9ed42536e9; no voters: 
I20260709 13:03:01.714267 12618 tablet_bootstrap.cc:492] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06: Bootstrap starting.
I20260709 13:03:01.714849 12622 raft_consensus.cc:2804] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.715343 12622 raft_consensus.cc:493] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.715744 12622 raft_consensus.cc:3060] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.721994 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" is_pre_election: true
W20260709 13:03:01.724553 12539 leader_election.cc:343] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.721967 12620 raft_consensus.cc:359] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.725804 12620 raft_consensus.cc:385] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.724509 12618 tablet_bootstrap.cc:654] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.726198 12620 raft_consensus.cc:740] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c4a6f3a7494a0e82b38c596e84ec7f, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.727149 12620 consensus_queue.cc:260] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.733062 12525 heartbeater.cc:499] Master 127.0.107.254:44019 was elected leader, sending a full tablet report...
I20260709 13:03:01.734026 12620 ts_tablet_manager.cc:1434] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:03:01.737356 12620 tablet_bootstrap.cc:492] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f: Bootstrap starting.
I20260709 13:03:01.742347 12617 tablet_bootstrap.cc:492] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9: No bootstrap required, opened a new log
I20260709 13:03:01.743368 12617 ts_tablet_manager.cc:1403] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.008s
I20260709 13:03:01.744282 12618 tablet_bootstrap.cc:492] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06: No bootstrap required, opened a new log
I20260709 13:03:01.744980 12618 ts_tablet_manager.cc:1403] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.012s
I20260709 13:03:01.746976 12622 raft_consensus.cc:515] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.747166 12617 raft_consensus.cc:359] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.748472 12617 raft_consensus.cc:385] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.749014 12617 raft_consensus.cc:740] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.748911 12618 raft_consensus.cc:359] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.749941 12618 raft_consensus.cc:385] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.750155 12617 consensus_queue.cc:260] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.752446 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
I20260709 13:03:01.753443 12425 raft_consensus.cc:3060] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.754591 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
W20260709 13:03:01.757236 12539 leader_election.cc:343] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.758036 12622 leader_election.cc:290] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:01.761566 12620 tablet_bootstrap.cc:654] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.767829 12618 raft_consensus.cc:740] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.770838 12425 raft_consensus.cc:2468] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 1.
I20260709 13:03:01.770072 12618 consensus_queue.cc:260] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.772686 12538 leader_election.cc:304] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, ad0700e0d82b43e2a267fd9ed42536e9; no voters: c2c4a6f3a7494a0e82b38c596e84ec7f
I20260709 13:03:01.774523 12622 raft_consensus.cc:2804] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:01.774755 12618 ts_tablet_manager.cc:1434] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:03:01.775178 12622 raft_consensus.cc:697] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Becoming Leader. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Running, Role: LEADER
I20260709 13:03:01.776422 12622 consensus_queue.cc:237] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.783448 12620 tablet_bootstrap.cc:492] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f: No bootstrap required, opened a new log
I20260709 13:03:01.785761 12620 ts_tablet_manager.cc:1403] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.006s
I20260709 13:03:01.789474 12617 ts_tablet_manager.cc:1434] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9: Time spent starting tablet: real 0.046s	user 0.016s	sys 0.027s
I20260709 13:03:01.790431 12620 raft_consensus.cc:359] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.791466 12620 raft_consensus.cc:385] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.791854 12620 raft_consensus.cc:740] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c4a6f3a7494a0e82b38c596e84ec7f, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.792655 12620 consensus_queue.cc:260] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.795297 12620 ts_tablet_manager.cc:1434] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:03:01.802361 12321 catalog_manager.cc:5697] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.825294 12622 raft_consensus.cc:493] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.825882 12622 raft_consensus.cc:515] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.828094 12622 leader_election.cc:290] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:01.829631 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3db860bdf3f457781a3b6769189ba57" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" is_pre_election: true
I20260709 13:03:01.829631 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3db860bdf3f457781a3b6769189ba57" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06" is_pre_election: true
I20260709 13:03:01.830961 12500 raft_consensus.cc:2468] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 0.
I20260709 13:03:01.831073 12425 raft_consensus.cc:2468] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 0.
I20260709 13:03:01.832576 12539 leader_election.cc:304] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad0700e0d82b43e2a267fd9ed42536e9, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:01.833508 12622 raft_consensus.cc:2804] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.833963 12622 raft_consensus.cc:493] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.834257 12622 raft_consensus.cc:3060] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.841961 12622 raft_consensus.cc:515] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.844194 12622 leader_election.cc:290] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:01.845449 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3db860bdf3f457781a3b6769189ba57" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
I20260709 13:03:01.845454 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3db860bdf3f457781a3b6769189ba57" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
I20260709 13:03:01.846231 12425 raft_consensus.cc:3060] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.846371 12500 raft_consensus.cc:3060] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.853797 12500 raft_consensus.cc:2468] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 1.
I20260709 13:03:01.853793 12425 raft_consensus.cc:2468] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 1.
I20260709 13:03:01.855304 12539 leader_election.cc:304] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad0700e0d82b43e2a267fd9ed42536e9, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:01.856325 12622 raft_consensus.cc:2804] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:01.856851 12622 raft_consensus.cc:697] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Becoming Leader. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Running, Role: LEADER
I20260709 13:03:01.857758 12622 consensus_queue.cc:237] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:01.866031 12322 catalog_manager.cc:5697] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.938447 12322 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43062:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:01.940893 12322 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:01.959875 12627 raft_consensus.cc:493] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.960798 12627 raft_consensus.cc:515] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:01.966253 12627 leader_election.cc:290] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703), a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257)
I20260709 13:03:01.971190 12414 tablet_service.cc:1511] Processing CreateTablet for tablet 53daaa44faab49649e3c5d10c25aaed0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2c932068c87248b7b4c16dc943eb8a0e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:01.972981 12414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53daaa44faab49649e3c5d10c25aaed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.976842 12490 tablet_service.cc:1511] Processing CreateTablet for tablet 53daaa44faab49649e3c5d10c25aaed0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2c932068c87248b7b4c16dc943eb8a0e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:01.978421 12490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53daaa44faab49649e3c5d10c25aaed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.981742 12563 tablet_service.cc:1511] Processing CreateTablet for tablet 53daaa44faab49649e3c5d10c25aaed0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2c932068c87248b7b4c16dc943eb8a0e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:01.985090 12574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" is_pre_election: true
I20260709 13:03:01.989157 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06" is_pre_election: true
I20260709 13:03:01.989343 12489 tablet_service.cc:1511] Processing CreateTablet for tablet 2812cf21f2024d08b9f5f38a58f568bc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2c932068c87248b7b4c16dc943eb8a0e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:01.988847 12415 tablet_service.cc:1511] Processing CreateTablet for tablet 2812cf21f2024d08b9f5f38a58f568bc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2c932068c87248b7b4c16dc943eb8a0e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:01.990160 12425 raft_consensus.cc:2393] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2c4a6f3a7494a0e82b38c596e84ec7f in current term 1: Already voted for candidate ad0700e0d82b43e2a267fd9ed42536e9 in this term.
I20260709 13:03:01.990734 12415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2812cf21f2024d08b9f5f38a58f568bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.990746 12489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2812cf21f2024d08b9f5f38a58f568bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.983428 12563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53daaa44faab49649e3c5d10c25aaed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.991945 12466 leader_election.cc:304] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: a9b4951f54814c19b17d0fdc60d79d06, ad0700e0d82b43e2a267fd9ed42536e9
I20260709 13:03:01.995056 12564 tablet_service.cc:1511] Processing CreateTablet for tablet 2812cf21f2024d08b9f5f38a58f568bc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2c932068c87248b7b4c16dc943eb8a0e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:01.996644 12564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2812cf21f2024d08b9f5f38a58f568bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:02.001057 12627 raft_consensus.cc:3060] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.012262 12620 tablet_bootstrap.cc:492] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f: Bootstrap starting.
I20260709 13:03:02.021677 12617 tablet_bootstrap.cc:492] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: Bootstrap starting.
I20260709 13:03:02.022379 12618 tablet_bootstrap.cc:492] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06: Bootstrap starting.
I20260709 13:03:02.024693 12620 tablet_bootstrap.cc:654] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.030115 12618 tablet_bootstrap.cc:654] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.030838 12627 raft_consensus.cc:2749] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:02.031657 12617 tablet_bootstrap.cc:654] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.041831 12620 tablet_bootstrap.cc:492] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f: No bootstrap required, opened a new log
I20260709 13:03:02.042613 12620 ts_tablet_manager.cc:1403] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 13:03:02.046871 12618 tablet_bootstrap.cc:492] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06: No bootstrap required, opened a new log
I20260709 13:03:02.047657 12618 ts_tablet_manager.cc:1403] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.015s
I20260709 13:03:02.050181 12617 tablet_bootstrap.cc:492] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: No bootstrap required, opened a new log
I20260709 13:03:02.051055 12617 ts_tablet_manager.cc:1403] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:03:02.053402 12620 raft_consensus.cc:359] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.054400 12620 raft_consensus.cc:385] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.054740 12620 raft_consensus.cc:740] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c4a6f3a7494a0e82b38c596e84ec7f, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.054538 12617 raft_consensus.cc:359] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.055517 12617 raft_consensus.cc:385] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.051429 12618 raft_consensus.cc:359] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.056103 12617 raft_consensus.cc:740] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.056398 12618 raft_consensus.cc:385] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.055990 12620 consensus_queue.cc:260] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.056772 12618 raft_consensus.cc:740] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.057682 12618 consensus_queue.cc:260] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.057143 12617 consensus_queue.cc:260] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.060065 12618 ts_tablet_manager.cc:1434] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:02.060318 12622 raft_consensus.cc:493] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.060861 12622 raft_consensus.cc:515] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.061299 12618 tablet_bootstrap.cc:492] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: Bootstrap starting.
I20260709 13:03:02.062961 12620 ts_tablet_manager.cc:1434] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:03:02.064355 12620 tablet_bootstrap.cc:492] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: Bootstrap starting.
I20260709 13:03:02.066963 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06" is_pre_election: true
I20260709 13:03:02.067996 12425 raft_consensus.cc:2468] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 0.
I20260709 13:03:02.070112 12618 tablet_bootstrap.cc:654] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.069948 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" is_pre_election: true
I20260709 13:03:02.070833 12500 raft_consensus.cc:2468] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 0.
I20260709 13:03:02.073091 12617 ts_tablet_manager.cc:1434] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:03:02.074391 12617 tablet_bootstrap.cc:492] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9: Bootstrap starting.
I20260709 13:03:02.074092 12538 leader_election.cc:304] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, ad0700e0d82b43e2a267fd9ed42536e9; no voters: 
I20260709 13:03:02.076035 12629 raft_consensus.cc:2804] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:02.076498 12629 raft_consensus.cc:493] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.076719 12620 tablet_bootstrap.cc:654] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.076911 12629 raft_consensus.cc:3060] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.071085 12622 leader_election.cc:290] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:02.087775 12629 raft_consensus.cc:515] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.091251 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
I20260709 13:03:02.091984 12425 raft_consensus.cc:3060] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.100819 12618 tablet_bootstrap.cc:492] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: No bootstrap required, opened a new log
I20260709 13:03:02.102038 12425 raft_consensus.cc:2468] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 1.
I20260709 13:03:02.101979 12618 ts_tablet_manager.cc:1403] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.006s
I20260709 13:03:02.102205 12629 leader_election.cc:290] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:02.103829 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0" candidate_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
I20260709 13:03:02.104677 12617 tablet_bootstrap.cc:654] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.105005 12500 raft_consensus.cc:3060] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.106900 12620 tablet_bootstrap.cc:492] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: No bootstrap required, opened a new log
I20260709 13:03:02.106508 12618 raft_consensus.cc:359] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.107391 12618 raft_consensus.cc:385] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.107589 12620 ts_tablet_manager.cc:1403] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.008s
I20260709 13:03:02.107798 12618 raft_consensus.cc:740] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.103945 12538 leader_election.cc:304] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, ad0700e0d82b43e2a267fd9ed42536e9; no voters: 
I20260709 13:03:02.108841 12618 consensus_queue.cc:260] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.109597 12622 raft_consensus.cc:2804] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.111487 12618 ts_tablet_manager.cc:1434] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:03:02.111267 12620 raft_consensus.cc:359] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.112320 12620 raft_consensus.cc:385] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.112701 12620 raft_consensus.cc:740] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c4a6f3a7494a0e82b38c596e84ec7f, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.113587 12620 consensus_queue.cc:260] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.125183 12620 ts_tablet_manager.cc:1434] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:03:02.125545 12622 raft_consensus.cc:697] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Becoming Leader. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Running, Role: LEADER
I20260709 13:03:02.126801 12622 consensus_queue.cc:237] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.130962 12617 tablet_bootstrap.cc:492] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9: No bootstrap required, opened a new log
I20260709 13:03:02.131933 12617 ts_tablet_manager.cc:1403] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.008s
I20260709 13:03:02.135097 12500 raft_consensus.cc:2468] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0700e0d82b43e2a267fd9ed42536e9 in term 1.
I20260709 13:03:02.140250 12617 raft_consensus.cc:359] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.141168 12617 raft_consensus.cc:385] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.141508 12617 raft_consensus.cc:740] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.142382 12617 consensus_queue.cc:260] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.143348 12623 raft_consensus.cc:493] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.144062 12623 raft_consensus.cc:515] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.143870 12322 catalog_manager.cc:5697] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.145315 12617 ts_tablet_manager.cc:1434] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:03:02.146795 12623 leader_election.cc:290] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669), ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703)
I20260709 13:03:02.162914 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" is_pre_election: true
I20260709 13:03:02.163684 12574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" is_pre_election: true
I20260709 13:03:02.163897 12500 raft_consensus.cc:2468] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 0.
I20260709 13:03:02.164422 12574 raft_consensus.cc:2468] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 0.
I20260709 13:03:02.165297 12390 leader_election.cc:304] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:02.166518 12623 raft_consensus.cc:2804] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:02.167181 12623 raft_consensus.cc:493] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.167640 12623 raft_consensus.cc:3060] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.174427 12623 raft_consensus.cc:515] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.176570 12623 leader_election.cc:290] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 1 election: Requested vote from peers c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669), ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703)
I20260709 13:03:02.177742 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
I20260709 13:03:02.177991 12574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
I20260709 13:03:02.178510 12500 raft_consensus.cc:3060] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.178673 12574 raft_consensus.cc:3060] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.186782 12500 raft_consensus.cc:2468] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 1.
I20260709 13:03:02.187307 12574 raft_consensus.cc:2468] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 1.
I20260709 13:03:02.188171 12390 leader_election.cc:304] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:02.189234 12623 raft_consensus.cc:2804] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.190398 12623 raft_consensus.cc:697] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 LEADER]: Becoming Leader. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Running, Role: LEADER
I20260709 13:03:02.191352 12623 consensus_queue.cc:237] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.202020 12322 catalog_manager.cc:5697] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "a9b4951f54814c19b17d0fdc60d79d06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.221213 12622 consensus_queue.cc:1048] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.246217 12646 consensus_queue.cc:1048] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.250077 12629 consensus_queue.cc:1048] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.265668 12574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb"
dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
mode: GRACEFUL
new_leader_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
 from {username='slave'} at 127.0.0.1:52682
I20260709 13:03:02.266469 12574 raft_consensus.cc:606] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Received request to transfer leadership to TS a9b4951f54814c19b17d0fdc60d79d06
I20260709 13:03:02.270538 12622 consensus_queue.cc:1048] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.279969 12646 raft_consensus.cc:993] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: : Instructing follower a9b4951f54814c19b17d0fdc60d79d06 to start an election
I20260709 13:03:02.280571 12646 raft_consensus.cc:1081] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Signalling peer a9b4951f54814c19b17d0fdc60d79d06 to start an election
I20260709 13:03:02.281343 12574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0"
dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
mode: GRACEFUL
new_leader_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
 from {username='slave'} at 127.0.0.1:52682
I20260709 13:03:02.282140 12574 raft_consensus.cc:606] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Received request to transfer leadership to TS a9b4951f54814c19b17d0fdc60d79d06
I20260709 13:03:02.282924 12423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb"
dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
 from {username='slave'} at 127.0.0.1:53080
I20260709 13:03:02.283728 12423 raft_consensus.cc:493] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.284144 12423 raft_consensus.cc:3060] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.296281 12423 raft_consensus.cc:515] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:02.299966 12574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
I20260709 13:03:02.300130 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe3c34857d4c5db87643d9b8167dfb" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
I20260709 13:03:02.301046 12574 raft_consensus.cc:3055] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:02.301290 12500 raft_consensus.cc:3060] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.301523 12574 raft_consensus.cc:740] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Running, Role: LEADER
I20260709 13:03:02.302596 12574 consensus_queue.cc:260] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:02.304039 12574 raft_consensus.cc:3060] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.299935 12423 leader_election.cc:290] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 2 election: Requested vote from peers ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703), c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669)
I20260709 13:03:02.313395 12500 raft_consensus.cc:2468] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 2.
I20260709 13:03:02.313846 12574 raft_consensus.cc:2468] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 2.
I20260709 13:03:02.315131 12390 leader_election.cc:304] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:02.316402 12623 raft_consensus.cc:2804] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:02.317001 12623 raft_consensus.cc:697] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 2 LEADER]: Becoming Leader. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Running, Role: LEADER
I20260709 13:03:02.317963 12623 consensus_queue.cc:237] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } }
I20260709 13:03:02.325639 12323 catalog_manager.cc:5697] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 reported cstate change: term changed from 1 to 2, leader changed from ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195) to a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a9b4951f54814c19b17d0fdc60d79d06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.596508 12623 consensus_queue.cc:1048] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.611507 12661 consensus_queue.cc:1048] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.722136 12622 consensus_queue.cc:1048] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.735894 12499 raft_consensus.cc:1275] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Refusing update from remote peer a9b4951f54814c19b17d0fdc60d79d06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:02.737223 12629 consensus_queue.cc:1048] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.737859 12650 consensus_queue.cc:1048] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:02.749480 12574 raft_consensus.cc:1275] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Refusing update from remote peer a9b4951f54814c19b17d0fdc60d79d06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:02.751605 12661 consensus_queue.cc:1048] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:02.757831 12646 raft_consensus.cc:993] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: : Instructing follower a9b4951f54814c19b17d0fdc60d79d06 to start an election
I20260709 13:03:02.758395 12622 raft_consensus.cc:1081] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Signalling peer a9b4951f54814c19b17d0fdc60d79d06 to start an election
I20260709 13:03:02.761379 12423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0"
dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
 from {username='slave'} at 127.0.0.1:53080
I20260709 13:03:02.762135 12423 raft_consensus.cc:493] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.762566 12423 raft_consensus.cc:3060] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.772526 12423 raft_consensus.cc:515] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.774966 12423 leader_election.cc:290] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 2 election: Requested vote from peers c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194:39669), ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703)
I20260709 13:03:02.775741 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
I20260709 13:03:02.776348 12574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53daaa44faab49649e3c5d10c25aaed0" candidate_uuid: "a9b4951f54814c19b17d0fdc60d79d06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
I20260709 13:03:02.776526 12500 raft_consensus.cc:3060] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.776999 12574 raft_consensus.cc:3055] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:02.777366 12574 raft_consensus.cc:740] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad0700e0d82b43e2a267fd9ed42536e9, State: Running, Role: LEADER
I20260709 13:03:02.778285 12574 consensus_queue.cc:260] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.779611 12574 raft_consensus.cc:3060] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.785342 12500 raft_consensus.cc:2468] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 2.
I20260709 13:03:02.786813 12390 leader_election.cc:304] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4951f54814c19b17d0fdc60d79d06, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:02.787793 12623 raft_consensus.cc:2804] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:02.788405 12623 raft_consensus.cc:697] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 2 LEADER]: Becoming Leader. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Running, Role: LEADER
I20260709 13:03:02.788215 12574 raft_consensus.cc:2468] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4951f54814c19b17d0fdc60d79d06 in term 2.
I20260709 13:03:02.789425 12623 consensus_queue.cc:237] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:02.798120 12321 catalog_manager.cc:5697] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 reported cstate change: term changed from 1 to 2, leader changed from ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195) to a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "a9b4951f54814c19b17d0fdc60d79d06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.083091   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:03:03.084856   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:03:03.085292   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:03:03.099476 12423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc"
dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
mode: GRACEFUL
new_leader_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:03:03.100224 12423 raft_consensus.cc:606] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 LEADER]: Received request to transfer leadership to TS c2c4a6f3a7494a0e82b38c596e84ec7f
I20260709 13:03:03.101883   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:03:03.142089 12661 raft_consensus.cc:993] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: : Instructing follower c2c4a6f3a7494a0e82b38c596e84ec7f to start an election
I20260709 13:03:03.142684 12623 raft_consensus.cc:1081] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 LEADER]: Signalling peer c2c4a6f3a7494a0e82b38c596e84ec7f to start an election
I20260709 13:03:03.144491 12500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc"
dest_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f"
 from {username='slave'} at 127.0.0.1:41154
I20260709 13:03:03.145228 12500 raft_consensus.cc:493] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.145646 12500 raft_consensus.cc:3060] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.152544 12500 raft_consensus.cc:515] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:03.154695 12500 leader_election.cc:290] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [CANDIDATE]: Term 2 election: Requested vote from peers a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193:38257), ad0700e0d82b43e2a267fd9ed42536e9 (127.0.107.195:41703)
I20260709 13:03:03.155817 12423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc" candidate_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b4951f54814c19b17d0fdc60d79d06"
I20260709 13:03:03.155953 12574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812cf21f2024d08b9f5f38a58f568bc" candidate_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad0700e0d82b43e2a267fd9ed42536e9"
I20260709 13:03:03.156867 12423 raft_consensus.cc:3055] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:03.156908 12574 raft_consensus.cc:3060] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.157485 12423 raft_consensus.cc:740] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b4951f54814c19b17d0fdc60d79d06, State: Running, Role: LEADER
I20260709 13:03:03.158437 12423 consensus_queue.cc:260] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:03.159797 12423 raft_consensus.cc:3060] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.165355 12574 raft_consensus.cc:2468] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c4a6f3a7494a0e82b38c596e84ec7f in term 2.
I20260709 13:03:03.166963 12466 leader_election.cc:304] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad0700e0d82b43e2a267fd9ed42536e9, c2c4a6f3a7494a0e82b38c596e84ec7f; no voters: 
I20260709 13:03:03.168077 12627 raft_consensus.cc:2804] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:03.168885 12423 raft_consensus.cc:2468] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c4a6f3a7494a0e82b38c596e84ec7f in term 2.
I20260709 13:03:03.169363 12627 raft_consensus.cc:697] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 LEADER]: Becoming Leader. State: Replica: c2c4a6f3a7494a0e82b38c596e84ec7f, State: Running, Role: LEADER
I20260709 13:03:03.170632 12627 consensus_queue.cc:237] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } }
I20260709 13:03:03.179394 12321 catalog_manager.cc:5697] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f reported cstate change: term changed from 1 to 2, leader changed from a9b4951f54814c19b17d0fdc60d79d06 (127.0.107.193) to c2c4a6f3a7494a0e82b38c596e84ec7f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4951f54814c19b17d0fdc60d79d06" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c4a6f3a7494a0e82b38c596e84ec7f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.221007   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:03.253400 12574 raft_consensus.cc:1275] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Refusing update from remote peer a9b4951f54814c19b17d0fdc60d79d06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.255115   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:03.255774 12623 consensus_queue.cc:1048] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad0700e0d82b43e2a267fd9ed42536e9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.256213   431 tablet_replica.cc:333] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06: stopping tablet replica
I20260709 13:03:03.257354   431 raft_consensus.cc:2243] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.258008   431 raft_consensus.cc:2272] T 2812cf21f2024d08b9f5f38a58f568bc P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.261832   431 tablet_replica.cc:333] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06: stopping tablet replica
I20260709 13:03:03.262723   431 raft_consensus.cc:2243] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.269344   431 raft_consensus.cc:2272] T 53daaa44faab49649e3c5d10c25aaed0 P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.272497   431 tablet_replica.cc:333] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06: stopping tablet replica
I20260709 13:03:03.273159   431 raft_consensus.cc:2243] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.273658   431 raft_consensus.cc:2272] T c3db860bdf3f457781a3b6769189ba57 P a9b4951f54814c19b17d0fdc60d79d06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.276467   431 tablet_replica.cc:333] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06: stopping tablet replica
I20260709 13:03:03.277073   431 raft_consensus.cc:2243] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.278100   431 raft_consensus.cc:2272] T b9fe3c34857d4c5db87643d9b8167dfb P a9b4951f54814c19b17d0fdc60d79d06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.308245   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:03.325543   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:03.351193   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:03.351995   431 tablet_replica.cc:333] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: stopping tablet replica
I20260709 13:03:03.352645   431 raft_consensus.cc:2243] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.353366   431 pending_rounds.cc:70] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: Trying to abort 1 pending ops.
I20260709 13:03:03.353561   431 pending_rounds.cc:77] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634542278103040 op_type: NO_OP noop_request { }
I20260709 13:03:03.353871   431 raft_consensus.cc:2889] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:03.354128   431 raft_consensus.cc:2272] T 2812cf21f2024d08b9f5f38a58f568bc P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.357029   431 tablet_replica.cc:333] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f: stopping tablet replica
I20260709 13:03:03.357645   431 raft_consensus.cc:2243] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.358091   431 raft_consensus.cc:2272] T 53daaa44faab49649e3c5d10c25aaed0 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.361446   431 tablet_replica.cc:333] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f: stopping tablet replica
I20260709 13:03:03.362138   431 raft_consensus.cc:2243] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.362653   431 raft_consensus.cc:2272] T b9fe3c34857d4c5db87643d9b8167dfb P c2c4a6f3a7494a0e82b38c596e84ec7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.366396   431 tablet_replica.cc:333] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f: stopping tablet replica
I20260709 13:03:03.366995   431 raft_consensus.cc:2243] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.367477   431 raft_consensus.cc:2272] T c3db860bdf3f457781a3b6769189ba57 P c2c4a6f3a7494a0e82b38c596e84ec7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.393352   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:03.410130   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:03.434373   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:03.435284   431 tablet_replica.cc:333] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9: stopping tablet replica
I20260709 13:03:03.436236   431 raft_consensus.cc:2243] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.436798   431 raft_consensus.cc:2272] T 2812cf21f2024d08b9f5f38a58f568bc P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.439826   431 tablet_replica.cc:333] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9: stopping tablet replica
I20260709 13:03:03.440466   431 raft_consensus.cc:2243] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.441056   431 raft_consensus.cc:2272] T 53daaa44faab49649e3c5d10c25aaed0 P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.443688   431 tablet_replica.cc:333] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9: stopping tablet replica
I20260709 13:03:03.444343   431 raft_consensus.cc:2243] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.445309   431 raft_consensus.cc:2272] T c3db860bdf3f457781a3b6769189ba57 P ad0700e0d82b43e2a267fd9ed42536e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.447688   431 tablet_replica.cc:333] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9: stopping tablet replica
I20260709 13:03:03.448264   431 raft_consensus.cc:2243] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.448817   431 raft_consensus.cc:2272] T b9fe3c34857d4c5db87643d9b8167dfb P ad0700e0d82b43e2a267fd9ed42536e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.475121   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:03.491195   431 master.cc:562] Master@127.0.107.254:44019 shutting down...
I20260709 13:03:03.517858   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.518537   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.518908   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P b994feebb2024b67ab9bade65831d789: stopping tablet replica
I20260709 13:03:03.532970   431 master.cc:584] Master@127.0.107.254:44019 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2823 ms)
[----------] 6 tests from LeaderRebalancerTest (364632 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:03:03.567840   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45215
I20260709 13:03:03.569065   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:03.574847 12670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:03.575196 12671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:03.577253 12673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:03.578059   431 server_base.cc:1061] running on GCE node
I20260709 13:03:03.579068   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:03.579313   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:03.579499   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602183579464 us; error 0 us; skew 500 ppm
I20260709 13:03:03.580385   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:03.583751   431 webserver.cc:533] Webserver started at http://127.0.107.254:40405/ using document root <none> and password file <none>
I20260709 13:03:03.584364   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:03.584542   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:03.584901   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:03.586242   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "ea7410d87332475883a454ac887487fc"
format_stamp: "Formatted at 2026-07-09 13:03:03 on dist-test-slave-fc6v"
I20260709 13:03:03.592031   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:03:03.596271 12678 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:03.597205   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:03:03.597576   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "ea7410d87332475883a454ac887487fc"
format_stamp: "Formatted at 2026-07-09 13:03:03 on dist-test-slave-fc6v"
I20260709 13:03:03.597919   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:03.625622   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:03.626915   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:03.673523   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45215
I20260709 13:03:03.673666 12729 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45215 every 8 connection(s)
I20260709 13:03:03.678090 12730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:03.691860 12730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc: Bootstrap starting.
I20260709 13:03:03.697129 12730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:03.702117 12730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc: No bootstrap required, opened a new log
I20260709 13:03:03.704865 12730 raft_consensus.cc:359] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea7410d87332475883a454ac887487fc" member_type: VOTER }
I20260709 13:03:03.705336 12730 raft_consensus.cc:385] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:03.705616 12730 raft_consensus.cc:740] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea7410d87332475883a454ac887487fc, State: Initialized, Role: FOLLOWER
I20260709 13:03:03.706290 12730 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea7410d87332475883a454ac887487fc" member_type: VOTER }
I20260709 13:03:03.706840 12730 raft_consensus.cc:399] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:03.707098 12730 raft_consensus.cc:493] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:03.707391 12730 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:03.713498 12730 raft_consensus.cc:515] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea7410d87332475883a454ac887487fc" member_type: VOTER }
I20260709 13:03:03.714221 12730 leader_election.cc:304] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea7410d87332475883a454ac887487fc; no voters: 
I20260709 13:03:03.715682 12730 leader_election.cc:290] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:03.716171 12733 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:03.717849 12733 raft_consensus.cc:697] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 1 LEADER]: Becoming Leader. State: Replica: ea7410d87332475883a454ac887487fc, State: Running, Role: LEADER
I20260709 13:03:03.718693 12733 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea7410d87332475883a454ac887487fc" member_type: VOTER }
I20260709 13:03:03.719058 12730 sys_catalog.cc:565] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:03.722431 12735 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea7410d87332475883a454ac887487fc. Latest consensus state: current_term: 1 leader_uuid: "ea7410d87332475883a454ac887487fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea7410d87332475883a454ac887487fc" member_type: VOTER } }
I20260709 13:03:03.722425 12734 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea7410d87332475883a454ac887487fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea7410d87332475883a454ac887487fc" member_type: VOTER } }
I20260709 13:03:03.723433 12734 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:03.724408 12735 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:03.729198 12739 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:03.739125 12739 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:03.740437   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:03.750440 12739 catalog_manager.cc:1383] Generated new cluster ID: 607bbdc3d0aa46588eb78000fc75ef85
I20260709 13:03:03.750867 12739 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:03.789309 12739 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:03.791357 12739 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:03.809039 12739 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc: Generated new TSK 0
I20260709 13:03:03.809888 12739 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:03.872238   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:03.879413 12751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:03.880188 12752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:03.883232 12754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:03.883894   431 server_base.cc:1061] running on GCE node
I20260709 13:03:03.884891   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:03.885105   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:03.885305   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602183885286 us; error 0 us; skew 500 ppm
I20260709 13:03:03.885944   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:03.889747   431 webserver.cc:533] Webserver started at http://127.0.107.193:34989/ using document root <none> and password file <none>
I20260709 13:03:03.890429   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:03.890641   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:03.890913   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:03.892606   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "2351aea55ff64112af613300ddc24b72"
format_stamp: "Formatted at 2026-07-09 13:03:03 on dist-test-slave-fc6v"
I20260709 13:03:03.898528   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:03:03.902994 12759 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:03.904070   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:03.904436   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "2351aea55ff64112af613300ddc24b72"
format_stamp: "Formatted at 2026-07-09 13:03:03 on dist-test-slave-fc6v"
I20260709 13:03:03.904779   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:03.923161   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:03.924698   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:03.926470   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:03.929219   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:03.929491   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:03.929766   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:03.929952   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:03.979696   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34575
I20260709 13:03:03.979843 12821 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34575 every 8 connection(s)
I20260709 13:03:03.986231   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:03.994179 12826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:03.995713 12827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.000787   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.001667 12822 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45215
W20260709 13:03:04.002048 12829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.002203 12822 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.003160   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:04.003201 12822 heartbeater.cc:507] Master 127.0.107.254:45215 requested a full tablet report, sending...
W20260709 13:03:04.003472   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.003765   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184003745 us; error 0 us; skew 500 ppm
I20260709 13:03:04.004581   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.006191 12695 ts_manager.cc:194] Registered new tserver with Master: 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575)
I20260709 13:03:04.008103   431 webserver.cc:533] Webserver started at http://127.0.107.194:39929/ using document root <none> and password file <none>
I20260709 13:03:04.008914   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.009183   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.009259 12695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50054
I20260709 13:03:04.009585   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.011234   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-fc6v"
I20260709 13:03:04.016759   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:03:04.021088 12834 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.022137   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:04.022526   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-fc6v"
I20260709 13:03:04.022876   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.061942   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.063663   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.065510   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.068609   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.068866   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.069255   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.069412   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.121425   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45387
I20260709 13:03:04.121560 12896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45387 every 8 connection(s)
I20260709 13:03:04.127343   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.136072 12900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.140408 12901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.142369   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.144017 12897 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45215
W20260709 13:03:04.144084 12903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.144884 12897 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.145752   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:04.145893 12897 heartbeater.cc:507] Master 127.0.107.254:45215 requested a full tablet report, sending...
W20260709 13:03:04.146130   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.146406   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184146391 us; error 0 us; skew 500 ppm
I20260709 13:03:04.147181   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.148849 12695 ts_manager.cc:194] Registered new tserver with Master: 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:04.150390   431 webserver.cc:533] Webserver started at http://127.0.107.195:43451/ using document root <none> and password file <none>
I20260709 13:03:04.151039   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.151099 12695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50070
I20260709 13:03:04.151588   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.151980   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.153378   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "e44283118803451fa17ec5f8f8f9833e"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-fc6v"
I20260709 13:03:04.158447   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:04.162658 12908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.163807   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:04.164131   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "e44283118803451fa17ec5f8f8f9833e"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-fc6v"
I20260709 13:03:04.164408   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.202242   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.203505   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.204942   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.207726   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.207988   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.208252   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.208456   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.260313   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39091
I20260709 13:03:04.260442 12970 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39091 every 8 connection(s)
I20260709 13:03:04.276849 12971 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45215
I20260709 13:03:04.277436 12971 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.278306 12971 heartbeater.cc:507] Master 127.0.107.254:45215 requested a full tablet report, sending...
I20260709 13:03:04.280807 12695 ts_manager.cc:194] Registered new tserver with Master: e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:04.280922   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016822819s
I20260709 13:03:04.282480 12695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50074
I20260709 13:03:04.311810 12695 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50090:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:04.314796 12695 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:04.420727 12862 tablet_service.cc:1511] Processing CreateTablet for tablet d26d214caf1b47e5a5c94aeb7bc80b97 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:04.422895 12858 tablet_service.cc:1511] Processing CreateTablet for tablet c0375afe1e274958a80c20aa1ccae6a3 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:04.423815 12936 tablet_service.cc:1511] Processing CreateTablet for tablet d26d214caf1b47e5a5c94aeb7bc80b97 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:04.424724 12860 tablet_service.cc:1511] Processing CreateTablet for tablet 2bef478f39154cc4bdaebe662881299d (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:04.425356 12936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d214caf1b47e5a5c94aeb7bc80b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.427268 12859 tablet_service.cc:1511] Processing CreateTablet for tablet 19b87b8b2fb544fb8d8d15f4db763bb8 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:04.428934 12932 tablet_service.cc:1511] Processing CreateTablet for tablet c0375afe1e274958a80c20aa1ccae6a3 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:04.429996 12935 tablet_service.cc:1511] Processing CreateTablet for tablet f02e718f6a8d42acb44697e5b9423354 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:04.430594 12932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0375afe1e274958a80c20aa1ccae6a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.431962 12787 tablet_service.cc:1511] Processing CreateTablet for tablet d26d214caf1b47e5a5c94aeb7bc80b97 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:04.432806 12934 tablet_service.cc:1511] Processing CreateTablet for tablet 2bef478f39154cc4bdaebe662881299d (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:04.433614 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d214caf1b47e5a5c94aeb7bc80b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.435009 12783 tablet_service.cc:1511] Processing CreateTablet for tablet c0375afe1e274958a80c20aa1ccae6a3 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:04.435297 12857 tablet_service.cc:1511] Processing CreateTablet for tablet 0b4038ed899742c6b84a759162730f97 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:04.436544 12783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0375afe1e274958a80c20aa1ccae6a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.437747 12933 tablet_service.cc:1511] Processing CreateTablet for tablet 19b87b8b2fb544fb8d8d15f4db763bb8 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:04.439837 12861 tablet_service.cc:1511] Processing CreateTablet for tablet f02e718f6a8d42acb44697e5b9423354 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:04.439965 12784 tablet_service.cc:1511] Processing CreateTablet for tablet 19b87b8b2fb544fb8d8d15f4db763bb8 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:04.441735 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b87b8b2fb544fb8d8d15f4db763bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.433194 12782 tablet_service.cc:1511] Processing CreateTablet for tablet 0b4038ed899742c6b84a759162730f97 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:04.443915 12935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02e718f6a8d42acb44697e5b9423354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.444562 12782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b4038ed899742c6b84a759162730f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.444950 12785 tablet_service.cc:1511] Processing CreateTablet for tablet 2bef478f39154cc4bdaebe662881299d (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:04.446509 12785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bef478f39154cc4bdaebe662881299d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.448009 12934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bef478f39154cc4bdaebe662881299d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.449012 12786 tablet_service.cc:1511] Processing CreateTablet for tablet f02e718f6a8d42acb44697e5b9423354 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:04.456223 12933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b87b8b2fb544fb8d8d15f4db763bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.422464 12862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d214caf1b47e5a5c94aeb7bc80b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.460033 12786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02e718f6a8d42acb44697e5b9423354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.463270 12861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02e718f6a8d42acb44697e5b9423354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.467243 12860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bef478f39154cc4bdaebe662881299d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.472174 12859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b87b8b2fb544fb8d8d15f4db763bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.474500 12857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b4038ed899742c6b84a759162730f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.476107 12858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0375afe1e274958a80c20aa1ccae6a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.512987 12990 tablet_bootstrap.cc:492] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:04.530373 12931 tablet_service.cc:1511] Processing CreateTablet for tablet 0b4038ed899742c6b84a759162730f97 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:04.532258 12931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b4038ed899742c6b84a759162730f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.535907 12787 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5ae7723e5a4d43bfda643d431c1d11 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:04.537700 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5ae7723e5a4d43bfda643d431c1d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.551364 12990 tablet_bootstrap.cc:654] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.558655 12856 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5ae7723e5a4d43bfda643d431c1d11 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:04.560598 12856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5ae7723e5a4d43bfda643d431c1d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.564693 12990 tablet_bootstrap.cc:492] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:04.565603 12990 ts_tablet_manager.cc:1403] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.006s
I20260709 13:03:04.569300 12990 raft_consensus.cc:359] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.570206 12990 raft_consensus.cc:385] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.570524 12990 raft_consensus.cc:740] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.571791 12990 consensus_queue.cc:260] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.574659 12932 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5ae7723e5a4d43bfda643d431c1d11 (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:04.576411 12932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5ae7723e5a4d43bfda643d431c1d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.576462 12784 tablet_service.cc:1511] Processing CreateTablet for tablet a649ce0342884eb18d8d791efb0ca69e (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:04.578418 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a649ce0342884eb18d8d791efb0ca69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.601473 12822 heartbeater.cc:499] Master 127.0.107.254:45215 was elected leader, sending a full tablet report...
I20260709 13:03:04.608562 12990 ts_tablet_manager.cc:1434] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.043s	user 0.015s	sys 0.022s
I20260709 13:03:04.610069 12990 tablet_bootstrap.cc:492] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:04.617399 12990 tablet_bootstrap.cc:654] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.623956 12855 tablet_service.cc:1511] Processing CreateTablet for tablet a649ce0342884eb18d8d791efb0ca69e (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:04.626922 12855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a649ce0342884eb18d8d791efb0ca69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.640571 12932 tablet_service.cc:1511] Processing CreateTablet for tablet a649ce0342884eb18d8d791efb0ca69e (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:04.642854 12932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a649ce0342884eb18d8d791efb0ca69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.656906 12854 tablet_service.cc:1511] Processing CreateTablet for tablet c5889444bd9d4bcb82db775ecc6ab27e (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:04.657220 12787 tablet_service.cc:1511] Processing CreateTablet for tablet c5889444bd9d4bcb82db775ecc6ab27e (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:04.658601 12854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5889444bd9d4bcb82db775ecc6ab27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.658691 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5889444bd9d4bcb82db775ecc6ab27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.664487 12989 tablet_bootstrap.cc:492] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:04.674495 12990 tablet_bootstrap.cc:492] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:04.675374 12990 ts_tablet_manager.cc:1403] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.005s
I20260709 13:03:04.678790 12990 raft_consensus.cc:359] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.684386 12936 tablet_service.cc:1511] Processing CreateTablet for tablet c5889444bd9d4bcb82db775ecc6ab27e (DEFAULT_TABLE table=test-workload [id=988c6539804f4aeab4645f687ff14b8f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:04.687054 12989 tablet_bootstrap.cc:654] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.703164 12994 tablet_bootstrap.cc:492] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:04.699287 12990 raft_consensus.cc:385] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.706573 12990 raft_consensus.cc:740] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.715843 12990 consensus_queue.cc:260] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.722972 12990 ts_tablet_manager.cc:1434] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:03:04.719892 12936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5889444bd9d4bcb82db775ecc6ab27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.724339 12990 tablet_bootstrap.cc:492] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
W20260709 13:03:04.732851 12743 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:04.734265 12989 tablet_bootstrap.cc:492] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:04.735184 12989 ts_tablet_manager.cc:1403] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.004s
I20260709 13:03:04.731400 12994 tablet_bootstrap.cc:654] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.739300 12989 raft_consensus.cc:359] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.740449 12989 raft_consensus.cc:385] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.740803 12989 raft_consensus.cc:740] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.741074 12990 tablet_bootstrap.cc:654] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.741755 12989 consensus_queue.cc:260] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.743165 12994 tablet_bootstrap.cc:492] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:04.743903 12994 ts_tablet_manager.cc:1403] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 13:03:04.748618 12994 raft_consensus.cc:359] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.750044 12994 raft_consensus.cc:385] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.750525 12994 raft_consensus.cc:740] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.751775 12994 consensus_queue.cc:260] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.754249 12990 tablet_bootstrap.cc:492] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:04.755203 12990 ts_tablet_manager.cc:1403] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 13:03:04.761639 12990 raft_consensus.cc:359] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.762796 12990 raft_consensus.cc:385] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.763273 12990 raft_consensus.cc:740] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.764577 12990 consensus_queue.cc:260] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.766798 12989 ts_tablet_manager.cc:1434] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.019s
I20260709 13:03:04.767081 12897 heartbeater.cc:499] Master 127.0.107.254:45215 was elected leader, sending a full tablet report...
I20260709 13:03:04.768002 12994 ts_tablet_manager.cc:1434] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:03:04.768245 12989 tablet_bootstrap.cc:492] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:04.769358 12994 tablet_bootstrap.cc:492] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:04.769677 12971 heartbeater.cc:499] Master 127.0.107.254:45215 was elected leader, sending a full tablet report...
I20260709 13:03:04.776554 12989 tablet_bootstrap.cc:654] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.776552 12994 tablet_bootstrap.cc:654] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.788152 12999 raft_consensus.cc:493] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.788901 12999 raft_consensus.cc:515] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.789376 12989 tablet_bootstrap.cc:492] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:04.790011 12989 ts_tablet_manager.cc:1403] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:03:04.795219 12990 ts_tablet_manager.cc:1434] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:03:04.796319 12989 raft_consensus.cc:359] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.797240 12989 raft_consensus.cc:385] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.797106 12990 tablet_bootstrap.cc:492] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:04.799989 12999 leader_election.cc:290] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:04.797767 12989 raft_consensus.cc:740] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.808640 12989 consensus_queue.cc:260] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.811306 12989 ts_tablet_manager.cc:1434] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:03:04.812615 12989 tablet_bootstrap.cc:492] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:04.815672 12990 tablet_bootstrap.cc:654] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.819851 12989 tablet_bootstrap.cc:654] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.826920 12994 tablet_bootstrap.cc:492] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:04.827677 12994 ts_tablet_manager.cc:1403] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.059s	user 0.037s	sys 0.019s
I20260709 13:03:04.830972 12994 raft_consensus.cc:359] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.832125 12994 raft_consensus.cc:385] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.832537 12994 raft_consensus.cc:740] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.833518 12994 consensus_queue.cc:260] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.834260 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:04.836139 12994 ts_tablet_manager.cc:1434] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 13:03:04.836750 12837 leader_election.cc:343] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:04.837566 12994 tablet_bootstrap.cc:492] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:04.840373 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:04.841290 12989 tablet_bootstrap.cc:492] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:04.843392 12989 ts_tablet_manager.cc:1403] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.004s
W20260709 13:03:04.843413 12838 leader_election.cc:343] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:04.843876 12992 raft_consensus.cc:493] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.844100 12838 leader_election.cc:304] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:04.844528 12992 raft_consensus.cc:515] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.845551 12999 raft_consensus.cc:2749] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:04.847347 12989 raft_consensus.cc:359] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.848318 12989 raft_consensus.cc:385] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.848630 12990 tablet_bootstrap.cc:492] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:04.848661 12989 raft_consensus.cc:740] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.849861 12994 tablet_bootstrap.cc:654] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.849454 12990 ts_tablet_manager.cc:1403] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 13:03:04.849846 12989 consensus_queue.cc:260] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.854444 12990 raft_consensus.cc:359] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.855397 12990 raft_consensus.cc:385] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.855806 12990 raft_consensus.cc:740] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.856941 12990 consensus_queue.cc:260] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.858487 12989 ts_tablet_manager.cc:1434] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:04.860489 12989 tablet_bootstrap.cc:492] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:04.862671 12992 leader_election.cc:290] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:04.869390 12994 tablet_bootstrap.cc:492] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:04.871472 12994 ts_tablet_manager.cc:1403] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.015s
I20260709 13:03:04.877707 12994 raft_consensus.cc:359] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.878400 12994 raft_consensus.cc:385] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.878720 12994 raft_consensus.cc:740] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.879136 12989 tablet_bootstrap.cc:654] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.879587 12994 consensus_queue.cc:260] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.882068 12994 ts_tablet_manager.cc:1434] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:03:04.883489 12994 tablet_bootstrap.cc:492] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:04.890982 12994 tablet_bootstrap.cc:654] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.896400 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d214caf1b47e5a5c94aeb7bc80b97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:04.897782 12872 raft_consensus.cc:2468] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:04.901503 12760 leader_election.cc:304] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:04.902557 12989 tablet_bootstrap.cc:492] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:04.902819 13008 raft_consensus.cc:2804] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:04.903292 13008 raft_consensus.cc:493] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.903367 12989 ts_tablet_manager.cc:1403] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.020s
I20260709 13:03:04.903769 13008 raft_consensus.cc:3060] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:04.909590 12989 raft_consensus.cc:359] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.910863 12989 raft_consensus.cc:385] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.911221 12989 raft_consensus.cc:740] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.911372 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d214caf1b47e5a5c94aeb7bc80b97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:04.912232 12946 raft_consensus.cc:2468] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:04.912859 12997 raft_consensus.cc:493] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.913394 12997 raft_consensus.cc:515] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.914151 12994 tablet_bootstrap.cc:492] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:04.914845 12994 ts_tablet_manager.cc:1403] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.015s
I20260709 13:03:04.916198 12989 consensus_queue.cc:260] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.914669 13008 raft_consensus.cc:515] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.930085 12990 ts_tablet_manager.cc:1434] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.079s	user 0.012s	sys 0.008s
I20260709 13:03:04.920243 12997 leader_election.cc:290] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575)
I20260709 13:03:04.920449 12994 raft_consensus.cc:359] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.938737 12989 ts_tablet_manager.cc:1434] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.020s
I20260709 13:03:04.937189 12994 raft_consensus.cc:385] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.946312 12989 tablet_bootstrap.cc:492] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:04.948516 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d214caf1b47e5a5c94aeb7bc80b97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:04.949431 12872 raft_consensus.cc:3060] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:04.950515 13008 leader_election.cc:290] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:04.952105 12990 tablet_bootstrap.cc:492] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:04.952360 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d214caf1b47e5a5c94aeb7bc80b97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:04.953106 12946 raft_consensus.cc:3060] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:04.945524 12994 raft_consensus.cc:740] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.956629 12994 consensus_queue.cc:260] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.959336 12994 ts_tablet_manager.cc:1434] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 13:03:04.960649 12994 tablet_bootstrap.cc:492] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:04.962944 12872 raft_consensus.cc:2468] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:04.966349 13012 raft_consensus.cc:493] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.968052 13012 raft_consensus.cc:515] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.969054 12760 leader_election.cc:304] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:04.970378 13008 raft_consensus.cc:2804] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:04.970757 13012 leader_election.cc:290] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:04.971212 12990 tablet_bootstrap.cc:654] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.972010 13008 raft_consensus.cc:697] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:04.973232 13008 consensus_queue.cc:237] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:04.977377 12994 tablet_bootstrap.cc:654] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.979972 12989 tablet_bootstrap.cc:654] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.981489 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
W20260709 13:03:04.983604 12911 leader_election.cc:343] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:04.983675 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d214caf1b47e5a5c94aeb7bc80b97" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:04.966502 12946 raft_consensus.cc:2468] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:04.988638 12990 tablet_bootstrap.cc:492] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:04.988869 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d214caf1b47e5a5c94aeb7bc80b97" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:04.989653 12990 ts_tablet_manager.cc:1403] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.005s
I20260709 13:03:04.990025 12872 raft_consensus.cc:2393] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e44283118803451fa17ec5f8f8f9833e in current term 1: Already voted for candidate 2351aea55ff64112af613300ddc24b72 in this term.
I20260709 13:03:04.994879 12909 leader_election.cc:304] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:04.996196 13012 raft_consensus.cc:2749] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:04.999488 12994 tablet_bootstrap.cc:492] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:05.000427 12994 ts_tablet_manager.cc:1403] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.007s
I20260709 13:03:04.999894 12990 raft_consensus.cc:359] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.001204 12990 raft_consensus.cc:385] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.002161 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.001665 12693 catalog_manager.cc:5697] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.003261 12872 raft_consensus.cc:2468] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:05.004436 12994 raft_consensus.cc:359] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.005446 12994 raft_consensus.cc:385] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.005762 12994 raft_consensus.cc:740] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.007335 12909 leader_election.cc:304] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72
I20260709 13:03:05.006897 12994 consensus_queue.cc:260] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.001678 12990 raft_consensus.cc:740] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.008821 12989 tablet_bootstrap.cc:492] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:05.009423 12989 ts_tablet_manager.cc:1403] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.006s
I20260709 13:03:05.009665 12990 consensus_queue.cc:260] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.010309 12994 ts_tablet_manager.cc:1434] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:05.011708 12994 tablet_bootstrap.cc:492] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:05.011821 13012 raft_consensus.cc:2804] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.011950 13008 raft_consensus.cc:493] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.012454 13012 raft_consensus.cc:493] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.012905 13012 raft_consensus.cc:3060] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.012626 13008 raft_consensus.cc:515] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.021963 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.022926 12994 tablet_bootstrap.cc:654] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.022835 12946 raft_consensus.cc:2468] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:05.024716 12990 ts_tablet_manager.cc:1434] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:03:05.025239 12763 leader_election.cc:304] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:05.026384 12990 tablet_bootstrap.cc:492] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:05.026681 12992 raft_consensus.cc:2804] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.027338 12992 raft_consensus.cc:493] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.027809 12992 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.029383 12989 raft_consensus.cc:359] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.030368 12989 raft_consensus.cc:385] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.030756 12989 raft_consensus.cc:740] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.031893 13008 leader_election.cc:290] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.031777 13012 raft_consensus.cc:515] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.036690 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:05.037147 13012 leader_election.cc:290] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.039042 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.039989 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.040469 12992 raft_consensus.cc:515] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.041039 12871 raft_consensus.cc:3060] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:05.041795 12760 leader_election.cc:343] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.037498 12797 raft_consensus.cc:3060] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.031930 12989 consensus_queue.cc:260] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.045575 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:05.046525 12946 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.047437 12989 ts_tablet_manager.cc:1434] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:03:05.048262 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.048978 12989 tablet_bootstrap.cc:492] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
W20260709 13:03:05.050380 12760 leader_election.cc:343] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.058460 13008 raft_consensus.cc:493] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.059466 12992 leader_election.cc:290] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.059568 13008 raft_consensus.cc:515] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.063225 12989 tablet_bootstrap.cc:654] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.067902 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02e718f6a8d42acb44697e5b9423354" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.069155 12870 raft_consensus.cc:2468] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:05.072366 12760 leader_election.cc:304] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:05.073860 12992 raft_consensus.cc:2804] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.074323 12992 raft_consensus.cc:493] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.074687 12992 raft_consensus.cc:3060] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.078469 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02e718f6a8d42acb44697e5b9423354" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.078910 13008 leader_election.cc:290] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
W20260709 13:03:05.080729 12763 leader_election.cc:343] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.083839 13008 raft_consensus.cc:493] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.084285 12992 raft_consensus.cc:515] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.086850 12990 tablet_bootstrap.cc:654] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.088169 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02e718f6a8d42acb44697e5b9423354" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.089502 12872 raft_consensus.cc:3060] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.084841 13008 raft_consensus.cc:515] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.090241 12992 leader_election.cc:290] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.090529 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02e718f6a8d42acb44697e5b9423354" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:05.093477 12871 raft_consensus.cc:2468] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:05.095149 12797 raft_consensus.cc:2468] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
W20260709 13:03:05.099826 12763 leader_election.cc:343] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.103255 12911 leader_election.cc:304] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:05.104630 13008 leader_election.cc:290] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.105167 13012 raft_consensus.cc:2804] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.106089 13012 raft_consensus.cc:697] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:05.106601 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bef478f39154cc4bdaebe662881299d" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.107843 12870 raft_consensus.cc:2468] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:05.108479 13012 consensus_queue.cc:237] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.111608 12760 leader_election.cc:304] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:05.114351 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bef478f39154cc4bdaebe662881299d" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
W20260709 13:03:05.117112 12763 leader_election.cc:343] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.118918 13008 raft_consensus.cc:2804] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.119656 13008 raft_consensus.cc:493] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.120187 13008 raft_consensus.cc:3060] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.115195 12946 raft_consensus.cc:2468] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:05.138756 13008 raft_consensus.cc:515] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.147985 12763 leader_election.cc:304] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.149610 12992 raft_consensus.cc:2804] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.157306 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bef478f39154cc4bdaebe662881299d" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.158475 12871 raft_consensus.cc:3060] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.159983 12990 tablet_bootstrap.cc:492] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:05.159684 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bef478f39154cc4bdaebe662881299d" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:05.160655 12990 ts_tablet_manager.cc:1403] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.033s
W20260709 13:03:05.163084 12763 leader_election.cc:343] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.162524 12992 raft_consensus.cc:697] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:05.165138 12992 consensus_queue.cc:237] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.161548 13008 leader_election.cc:290] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.167912 12872 raft_consensus.cc:2468] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:05.171976 12989 tablet_bootstrap.cc:492] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:05.172250 12760 leader_election.cc:304] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:05.173113 12989 ts_tablet_manager.cc:1403] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.124s	user 0.049s	sys 0.010s
I20260709 13:03:05.175014 13025 raft_consensus.cc:2804] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.171976 12994 tablet_bootstrap.cc:492] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:05.178231 12994 ts_tablet_manager.cc:1403] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.167s	user 0.059s	sys 0.087s
I20260709 13:03:05.178023 12989 raft_consensus.cc:359] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.178987 12989 raft_consensus.cc:385] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.179415 12989 raft_consensus.cc:740] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.180455 12989 consensus_queue.cc:260] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.176951 12990 raft_consensus.cc:359] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.182309 12871 raft_consensus.cc:2468] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:05.183666 12990 raft_consensus.cc:385] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.186281 12990 raft_consensus.cc:740] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.182021 12994 raft_consensus.cc:359] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.184434 12989 ts_tablet_manager.cc:1434] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:03:05.187495 12760 leader_election.cc:304] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:05.187600 12990 consensus_queue.cc:260] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.183673 13025 raft_consensus.cc:697] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:05.189478 12989 tablet_bootstrap.cc:492] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:05.189949 13008 raft_consensus.cc:2804] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.190083 12994 raft_consensus.cc:385] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.192384 12994 raft_consensus.cc:740] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.194077 12994 consensus_queue.cc:260] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.194195 12693 catalog_manager.cc:5697] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.198012 13025 consensus_queue.cc:237] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.202203 12989 tablet_bootstrap.cc:654] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.222739 12994 ts_tablet_manager.cc:1434] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:03:05.223929 13012 raft_consensus.cc:493] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.224828 13012 raft_consensus.cc:515] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.230840 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bef478f39154cc4bdaebe662881299d" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:05.231715 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bef478f39154cc4bdaebe662881299d" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.233196 12871 raft_consensus.cc:2393] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e44283118803451fa17ec5f8f8f9833e in current term 1: Already voted for candidate 2351aea55ff64112af613300ddc24b72 in this term.
I20260709 13:03:05.235661 12694 catalog_manager.cc:5697] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.246286 12990 ts_tablet_manager.cc:1434] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.085s	user 0.030s	sys 0.023s
I20260709 13:03:05.247977 12990 tablet_bootstrap.cc:492] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:05.236605 13012 leader_election.cc:290] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.249182 12989 tablet_bootstrap.cc:492] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:05.249217 12994 tablet_bootstrap.cc:492] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:05.250656 13008 raft_consensus.cc:697] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:05.255355 12989 ts_tablet_manager.cc:1403] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.012s
I20260709 13:03:05.256049 13008 consensus_queue.cc:237] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.257642 13012 raft_consensus.cc:493] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.260107 12990 tablet_bootstrap.cc:654] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.263023 13012 raft_consensus.cc:515] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.263634 12994 tablet_bootstrap.cc:654] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.259666 12989 raft_consensus.cc:359] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.266325 12989 raft_consensus.cc:385] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.266731 12989 raft_consensus.cc:740] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.267242 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
W20260709 13:03:05.269369 12911 leader_election.cc:343] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.267307 13029 raft_consensus.cc:493] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.274250 13029 raft_consensus.cc:515] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.273124 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.276626 12871 raft_consensus.cc:2468] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:05.277304 12994 tablet_bootstrap.cc:492] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:05.278052 12994 ts_tablet_manager.cc:1403] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 13:03:05.279052 12909 leader_election.cc:304] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72
I20260709 13:03:05.280709 12997 raft_consensus.cc:2804] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.281271 12997 raft_consensus.cc:493] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.281550 12911 leader_election.cc:304] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.281745 12997 raft_consensus.cc:3060] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.281986 12994 raft_consensus.cc:359] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.283473 12994 raft_consensus.cc:385] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.284003 12994 raft_consensus.cc:740] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.285586 12994 consensus_queue.cc:260] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.271109 12989 consensus_queue.cc:260] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.292002 13035 raft_consensus.cc:3060] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.275581 13012 leader_election.cc:290] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.294241 12994 ts_tablet_manager.cc:1434] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:03:05.296005 12994 tablet_bootstrap.cc:492] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:05.305128 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.306493 13035 raft_consensus.cc:2749] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:05.307113 12760 leader_election.cc:343] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.309535 12994 tablet_bootstrap.cc:654] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.312552 13029 leader_election.cc:290] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.314560 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.316182 12946 raft_consensus.cc:2468] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:05.318132 12763 leader_election.cc:304] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.318390 12989 ts_tablet_manager.cc:1434] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.006s
I20260709 13:03:05.318804 12997 raft_consensus.cc:515] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.319768 13029 raft_consensus.cc:2804] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.320302 13029 raft_consensus.cc:493] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.321606 13029 raft_consensus.cc:3060] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.324344 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
W20260709 13:03:05.327224 12911 leader_election.cc:343] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.316102 12694 catalog_manager.cc:5697] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.329682 12990 tablet_bootstrap.cc:492] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:05.331277 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.332314 12871 raft_consensus.cc:3060] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.332717 12989 tablet_bootstrap.cc:492] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:05.331830 12694 catalog_manager.cc:5697] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.329579 12997 leader_election.cc:290] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.340322 12990 ts_tablet_manager.cc:1403] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.021s
I20260709 13:03:05.348814 12989 tablet_bootstrap.cc:654] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.347136 12871 raft_consensus.cc:2468] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:05.351893 13029 raft_consensus.cc:515] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.354063 12994 tablet_bootstrap.cc:492] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:05.353510 12990 raft_consensus.cc:359] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.354724 12994 ts_tablet_manager.cc:1403] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.028s
I20260709 13:03:05.354758 12990 raft_consensus.cc:385] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.355295 12990 raft_consensus.cc:740] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.355432 13029 leader_election.cc:290] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.356343 12989 tablet_bootstrap.cc:492] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:05.357061 12989 ts_tablet_manager.cc:1403] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 13:03:05.356307 12990 consensus_queue.cc:260] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.358223 12994 raft_consensus.cc:359] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.359249 12994 raft_consensus.cc:385] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.359759 12990 ts_tablet_manager.cc:1434] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:03:05.359779 12994 raft_consensus.cc:740] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.404338 12997 raft_consensus.cc:493] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.406267 12997 raft_consensus.cc:515] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.407111 12990 tablet_bootstrap.cc:492] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:05.408748 12909 leader_election.cc:304] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72
I20260709 13:03:05.411350 12997 leader_election.cc:290] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.412825 12997 raft_consensus.cc:2804] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.413596 12997 raft_consensus.cc:697] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:05.414853 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:05.415469 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:05.416747 12946 raft_consensus.cc:3060] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.417204 12999 raft_consensus.cc:493] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.418376 12999 raft_consensus.cc:515] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.408198 12994 consensus_queue.cc:260] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.426535 12997 consensus_queue.cc:237] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.425239 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
W20260709 13:03:05.434832 12911 leader_election.cc:343] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.435238 12999 leader_election.cc:290] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.436743 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5889444bd9d4bcb82db775ecc6ab27e" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
W20260709 13:03:05.439963 12837 leader_election.cc:343] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.441735 12999 raft_consensus.cc:493] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.360318 12989 raft_consensus.cc:359] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.443861 12989 raft_consensus.cc:385] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.444458 12989 raft_consensus.cc:740] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.445214 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.445962 12989 consensus_queue.cc:260] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.452646 12989 ts_tablet_manager.cc:1434] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.095s	user 0.013s	sys 0.000s
I20260709 13:03:05.454990 12989 tablet_bootstrap.cc:492] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:05.455209 12990 tablet_bootstrap.cc:654] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.443385 12999 raft_consensus.cc:515] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.465554 12871 raft_consensus.cc:2468] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:05.469583 12989 tablet_bootstrap.cc:654] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.471706 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:05.471145 12999 leader_election.cc:290] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
W20260709 13:03:05.476012 12837 leader_election.cc:343] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.476670 12909 leader_election.cc:304] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72
I20260709 13:03:05.477859 13035 raft_consensus.cc:2804] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.478390 13035 raft_consensus.cc:493] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.478765 13035 raft_consensus.cc:3060] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.483341 13036 raft_consensus.cc:493] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.484268 13036 raft_consensus.cc:515] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
W20260709 13:03:05.494946 12760 leader_election.cc:343] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.495471 12994 ts_tablet_manager.cc:1434] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.140s	user 0.011s	sys 0.003s
I20260709 13:03:05.498534 12994 tablet_bootstrap.cc:492] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:05.500564 13036 leader_election.cc:290] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.502143 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02e718f6a8d42acb44697e5b9423354" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.502882 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02e718f6a8d42acb44697e5b9423354" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:05.503608 12871 raft_consensus.cc:2393] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e44283118803451fa17ec5f8f8f9833e in current term 1: Already voted for candidate 2351aea55ff64112af613300ddc24b72 in this term.
I20260709 13:03:05.503710 13029 consensus_queue.cc:1048] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.504575 12694 catalog_manager.cc:5697] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.507721 12911 leader_election.cc:304] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.516302 13029 consensus_queue.cc:1048] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.516858 13036 raft_consensus.cc:3060] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.518999 12990 tablet_bootstrap.cc:492] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:05.519904 12990 ts_tablet_manager.cc:1403] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.114s	user 0.028s	sys 0.003s
I20260709 13:03:05.520355 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5889444bd9d4bcb82db775ecc6ab27e" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.525732 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.525769 13040 raft_consensus.cc:493] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.526872 13040 raft_consensus.cc:515] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.531481 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
W20260709 13:03:05.536126 12838 leader_election.cc:343] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.536778 12838 leader_election.cc:304] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:05.537505 13040 leader_election.cc:290] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.539861 13042 raft_consensus.cc:2749] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.541117 12989 tablet_bootstrap.cc:492] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:05.541740 12989 ts_tablet_manager.cc:1403] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.009s
I20260709 13:03:05.548022 12943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.549434 12943 raft_consensus.cc:2393] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cd0edf173e64b11b1d7052cfb92c26e in current term 1: Already voted for candidate 2351aea55ff64112af613300ddc24b72 in this term.
I20260709 13:03:05.550984 13036 raft_consensus.cc:2749] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.551218 12838 leader_election.cc:304] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:05.554421 12871 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.564067 12989 raft_consensus.cc:359] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.565620 12989 raft_consensus.cc:385] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.566128 12989 raft_consensus.cc:740] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.568284 12990 raft_consensus.cc:359] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.573027 12990 raft_consensus.cc:385] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.573536 12990 raft_consensus.cc:740] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.576639 12994 tablet_bootstrap.cc:654] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.578678 12990 consensus_queue.cc:260] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.580067 12946 raft_consensus.cc:2468] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:05.589123 12989 consensus_queue.cc:260] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.593123 12989 ts_tablet_manager.cc:1434] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.002s
I20260709 13:03:05.595511 12763 leader_election.cc:304] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.597936 13029 raft_consensus.cc:2804] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.598665 13029 raft_consensus.cc:697] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:05.602844 12990 ts_tablet_manager.cc:1434] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.001s
I20260709 13:03:05.604722 12990 tablet_bootstrap.cc:492] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:05.605705 13035 raft_consensus.cc:515] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.608290 12944 raft_consensus.cc:2393] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cd0edf173e64b11b1d7052cfb92c26e in current term 1: Already voted for candidate e44283118803451fa17ec5f8f8f9833e in this term.
I20260709 13:03:05.610713 12838 leader_election.cc:304] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:05.612293 13040 raft_consensus.cc:3060] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.613806 12990 tablet_bootstrap.cc:654] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.600198 13029 consensus_queue.cc:237] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.627027 13028 raft_consensus.cc:493] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.628752 13028 raft_consensus.cc:515] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.633744 13040 raft_consensus.cc:2749] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.634755 13028 leader_election.cc:290] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:05.636729 13042 raft_consensus.cc:2749] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.636883 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:05.641438 13028 consensus_queue.cc:1048] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.644536 12994 tablet_bootstrap.cc:492] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:05.645293 12994 ts_tablet_manager.cc:1403] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.008s
I20260709 13:03:05.646677 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:05.647461 12797 raft_consensus.cc:3060] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.650765 12994 raft_consensus.cc:359] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.652033 12994 raft_consensus.cc:385] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.652395 12994 raft_consensus.cc:740] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.655144 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.656361 12871 raft_consensus.cc:2393] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2351aea55ff64112af613300ddc24b72 in current term 1: Already voted for candidate e44283118803451fa17ec5f8f8f9833e in this term.
I20260709 13:03:05.657388 13035 leader_election.cc:290] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.657955 12760 leader_election.cc:304] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2351aea55ff64112af613300ddc24b72; no voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:05.659644 12992 raft_consensus.cc:3060] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.665705 12797 raft_consensus.cc:2468] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:05.664688 12693 catalog_manager.cc:5697] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.671907 12872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.670228 13025 consensus_queue.cc:1048] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.675812 12994 consensus_queue.cc:260] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.678740 12994 ts_tablet_manager.cc:1434] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:03:05.685161 12992 raft_consensus.cc:2749] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.688452 12911 leader_election.cc:304] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:05.692004 13036 raft_consensus.cc:2804] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.692708 13036 raft_consensus.cc:697] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:05.694459 13036 consensus_queue.cc:237] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.699903 12872 raft_consensus.cc:2468] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:05.707527 13036 consensus_queue.cc:1048] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.707484 12992 consensus_queue.cc:1048] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:05.712430 12990 tablet_bootstrap.cc:492] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:05.713164 12990 ts_tablet_manager.cc:1403] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.109s	user 0.029s	sys 0.006s
I20260709 13:03:05.716687 12990 raft_consensus.cc:359] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.717522 12990 raft_consensus.cc:385] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.717811 12990 raft_consensus.cc:740] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.719244 12694 catalog_manager.cc:5697] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.721854 12990 consensus_queue.cc:260] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.724874 12990 ts_tablet_manager.cc:1434] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:03:05.732288 13008 consensus_queue.cc:1048] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.736521 13035 consensus_queue.cc:1048] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.745343 13029 consensus_queue.cc:1048] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.750998 12992 consensus_queue.cc:1048] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:05.757160 12743 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:05.763160 13036 raft_consensus.cc:493] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.763940 13036 raft_consensus.cc:515] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.768672 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5889444bd9d4bcb82db775ecc6ab27e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:05.769624 12869 raft_consensus.cc:2468] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:05.770720 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5889444bd9d4bcb82db775ecc6ab27e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:05.771710 12796 raft_consensus.cc:2468] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:05.771603 12909 leader_election.cc:304] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:05.773288 13035 raft_consensus.cc:2804] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.773689 13035 raft_consensus.cc:493] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.774024 13035 raft_consensus.cc:3060] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.791801 13035 raft_consensus.cc:515] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.795666 13035 leader_election.cc:290] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.797006 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5889444bd9d4bcb82db775ecc6ab27e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:05.797508 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5889444bd9d4bcb82db775ecc6ab27e" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:05.797864 12869 raft_consensus.cc:3060] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.798231 12796 raft_consensus.cc:3060] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.796746 13036 leader_election.cc:290] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:05.810014 12869 raft_consensus.cc:2468] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:05.812566 12909 leader_election.cc:304] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:05.813839 13036 raft_consensus.cc:2804] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.814433 13036 raft_consensus.cc:697] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:05.815459 13036 consensus_queue.cc:237] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:05.833973 12693 catalog_manager.cc:5697] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.839922 12796 raft_consensus.cc:2468] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:05.872442 13036 consensus_queue.cc:1048] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.888666 13036 consensus_queue.cc:1048] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.929345 12944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:59354
I20260709 13:03:05.930109 12944 raft_consensus.cc:606] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.948120 12796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b4038ed899742c6b84a759162730f97"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:03:05.949290 12796 raft_consensus.cc:606] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.956568 12944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:59354
I20260709 13:03:05.957265 12944 raft_consensus.cc:606] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:05.964387 12944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:59354
I20260709 13:03:05.965111 12944 raft_consensus.cc:606] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:06.020213 13042 raft_consensus.cc:493] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.020977 13042 raft_consensus.cc:515] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.023474 13042 leader_election.cc:290] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:06.024420 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:06.024734 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:06.025913 12944 raft_consensus.cc:2393] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cd0edf173e64b11b1d7052cfb92c26e in current term 1: Already voted for candidate 2351aea55ff64112af613300ddc24b72 in this term.
I20260709 13:03:06.027287 12838 leader_election.cc:304] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:06.028273 13042 raft_consensus.cc:3060] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.036612 13042 raft_consensus.cc:2749] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:06.080856 13028 consensus_queue.cc:1048] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:06.096911 13008 consensus_queue.cc:1048] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:06.181635 13035 consensus_queue.cc:1048] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:06.190096 13036 raft_consensus.cc:993] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.190707 13036 raft_consensus.cc:1081] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.194227 12869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:03:06.195709 12869 raft_consensus.cc:493] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.196185 12869 raft_consensus.cc:3060] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.198180 12997 consensus_queue.cc:1048] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:06.202272 13036 consensus_queue.cc:1048] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:06.206282 12869 raft_consensus.cc:515] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.211184 12795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:06.211584 12869 leader_election.cc:290] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:06.211807 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a649ce0342884eb18d8d791efb0ca69e" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:06.212775 12944 raft_consensus.cc:3055] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.213250 12944 raft_consensus.cc:740] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:06.214557 12944 consensus_queue.cc:260] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.216599 12944 raft_consensus.cc:3060] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.228338 12944 raft_consensus.cc:2468] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.230229 12838 leader_election.cc:304] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72
I20260709 13:03:06.231257 13042 raft_consensus.cc:2804] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.232899 13035 consensus_queue.cc:1048] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:06.253974 13042 raft_consensus.cc:697] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:06.255482 13042 consensus_queue.cc:237] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.259032 13008 raft_consensus.cc:993] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.259769 13008 raft_consensus.cc:1081] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.262275 12871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b4038ed899742c6b84a759162730f97"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40500
I20260709 13:03:06.262962 12871 raft_consensus.cc:493] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.263383 12871 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.270467 12694 catalog_manager.cc:5697] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from e44283118803451fa17ec5f8f8f9833e (127.0.107.195) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.275709 12871 raft_consensus.cc:515] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.278998 12871 leader_election.cc:290] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:06.279867 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:06.280392 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:06.280654 12796 raft_consensus.cc:3055] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.281062 12944 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.281174 12796 raft_consensus.cc:740] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:06.282371 12796 consensus_queue.cc:260] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.283820 12796 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.290781 12944 raft_consensus.cc:2468] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.292418 12838 leader_election.cc:304] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:06.293179 12796 raft_consensus.cc:2468] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.293399 13042 raft_consensus.cc:2804] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.294031 13042 raft_consensus.cc:697] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:06.295261 13042 consensus_queue.cc:237] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.295892 13035 raft_consensus.cc:993] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.296525 13035 raft_consensus.cc:1081] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.298710 12871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:03:06.299418 12871 raft_consensus.cc:493] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.299978 12871 raft_consensus.cc:3060] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.304970 13035 raft_consensus.cc:993] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.305660 12997 raft_consensus.cc:1081] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:06.305835 12694 catalog_manager.cc:5697] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from 2351aea55ff64112af613300ddc24b72 (127.0.107.193) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.308084 12869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:03:06.308821 12869 raft_consensus.cc:493] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.309222 12869 raft_consensus.cc:3060] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.310240 12871 raft_consensus.cc:515] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.313932 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:06.314306 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0375afe1e274958a80c20aa1ccae6a3" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:06.314646 12796 raft_consensus.cc:3060] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.315040 12944 raft_consensus.cc:3055] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.315429 12944 raft_consensus.cc:740] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:06.317145 12944 consensus_queue.cc:260] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.318392 12944 raft_consensus.cc:3060] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.319263 12869 raft_consensus.cc:515] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.322204 12869 leader_election.cc:290] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:06.323271 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:06.323729 12871 leader_election.cc:290] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:06.324139 12797 raft_consensus.cc:3060] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.324195 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ae7723e5a4d43bfda643d431c1d11" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:06.325027 12945 raft_consensus.cc:3055] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.325388 12945 raft_consensus.cc:740] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:06.326427 12945 consensus_queue.cc:260] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.328003 12945 raft_consensus.cc:3060] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.329715 12944 raft_consensus.cc:2468] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.331714 12838 leader_election.cc:304] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:06.332693 13042 raft_consensus.cc:2804] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.332931 12797 raft_consensus.cc:2468] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.333099 12796 raft_consensus.cc:2468] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.333324 13042 raft_consensus.cc:697] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:06.334599 13042 consensus_queue.cc:237] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.335151 12837 leader_election.cc:304] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:06.336205 13073 raft_consensus.cc:2804] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.336673 13073 raft_consensus.cc:697] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:06.337553 13073 consensus_queue.cc:237] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:06.342275 12945 raft_consensus.cc:2468] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:06.343607 12694 catalog_manager.cc:5697] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from e44283118803451fa17ec5f8f8f9833e (127.0.107.195) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.358263 12694 catalog_manager.cc:5697] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from e44283118803451fa17ec5f8f8f9833e (127.0.107.195) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.679625 12945 raft_consensus.cc:1275] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.681283 13073 consensus_queue.cc:1048] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.691468 12796 raft_consensus.cc:1275] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.693575 13073 consensus_queue.cc:1048] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:06.721446 12796 raft_consensus.cc:1275] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.723242 13074 consensus_queue.cc:1048] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.736052 12945 raft_consensus.cc:1275] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.738261 13073 consensus_queue.cc:1048] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.749099 12945 raft_consensus.cc:1275] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.750638 12796 raft_consensus.cc:3060] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.750769 13073 consensus_queue.cc:1048] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:06.763778 12796 raft_consensus.cc:1275] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.765957 13042 consensus_queue.cc:1048] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:06.766996 12796 raft_consensus.cc:1275] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.769306 13073 consensus_queue.cc:1048] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.785737 12945 raft_consensus.cc:1275] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.787431 13073 consensus_queue.cc:1048] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:09.003623 12695 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50104:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:09.006364 12695 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:09.063745 12787 tablet_service.cc:1511] Processing CreateTablet for tablet a24148309cba4558af0f1597863fb199 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:09.065514 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24148309cba4558af0f1597863fb199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.065243 12859 tablet_service.cc:1511] Processing CreateTablet for tablet a24148309cba4558af0f1597863fb199 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:09.067162 12859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24148309cba4558af0f1597863fb199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.073876 12936 tablet_service.cc:1511] Processing CreateTablet for tablet a24148309cba4558af0f1597863fb199 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:09.075711 12936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24148309cba4558af0f1597863fb199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.079504 12784 tablet_service.cc:1511] Processing CreateTablet for tablet f52f0bab80f34446a0a595a5de529d8e (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:09.081009 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52f0bab80f34446a0a595a5de529d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.080754 12857 tablet_service.cc:1511] Processing CreateTablet for tablet f52f0bab80f34446a0a595a5de529d8e (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:09.082401 12857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52f0bab80f34446a0a595a5de529d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.092991 12783 tablet_service.cc:1511] Processing CreateTablet for tablet 5792ca081545497eb026a3a6b5c3b368 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:09.094802 12932 tablet_service.cc:1511] Processing CreateTablet for tablet f52f0bab80f34446a0a595a5de529d8e (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:09.096446 12932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52f0bab80f34446a0a595a5de529d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.101161 12861 tablet_service.cc:1511] Processing CreateTablet for tablet 5792ca081545497eb026a3a6b5c3b368 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:09.102900 12861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5792ca081545497eb026a3a6b5c3b368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.103469 12935 tablet_service.cc:1511] Processing CreateTablet for tablet 5792ca081545497eb026a3a6b5c3b368 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:09.106019 12786 tablet_service.cc:1511] Processing CreateTablet for tablet ea540bd71f614b1e80cbd8fce45e6b33 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:09.106480 12935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5792ca081545497eb026a3a6b5c3b368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.094877 12783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5792ca081545497eb026a3a6b5c3b368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.108626 12860 tablet_service.cc:1511] Processing CreateTablet for tablet ea540bd71f614b1e80cbd8fce45e6b33 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:09.110121 12934 tablet_service.cc:1511] Processing CreateTablet for tablet ea540bd71f614b1e80cbd8fce45e6b33 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:09.118880 12855 tablet_service.cc:1511] Processing CreateTablet for tablet 5413bd57ec994a8aa817cdeaeca0e8fa (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:09.119920 12786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea540bd71f614b1e80cbd8fce45e6b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.120563 12855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5413bd57ec994a8aa817cdeaeca0e8fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.124038 12933 tablet_service.cc:1511] Processing CreateTablet for tablet 5413bd57ec994a8aa817cdeaeca0e8fa (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:09.124719 12860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea540bd71f614b1e80cbd8fce45e6b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.125519 12784 tablet_service.cc:1511] Processing CreateTablet for tablet 5413bd57ec994a8aa817cdeaeca0e8fa (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:09.131182 12785 tablet_service.cc:1511] Processing CreateTablet for tablet da4f578d99f34879be9384284ab094b6 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:09.134744 12854 tablet_service.cc:1511] Processing CreateTablet for tablet da4f578d99f34879be9384284ab094b6 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:09.139619 12934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea540bd71f614b1e80cbd8fce45e6b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.141018 12854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4f578d99f34879be9384284ab094b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.141700 12933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5413bd57ec994a8aa817cdeaeca0e8fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.144060 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5413bd57ec994a8aa817cdeaeca0e8fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.145644 12785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4f578d99f34879be9384284ab094b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.152483 13090 tablet_bootstrap.cc:492] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.176545 12936 tablet_service.cc:1511] Processing CreateTablet for tablet da4f578d99f34879be9384284ab094b6 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:09.177230 12787 tablet_service.cc:1511] Processing CreateTablet for tablet ea33500c4b624ccd974ecb31098630d1 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:09.178017 12936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4f578d99f34879be9384284ab094b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.179280 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea33500c4b624ccd974ecb31098630d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.183193 13092 tablet_bootstrap.cc:492] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.181573 13091 tablet_bootstrap.cc:492] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.179754 12857 tablet_service.cc:1511] Processing CreateTablet for tablet ea33500c4b624ccd974ecb31098630d1 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:09.189461 12857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea33500c4b624ccd974ecb31098630d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.206003 13090 tablet_bootstrap.cc:654] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.209286 13091 tablet_bootstrap.cc:654] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.214720 12935 tablet_service.cc:1511] Processing CreateTablet for tablet ea33500c4b624ccd974ecb31098630d1 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:09.217988 12786 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:09.218181 12932 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:09.219483 12786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1547f9a6bb4b0eabbcaf3ef5abd0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.220054 12932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1547f9a6bb4b0eabbcaf3ef5abd0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.237951 12931 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7103651dbc4a7ead5a87b392b08624 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:09.241624 12784 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7103651dbc4a7ead5a87b392b08624 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:09.243136 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7103651dbc4a7ead5a87b392b08624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.246105 13092 tablet_bootstrap.cc:654] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.256721 12935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea33500c4b624ccd974ecb31098630d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.267271 12854 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7103651dbc4a7ead5a87b392b08624 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:09.271925 12854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7103651dbc4a7ead5a87b392b08624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.276067 12861 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 (DEFAULT_TABLE table=soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:09.278476 12861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1547f9a6bb4b0eabbcaf3ef5abd0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.298483 12931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7103651dbc4a7ead5a87b392b08624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.320622 13091 tablet_bootstrap.cc:492] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.321347 13091 ts_tablet_manager.cc:1403] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.013s
I20260709 13:03:09.325095 13091 raft_consensus.cc:359] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.326056 13091 raft_consensus.cc:385] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.326398 13091 raft_consensus.cc:740] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.327344 13091 consensus_queue.cc:260] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.330353 13091 ts_tablet_manager.cc:1434] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:09.334317 13090 tablet_bootstrap.cc:492] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.335151 13090 ts_tablet_manager.cc:1403] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.183s	user 0.032s	sys 0.024s
I20260709 13:03:09.335734 13091 tablet_bootstrap.cc:492] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.339659 13090 raft_consensus.cc:359] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.340580 13090 raft_consensus.cc:385] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.340963 13090 raft_consensus.cc:740] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.341845 13090 consensus_queue.cc:260] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.344483 13090 ts_tablet_manager.cc:1434] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:09.345722 13091 tablet_bootstrap.cc:654] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.345893 13090 tablet_bootstrap.cc:492] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.355301 13090 tablet_bootstrap.cc:654] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.368340 13092 tablet_bootstrap.cc:492] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.369843 13092 ts_tablet_manager.cc:1403] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.003s
I20260709 13:03:09.374099 13092 raft_consensus.cc:359] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.375249 13092 raft_consensus.cc:385] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.375645 13092 raft_consensus.cc:740] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.376575 13092 consensus_queue.cc:260] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.377072 13091 tablet_bootstrap.cc:492] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.379101 13092 ts_tablet_manager.cc:1434] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:03:09.379657 13091 ts_tablet_manager.cc:1403] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.016s
I20260709 13:03:09.380229 13092 tablet_bootstrap.cc:492] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.383456 13091 raft_consensus.cc:359] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.384310 13091 raft_consensus.cc:385] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.384620 13091 raft_consensus.cc:740] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.385406 13091 consensus_queue.cc:260] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.387854 13091 ts_tablet_manager.cc:1434] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:03:09.388944 13091 tablet_bootstrap.cc:492] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.388969 13092 tablet_bootstrap.cc:654] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.397250 13090 tablet_bootstrap.cc:492] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.397825 13090 ts_tablet_manager.cc:1403] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.009s
I20260709 13:03:09.399674 13091 tablet_bootstrap.cc:654] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.401176 13092 tablet_bootstrap.cc:492] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.400926 13090 raft_consensus.cc:359] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.401717 13092 ts_tablet_manager.cc:1403] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:03:09.401755 13090 raft_consensus.cc:385] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.402398 13090 raft_consensus.cc:740] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.403384 13090 consensus_queue.cc:260] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.406034 13090 ts_tablet_manager.cc:1434] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:09.405794 13092 raft_consensus.cc:359] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.406646 13091 tablet_bootstrap.cc:492] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.406698 13092 raft_consensus.cc:385] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.407326 13091 ts_tablet_manager.cc:1403] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:03:09.407652 13090 tablet_bootstrap.cc:492] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.407364 13092 raft_consensus.cc:740] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.408808 13092 consensus_queue.cc:260] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.411643 13092 ts_tablet_manager.cc:1434] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:03:09.411267 13091 raft_consensus.cc:359] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.412385 13091 raft_consensus.cc:385] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.412750 13091 raft_consensus.cc:740] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.413259 13092 tablet_bootstrap.cc:492] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.413600 13091 consensus_queue.cc:260] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.416795 13091 ts_tablet_manager.cc:1434] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:09.417936 13091 tablet_bootstrap.cc:492] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.420324 13090 tablet_bootstrap.cc:654] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.421862 13092 tablet_bootstrap.cc:654] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.425669 13091 tablet_bootstrap.cc:654] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.434980 13092 tablet_bootstrap.cc:492] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.434980 13090 tablet_bootstrap.cc:492] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.436072 13090 ts_tablet_manager.cc:1403] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.002s
I20260709 13:03:09.436072 13092 ts_tablet_manager.cc:1403] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:03:09.440881 13092 raft_consensus.cc:359] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.442924 13090 raft_consensus.cc:359] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.443869 13092 raft_consensus.cc:385] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.443960 13091 tablet_bootstrap.cc:492] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.444061 13090 raft_consensus.cc:385] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.444375 13092 raft_consensus.cc:740] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.444994 13090 raft_consensus.cc:740] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.445012 13091 ts_tablet_manager.cc:1403] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.011s
I20260709 13:03:09.445765 13092 consensus_queue.cc:260] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.446240 13090 consensus_queue.cc:260] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.449258 13092 ts_tablet_manager.cc:1434] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:03:09.449306 13090 ts_tablet_manager.cc:1434] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:03:09.449615 13091 raft_consensus.cc:359] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.450773 13091 raft_consensus.cc:385] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.451004 13092 tablet_bootstrap.cc:492] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.451186 13091 raft_consensus.cc:740] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.451004 13090 tablet_bootstrap.cc:492] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.452607 13091 consensus_queue.cc:260] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.455698 13091 ts_tablet_manager.cc:1434] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:03:09.457070 13091 tablet_bootstrap.cc:492] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.462045 13092 tablet_bootstrap.cc:654] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.462045 13090 tablet_bootstrap.cc:654] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.466015 13091 tablet_bootstrap.cc:654] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.480611 13091 tablet_bootstrap.cc:492] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.481276 13091 ts_tablet_manager.cc:1403] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.015s
I20260709 13:03:09.483876 13092 tablet_bootstrap.cc:492] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.484972 13092 ts_tablet_manager.cc:1403] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.022s
I20260709 13:03:09.485350 13091 raft_consensus.cc:359] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.486275 13091 raft_consensus.cc:385] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.486554 13094 raft_consensus.cc:493] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.486608 13091 raft_consensus.cc:740] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.487357 13094 raft_consensus.cc:515] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.487958 13091 consensus_queue.cc:260] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.489497 13092 raft_consensus.cc:359] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.490394 13092 raft_consensus.cc:385] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.490773 13092 raft_consensus.cc:740] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.490949 13091 ts_tablet_manager.cc:1434] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:03:09.491149 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24148309cba4558af0f1597863fb199" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:09.491976 12797 raft_consensus.cc:2468] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 0.
I20260709 13:03:09.492033 13092 consensus_queue.cc:260] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.493831 12837 leader_election.cc:304] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:09.494963 13073 raft_consensus.cc:2804] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.495193 13092 ts_tablet_manager.cc:1434] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:03:09.495391 13073 raft_consensus.cc:493] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.495944 13094 leader_election.cc:290] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.496016 13073 raft_consensus.cc:3060] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.496775 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24148309cba4558af0f1597863fb199" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:09.497148 13092 tablet_bootstrap.cc:492] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.497516 12945 raft_consensus.cc:2468] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 0.
I20260709 13:03:09.505689 13073 raft_consensus.cc:515] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.507768 13091 tablet_bootstrap.cc:492] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.517103 13091 tablet_bootstrap.cc:654] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.522014 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24148309cba4558af0f1597863fb199" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:09.522997 12797 raft_consensus.cc:3060] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.523226 13092 tablet_bootstrap.cc:654] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:09.523818 12763 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52717.4us
I20260709 13:03:09.532476 13092 tablet_bootstrap.cc:492] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.532403 12797 raft_consensus.cc:2468] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 1.
I20260709 13:03:09.532850 13090 tablet_bootstrap.cc:492] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.533380 13092 ts_tablet_manager.cc:1403] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.005s
I20260709 13:03:09.533665 13090 ts_tablet_manager.cc:1403] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.083s	user 0.036s	sys 0.023s
I20260709 13:03:09.534618 12837 leader_election.cc:304] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:09.535733 13094 raft_consensus.cc:2804] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.536319 13094 raft_consensus.cc:697] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:09.537276 13094 consensus_queue.cc:237] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.537710 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24148309cba4558af0f1597863fb199" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:09.538658 12945 raft_consensus.cc:3060] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.537642 13092 raft_consensus.cc:359] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.544499 13092 raft_consensus.cc:385] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.544942 13092 raft_consensus.cc:740] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.545857 13092 consensus_queue.cc:260] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.547691 13073 leader_election.cc:290] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.548036 12945 raft_consensus.cc:2468] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 1.
I20260709 13:03:09.548460 13092 ts_tablet_manager.cc:1434] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 13:03:09.549232 13008 raft_consensus.cc:493] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.550002 13092 tablet_bootstrap.cc:492] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.549842 13008 raft_consensus.cc:515] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.543251 13090 raft_consensus.cc:359] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.551278 13090 raft_consensus.cc:385] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.551779 13090 raft_consensus.cc:740] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.552675 13090 consensus_queue.cc:260] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.553278 13008 leader_election.cc:290] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.554303 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f0bab80f34446a0a595a5de529d8e" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:09.555259 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f0bab80f34446a0a595a5de529d8e" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:09.557451 12871 raft_consensus.cc:2468] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:09.558249 12945 raft_consensus.cc:2468] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:09.560649 12763 leader_election.cc:304] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:09.561100 13090 ts_tablet_manager.cc:1434] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:03:09.562120 13008 raft_consensus.cc:2804] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.562592 13008 raft_consensus.cc:493] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.562852 13090 tablet_bootstrap.cc:492] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.562968 13008 raft_consensus.cc:3060] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.573091 13090 tablet_bootstrap.cc:654] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.575443 13092 tablet_bootstrap.cc:654] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.572835 12693 catalog_manager.cc:5697] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.580425 13077 raft_consensus.cc:493] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.581211 13008 raft_consensus.cc:515] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.581629 13077 raft_consensus.cc:515] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.586189 13077 leader_election.cc:290] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:09.586274 13008 leader_election.cc:290] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.587158 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f0bab80f34446a0a595a5de529d8e" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:09.587445 13094 raft_consensus.cc:493] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.588088 12945 raft_consensus.cc:3060] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.588338 13094 raft_consensus.cc:515] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.591789 13094 leader_election.cc:290] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.592471 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:09.593425 12871 raft_consensus.cc:2468] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:09.594808 12909 leader_election.cc:304] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:09.594977 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:09.595681 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f0bab80f34446a0a595a5de529d8e" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:09.595922 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:09.596365 12869 raft_consensus.cc:3060] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.596448 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
W20260709 13:03:09.596701 12837 leader_election.cc:343] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.596778 12797 raft_consensus.cc:2468] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:09.599390 13077 raft_consensus.cc:2804] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:09.600100 12838 leader_election.cc:343] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.600927 12838 leader_election.cc:304] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:09.604041 13094 raft_consensus.cc:2749] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.600124 13077 raft_consensus.cc:493] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.605566 13077 raft_consensus.cc:3060] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.609045 13092 tablet_bootstrap.cc:492] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.609835 13092 ts_tablet_manager.cc:1403] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.012s
I20260709 13:03:09.614161 13092 raft_consensus.cc:359] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.614763 13090 tablet_bootstrap.cc:492] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.615378 13092 raft_consensus.cc:385] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.615705 13090 ts_tablet_manager.cc:1403] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.016s
I20260709 13:03:09.615944 13092 raft_consensus.cc:740] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.617270 13092 consensus_queue.cc:260] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.620138 13092 ts_tablet_manager.cc:1434] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:09.619688 13090 raft_consensus.cc:359] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.621254 13090 raft_consensus.cc:385] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.621740 13090 raft_consensus.cc:740] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.617800 13091 tablet_bootstrap.cc:492] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.622115 13092 tablet_bootstrap.cc:492] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.622985 13091 ts_tablet_manager.cc:1403] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.011s
I20260709 13:03:09.622802 13090 consensus_queue.cc:260] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.625996 13090 ts_tablet_manager.cc:1434] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:09.620874 12945 raft_consensus.cc:2468] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:09.628341 12763 leader_election.cc:304] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:09.629822 13091 raft_consensus.cc:359] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.630813 13008 raft_consensus.cc:2804] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.631632 13008 raft_consensus.cc:697] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:09.632426 13092 tablet_bootstrap.cc:654] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.632788 13008 consensus_queue.cc:237] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.637634 13090 tablet_bootstrap.cc:492] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.630877 13091 raft_consensus.cc:385] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.653506 13094 raft_consensus.cc:493] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.656867 13094 raft_consensus.cc:515] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.670172 13077 raft_consensus.cc:515] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.670773 13094 leader_election.cc:290] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.672374 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:09.673156 12797 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 0.
I20260709 13:03:09.656087 13091 raft_consensus.cc:740] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.677467 12837 leader_election.cc:304] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:09.676002 13119 raft_consensus.cc:493] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.678469 13094 raft_consensus.cc:2804] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.678505 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:09.679929 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:09.680054 12797 raft_consensus.cc:3060] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.679009 13119 raft_consensus.cc:515] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.684641 13077 leader_election.cc:290] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:09.682992 12945 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 0.
I20260709 13:03:09.679215 13094 raft_consensus.cc:493] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.685568 13094 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.685968 13091 consensus_queue.cc:260] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.668017 12869 raft_consensus.cc:2468] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:09.689318 13119 leader_election.cc:290] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:09.690409 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
W20260709 13:03:09.692730 12911 leader_election.cc:343] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.698068 13090 tablet_bootstrap.cc:654] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.687155 13092 tablet_bootstrap.cc:492] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.700114 13092 ts_tablet_manager.cc:1403] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.010s
I20260709 13:03:09.703980 13092 raft_consensus.cc:359] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.704978 13092 raft_consensus.cc:385] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.705353 13092 raft_consensus.cc:740] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.706404 13093 raft_consensus.cc:493] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.707235 13093 raft_consensus.cc:515] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.706257 13092 consensus_queue.cc:260] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.715992 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:09.717374 13092 ts_tablet_manager.cc:1434] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:03:09.711462 12797 raft_consensus.cc:2468] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:09.718107 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:09.718827 13092 tablet_bootstrap.cc:492] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.719208 12911 leader_election.cc:304] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
W20260709 13:03:09.720104 12837 leader_election.cc:343] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.720413 13119 raft_consensus.cc:2804] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.723747 13119 raft_consensus.cc:697] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:09.724838 13119 consensus_queue.cc:237] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.699374 13094 raft_consensus.cc:515] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
W20260709 13:03:09.728065 12838 leader_election.cc:343] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.728824 12838 leader_election.cc:304] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:09.715118 13093 leader_election.cc:290] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.731809 13094 leader_election.cc:290] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.733398 13073 raft_consensus.cc:2749] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.735148 13091 ts_tablet_manager.cc:1434] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.112s	user 0.012s	sys 0.011s
W20260709 13:03:09.735744 12909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45387, user_credentials={real_user=slave}} blocked reactor thread for 59841.9us
I20260709 13:03:09.739836 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:09.740698 12869 raft_consensus.cc:3060] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.741465 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:09.741720 13090 tablet_bootstrap.cc:492] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.742249 12797 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.742568 13090 ts_tablet_manager.cc:1403] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.003s
I20260709 13:03:09.745600 13091 tablet_bootstrap.cc:492] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.749425 13090 raft_consensus.cc:359] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.750651 13090 raft_consensus.cc:385] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.751109 13090 raft_consensus.cc:740] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.751291 12869 raft_consensus.cc:2468] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:09.754108 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:09.755002 13092 tablet_bootstrap.cc:654] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.757411 13090 consensus_queue.cc:260] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
W20260709 13:03:09.762511 12909 leader_election.cc:343] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.765920 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:09.766765 12944 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.767576 13091 tablet_bootstrap.cc:654] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.768563 12797 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 1.
I20260709 13:03:09.770223 12837 leader_election.cc:304] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:09.763300 12909 leader_election.cc:304] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e44283118803451fa17ec5f8f8f9833e; no voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:09.772511 13093 raft_consensus.cc:2804] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.773698 12691 catalog_manager.cc:5697] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.771984 13090 ts_tablet_manager.cc:1434] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.003s
I20260709 13:03:09.778486 12944 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 1.
I20260709 13:03:09.779804 13093 raft_consensus.cc:697] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:09.781572 13093 consensus_queue.cc:237] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.789456 13077 raft_consensus.cc:2749] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.793227 13090 tablet_bootstrap.cc:492] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.799499 13091 tablet_bootstrap.cc:492] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.808423 13091 ts_tablet_manager.cc:1403] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.003s
I20260709 13:03:09.811255 13090 tablet_bootstrap.cc:654] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.811924 13091 raft_consensus.cc:359] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.812667 13091 raft_consensus.cc:385] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.813211 13091 raft_consensus.cc:740] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.812568 12695 catalog_manager.cc:5697] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.814006 13091 consensus_queue.cc:260] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.804108 12691 catalog_manager.cc:5697] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.816862 13091 ts_tablet_manager.cc:1434] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:09.817996 13091 tablet_bootstrap.cc:492] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.802965 13092 tablet_bootstrap.cc:492] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.824496 13092 ts_tablet_manager.cc:1403] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.018s
I20260709 13:03:09.824822 13091 tablet_bootstrap.cc:654] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.831619 13092 raft_consensus.cc:359] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.832624 13092 raft_consensus.cc:385] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.833262 13092 raft_consensus.cc:740] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.834257 13092 consensus_queue.cc:260] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.836826 13092 ts_tablet_manager.cc:1434] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:03:09.837960 13092 tablet_bootstrap.cc:492] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: Bootstrap starting.
I20260709 13:03:09.841140 13090 tablet_bootstrap.cc:492] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.841910 13090 ts_tablet_manager.cc:1403] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.004s
I20260709 13:03:09.845844 13090 raft_consensus.cc:359] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.847404 13091 tablet_bootstrap.cc:492] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.848104 13091 ts_tablet_manager.cc:1403] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
I20260709 13:03:09.851521 13091 raft_consensus.cc:359] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.852406 13091 raft_consensus.cc:385] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.846706 13090 raft_consensus.cc:385] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:09.852640 12743 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:09.853139 13090 raft_consensus.cc:740] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.852720 13091 raft_consensus.cc:740] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.854089 13090 consensus_queue.cc:260] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.855118 13091 consensus_queue.cc:260] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.856976 13091 ts_tablet_manager.cc:1434] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:09.859871 13090 ts_tablet_manager.cc:1434] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:03:09.861258 13090 tablet_bootstrap.cc:492] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.867075 13092 tablet_bootstrap.cc:654] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.869163 13090 tablet_bootstrap.cc:654] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.875679 13091 tablet_bootstrap.cc:492] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: Bootstrap starting.
I20260709 13:03:09.882908 13091 tablet_bootstrap.cc:654] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.884006 13092 tablet_bootstrap.cc:492] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: No bootstrap required, opened a new log
I20260709 13:03:09.884765 13092 ts_tablet_manager.cc:1403] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.007s
I20260709 13:03:09.890689 13092 raft_consensus.cc:359] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.891449 13092 raft_consensus.cc:385] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.891793 13092 raft_consensus.cc:740] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.892827 13092 consensus_queue.cc:260] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.894253 13091 tablet_bootstrap.cc:492] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: No bootstrap required, opened a new log
I20260709 13:03:09.895102 13091 ts_tablet_manager.cc:1403] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.005s
I20260709 13:03:09.895457 13092 ts_tablet_manager.cc:1434] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:09.891803 13090 tablet_bootstrap.cc:492] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.896474 13090 ts_tablet_manager.cc:1403] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.013s
I20260709 13:03:09.898577 13091 raft_consensus.cc:359] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.899678 13090 raft_consensus.cc:359] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.900516 13090 raft_consensus.cc:385] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.900049 13091 raft_consensus.cc:385] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.900815 13090 raft_consensus.cc:740] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.901161 13091 raft_consensus.cc:740] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.901854 13090 consensus_queue.cc:260] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.902007 13091 consensus_queue.cc:260] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.904807 13091 ts_tablet_manager.cc:1434] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:09.906461 13090 ts_tablet_manager.cc:1434] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:09.907723 13090 tablet_bootstrap.cc:492] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: Bootstrap starting.
I20260709 13:03:09.913285 13090 tablet_bootstrap.cc:654] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.922971 13090 tablet_bootstrap.cc:492] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: No bootstrap required, opened a new log
I20260709 13:03:09.923983 13090 ts_tablet_manager.cc:1403] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:03:09.927191 13090 raft_consensus.cc:359] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.928077 13090 raft_consensus.cc:385] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.928382 13090 raft_consensus.cc:740] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.929159 13090 consensus_queue.cc:260] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.929396 13093 consensus_queue.cc:1048] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:09.931658 13090 ts_tablet_manager.cc:1434] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:09.944756 13124 consensus_queue.cc:1048] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:09.946506 13133 raft_consensus.cc:493] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.947230 13133 raft_consensus.cc:515] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.950608 13133 leader_election.cc:290] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.953176 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:09.954387 12869 raft_consensus.cc:2468] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:09.953351 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:09.955430 12945 raft_consensus.cc:2468] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:09.959472 12763 leader_election.cc:304] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:09.960857 13133 raft_consensus.cc:2804] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.961274 13133 raft_consensus.cc:493] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.961619 13133 raft_consensus.cc:3060] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.972084 13133 raft_consensus.cc:515] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.974586 13133 leader_election.cc:290] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.975855 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:09.975701 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:09.976733 12869 raft_consensus.cc:3060] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.976733 12944 raft_consensus.cc:3060] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.986258 12944 raft_consensus.cc:2468] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:09.986541 12869 raft_consensus.cc:2468] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:09.987958 12760 leader_election.cc:304] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:09.988989 13133 raft_consensus.cc:2804] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.989485 13133 raft_consensus.cc:697] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:09.990226 13133 consensus_queue.cc:237] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.991618 13107 raft_consensus.cc:493] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.992295 13107 raft_consensus.cc:515] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:09.995788 13107 leader_election.cc:290] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:09.996063 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:09.996372 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:09.996924 12869 raft_consensus.cc:2468] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:09.997012 12944 raft_consensus.cc:2468] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:09.998342 12763 leader_election.cc:304] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:09.999161 13107 raft_consensus.cc:2804] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.999771 13107 raft_consensus.cc:493] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.000099 13107 raft_consensus.cc:3060] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.000833 12693 catalog_manager.cc:5697] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.007783 13107 raft_consensus.cc:515] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.010814 13107 leader_election.cc:290] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.012478 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.012553 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.013741 12869 raft_consensus.cc:3060] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.013741 12944 raft_consensus.cc:3060] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.016093 13107 raft_consensus.cc:493] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.016745 13107 raft_consensus.cc:515] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.018832 13107 leader_election.cc:290] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.019786 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:10.020390 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e" is_pre_election: true
I20260709 13:03:10.020599 12870 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:10.021275 12945 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 0.
I20260709 13:03:10.021917 12760 leader_election.cc:304] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:10.022996 13107 raft_consensus.cc:2804] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.023417 13107 raft_consensus.cc:493] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.023831 13107 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.023831 12944 raft_consensus.cc:2468] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:10.025565 12763 leader_election.cc:304] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.026490 13133 raft_consensus.cc:2804] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.027016 13133 raft_consensus.cc:697] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.027082 12869 raft_consensus.cc:2468] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:10.028136 13133 consensus_queue.cc:237] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.032670 13107 raft_consensus.cc:515] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.035758 13107 leader_election.cc:290] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.036715 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.036898 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.037547 12869 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.037603 12944 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.040031 12693 catalog_manager.cc:5697] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.045090 12869 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:10.047672 12760 leader_election.cc:304] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:10.047978 12944 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 1.
I20260709 13:03:10.048817 13107 raft_consensus.cc:2804] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.049414 13107 raft_consensus.cc:697] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.050343 13107 consensus_queue.cc:237] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.060829 12693 catalog_manager.cc:5697] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.062235 13107 consensus_queue.cc:1048] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.068477 13077 raft_consensus.cc:493] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.069202 13077 raft_consensus.cc:515] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.072605 13077 leader_election.cc:290] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:10.073339 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:10.074182 12869 raft_consensus.cc:2468] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:10.074314 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:10.075204 12797 raft_consensus.cc:2468] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:10.076200 12909 leader_election.cc:304] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.077085 13077 raft_consensus.cc:2804] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.077741 13077 raft_consensus.cc:493] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.078078 13077 raft_consensus.cc:3060] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.079643 13107 consensus_queue.cc:1048] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.087419 13077 raft_consensus.cc:515] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.091176 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:10.091605 13077 leader_election.cc:290] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:10.092013 12797 raft_consensus.cc:3060] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.094151 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.094980 12870 raft_consensus.cc:3060] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.101847 12797 raft_consensus.cc:2468] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:10.103219 12911 leader_election.cc:304] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.104391 13077 raft_consensus.cc:2804] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.105381 13077 raft_consensus.cc:697] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:10.106702 13077 consensus_queue.cc:237] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.104359 12870 raft_consensus.cc:2468] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:10.122676 12693 catalog_manager.cc:5697] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.161222 13077 raft_consensus.cc:493] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.161903 13077 raft_consensus.cc:515] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.164733 13077 leader_election.cc:290] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:10.165179 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7103651dbc4a7ead5a87b392b08624" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72" is_pre_election: true
I20260709 13:03:10.165480 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7103651dbc4a7ead5a87b392b08624" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" is_pre_election: true
I20260709 13:03:10.166072 12870 raft_consensus.cc:2468] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:10.166069 12797 raft_consensus.cc:2468] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 0.
I20260709 13:03:10.167421 12911 leader_election.cc:304] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.168339 13119 raft_consensus.cc:2804] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.168707 13119 raft_consensus.cc:493] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.169040 13119 raft_consensus.cc:3060] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.176390 13119 raft_consensus.cc:515] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.178727 13119 leader_election.cc:290] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:10.179962 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7103651dbc4a7ead5a87b392b08624" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.179981 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7103651dbc4a7ead5a87b392b08624" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:10.180794 12869 raft_consensus.cc:3060] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.180858 12797 raft_consensus.cc:3060] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.185858 13119 consensus_queue.cc:1048] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.189939 12797 raft_consensus.cc:2468] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:10.190454 12869 raft_consensus.cc:2468] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 1.
I20260709 13:03:10.191800 12911 leader_election.cc:304] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.192967 13119 raft_consensus.cc:2804] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.193558 13119 raft_consensus.cc:697] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:10.194487 13119 consensus_queue.cc:237] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.202495 13119 consensus_queue.cc:1048] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.208983 12691 catalog_manager.cc:5697] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 0 to 1, leader changed from <none> to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.215692 13124 consensus_queue.cc:1048] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.229156 13094 consensus_queue.cc:1048] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.254799 12869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24148309cba4558af0f1597863fb199"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
mode: GRACEFUL
new_leader_uuid: "2351aea55ff64112af613300ddc24b72"
 from {username='slave'} at 127.0.0.1:40514
I20260709 13:03:10.255597 12869 raft_consensus.cc:606] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Received request to transfer leadership to TS 2351aea55ff64112af613300ddc24b72
I20260709 13:03:10.265405 12944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
mode: GRACEFUL
new_leader_uuid: "2351aea55ff64112af613300ddc24b72"
 from {username='slave'} at 127.0.0.1:59354
I20260709 13:03:10.266166 12944 raft_consensus.cc:606] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Received request to transfer leadership to TS 2351aea55ff64112af613300ddc24b72
I20260709 13:03:10.273010 12869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
mode: GRACEFUL
new_leader_uuid: "2351aea55ff64112af613300ddc24b72"
 from {username='slave'} at 127.0.0.1:40514
I20260709 13:03:10.273698 12869 raft_consensus.cc:606] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Received request to transfer leadership to TS 2351aea55ff64112af613300ddc24b72
I20260709 13:03:10.280433 12796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:03:10.281255 12796 raft_consensus.cc:606] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:10.288272 12796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4f578d99f34879be9384284ab094b6"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:03:10.288960 12796 raft_consensus.cc:606] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:10.296026 12796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:03:10.296703 12796 raft_consensus.cc:606] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:10.303453 12944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
mode: GRACEFUL
new_leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:59354
I20260709 13:03:10.304153 12944 raft_consensus.cc:606] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Received request to transfer leadership to TS 2cd0edf173e64b11b1d7052cfb92c26e
I20260709 13:03:10.418394 13124 raft_consensus.cc:993] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: : Instructing follower 2351aea55ff64112af613300ddc24b72 to start an election
I20260709 13:03:10.419023 13124 raft_consensus.cc:1081] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Signalling peer 2351aea55ff64112af613300ddc24b72 to start an election
I20260709 13:03:10.421000 12796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a24148309cba4558af0f1597863fb199"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
 from {username='slave'} at 127.0.0.1:36110
I20260709 13:03:10.421789 12796 raft_consensus.cc:493] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.422106 12796 raft_consensus.cc:3060] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.429574 12796 raft_consensus.cc:515] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.431943 12796 leader_election.cc:290] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 2 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.432960 12869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24148309cba4558af0f1597863fb199" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.433291 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24148309cba4558af0f1597863fb199" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.435604 12944 raft_consensus.cc:3060] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.435563 12869 raft_consensus.cc:3055] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.436405 12869 raft_consensus.cc:740] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:10.437130 12869 consensus_queue.cc:260] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.438205 12869 raft_consensus.cc:3060] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.444239 12869 raft_consensus.cc:2468] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 2.
I20260709 13:03:10.444759 12944 raft_consensus.cc:2468] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 2.
I20260709 13:03:10.445534 12760 leader_election.cc:304] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:10.447283 13107 raft_consensus.cc:2804] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.448606 13107 raft_consensus.cc:697] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.449681 13107 consensus_queue.cc:237] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.457448 13107 consensus_queue.cc:1048] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.457584 12695 catalog_manager.cc:5697] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 1 to 2, leader changed from 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194) to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.468479 13008 raft_consensus.cc:993] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.468992 13133 raft_consensus.cc:1081] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.474968 12869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40500
I20260709 13:03:10.476526 13133 consensus_queue.cc:1048] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.476585 12869 raft_consensus.cc:493] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.478426 12869 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.486539 12869 raft_consensus.cc:515] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.489696 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:10.489915 12869 leader_election.cc:290] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.490195 12945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.490517 12796 raft_consensus.cc:3055] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.490989 12796 raft_consensus.cc:740] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.491113 12945 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.493475 12796 consensus_queue.cc:260] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.495062 12796 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.500856 12945 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.504210 12838 leader_election.cc:304] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.505182 13124 raft_consensus.cc:2804] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.505702 13124 raft_consensus.cc:697] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:10.506599 13124 consensus_queue.cc:237] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.506978 12796 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.514417 13107 consensus_queue.cc:1048] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.516099 12691 catalog_manager.cc:5697] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from 2351aea55ff64112af613300ddc24b72 (127.0.107.193) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.530099 13133 consensus_queue.cc:1048] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.541586 13107 consensus_queue.cc:1048] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.543380 13133 raft_consensus.cc:993] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.543984 13107 raft_consensus.cc:1081] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.546038 12870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da4f578d99f34879be9384284ab094b6"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40500
I20260709 13:03:10.546679 12870 raft_consensus.cc:493] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.547165 12870 raft_consensus.cc:3060] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.550868 13107 raft_consensus.cc:993] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.551510 13008 raft_consensus.cc:1081] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.557713 12871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40500
I20260709 13:03:10.558768 12871 raft_consensus.cc:493] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.559332 12871 raft_consensus.cc:3060] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.558864 12870 raft_consensus.cc:515] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.563053 13008 consensus_queue.cc:1048] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.563300 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.563999 12944 raft_consensus.cc:3060] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.565196 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4f578d99f34879be9384284ab094b6" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:10.566006 12796 raft_consensus.cc:3055] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.566352 12796 raft_consensus.cc:740] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.567457 12796 consensus_queue.cc:260] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.568300 12871 raft_consensus.cc:515] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.568841 12796 raft_consensus.cc:3060] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.580744 12871 leader_election.cc:290] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.582736 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.584617 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea33500c4b624ccd974ecb31098630d1" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:10.585366 12797 raft_consensus.cc:3055] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.585733 12797 raft_consensus.cc:740] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.586750 12797 consensus_queue.cc:260] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.587076 12796 raft_consensus.cc:2468] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.588042 12797 raft_consensus.cc:3060] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.588943 12837 leader_election.cc:304] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:10.590021 13124 raft_consensus.cc:2804] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.590548 13124 raft_consensus.cc:697] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:10.591472 13124 consensus_queue.cc:237] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.592988 13119 consensus_queue.cc:1048] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.599918 12870 leader_election.cc:290] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.601408 12944 raft_consensus.cc:2468] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.603914 12797 raft_consensus.cc:2468] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.605405 12837 leader_election.cc:304] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:10.605768 12691 catalog_manager.cc:5697] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from 2351aea55ff64112af613300ddc24b72 (127.0.107.193) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.606948 13124 raft_consensus.cc:2804] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.607705 13124 raft_consensus.cc:697] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:10.608662 13124 consensus_queue.cc:237] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.620529 13119 consensus_queue.cc:1048] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.625445 12694 catalog_manager.cc:5697] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from 2351aea55ff64112af613300ddc24b72 (127.0.107.193) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.631265 13121 raft_consensus.cc:993] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: : Instructing follower 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.631866 13121 raft_consensus.cc:1081] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Signalling peer 2cd0edf173e64b11b1d7052cfb92c26e to start an election
I20260709 13:03:10.639858 12870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:03:10.640602 12870 raft_consensus.cc:493] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.641080 12870 raft_consensus.cc:3060] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.647943 12870 raft_consensus.cc:515] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.649721 12870 leader_election.cc:290] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.651226 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:10.651224 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1547f9a6bb4b0eabbcaf3ef5abd0b8" candidate_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.652158 12796 raft_consensus.cc:3060] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.652467 12944 raft_consensus.cc:3055] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.652868 12944 raft_consensus.cc:740] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:10.653723 12944 consensus_queue.cc:260] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.655056 12944 raft_consensus.cc:3060] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.659368 12796 raft_consensus.cc:2468] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.660815 12944 raft_consensus.cc:2468] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd0edf173e64b11b1d7052cfb92c26e in term 2.
I20260709 13:03:10.661155 12837 leader_election.cc:304] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:10.662227 13124 raft_consensus.cc:2804] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.662781 13124 raft_consensus.cc:697] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Leader. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:10.663527 13124 consensus_queue.cc:237] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.668255 13073 raft_consensus.cc:993] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: : Instructing follower 2351aea55ff64112af613300ddc24b72 to start an election
I20260709 13:03:10.668823 13124 raft_consensus.cc:1081] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Signalling peer 2351aea55ff64112af613300ddc24b72 to start an election
I20260709 13:03:10.670962 12796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
 from {username='slave'} at 127.0.0.1:36110
I20260709 13:03:10.671734 12796 raft_consensus.cc:493] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.672101 12796 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.672575 12694 catalog_manager.cc:5697] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e reported cstate change: term changed from 1 to 2, leader changed from e44283118803451fa17ec5f8f8f9833e (127.0.107.195) to 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.678980 12796 raft_consensus.cc:515] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.681872 12796 leader_election.cc:290] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 2 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.682958 12870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.683192 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.683806 12944 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.683806 12870 raft_consensus.cc:3055] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.684433 12870 raft_consensus.cc:740] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:10.685377 12870 consensus_queue.cc:260] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.692718 12870 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.694182 12944 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 2.
I20260709 13:03:10.695399 12763 leader_election.cc:304] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:10.696285 13008 raft_consensus.cc:2804] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.696748 13008 raft_consensus.cc:697] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.697413 13008 consensus_queue.cc:237] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.702704 13077 consensus_queue.cc:1048] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.706561 12694 catalog_manager.cc:5697] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 1 to 2, leader changed from 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194) to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.707933 12870 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 2.
I20260709 13:03:10.720362 13077 consensus_queue.cc:1048] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.792979 13162 raft_consensus.cc:993] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: : Instructing follower 2351aea55ff64112af613300ddc24b72 to start an election
I20260709 13:03:10.793860 13119 raft_consensus.cc:1081] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Signalling peer 2351aea55ff64112af613300ddc24b72 to start an election
I20260709 13:03:10.796269 12796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
 from {username='slave'} at 127.0.0.1:36126
I20260709 13:03:10.796968 12796 raft_consensus.cc:493] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.797314 12796 raft_consensus.cc:3060] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.803510 12796 raft_consensus.cc:515] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.805771 12796 leader_election.cc:290] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 2 election: Requested vote from peers 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387), e44283118803451fa17ec5f8f8f9833e (127.0.107.195:39091)
I20260709 13:03:10.806815 12871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:10.807188 12944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5792ca081545497eb026a3a6b5c3b368" candidate_uuid: "2351aea55ff64112af613300ddc24b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
I20260709 13:03:10.807596 12871 raft_consensus.cc:3060] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.807998 12944 raft_consensus.cc:3055] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.808308 12944 raft_consensus.cc:740] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:10.809018 12944 consensus_queue.cc:260] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.810534 12944 raft_consensus.cc:3060] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.813426 12871 raft_consensus.cc:2468] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 2.
I20260709 13:03:10.815016 12760 leader_election.cc:304] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, 2cd0edf173e64b11b1d7052cfb92c26e; no voters: 
I20260709 13:03:10.815840 13008 raft_consensus.cc:2804] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.816249 13008 raft_consensus.cc:697] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Becoming Leader. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:10.816927 13008 consensus_queue.cc:237] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:10.817725 12944 raft_consensus.cc:2468] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2351aea55ff64112af613300ddc24b72 in term 2.
I20260709 13:03:10.825241 12695 catalog_manager.cc:5697] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 reported cstate change: term changed from 1 to 2, leader changed from e44283118803451fa17ec5f8f8f9833e (127.0.107.195) to 2351aea55ff64112af613300ddc24b72 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2351aea55ff64112af613300ddc24b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.909874 12944 raft_consensus.cc:1275] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2351aea55ff64112af613300ddc24b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.911795 13008 consensus_queue.cc:1048] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:10.922608 12871 raft_consensus.cc:1275] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Refusing update from remote peer 2351aea55ff64112af613300ddc24b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.925482 13107 consensus_queue.cc:1048] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:10.974483 12796 raft_consensus.cc:1275] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.976270 13124 consensus_queue.cc:1048] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.986418 12944 raft_consensus.cc:1275] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.988524 13094 consensus_queue.cc:1048] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.996095 12796 raft_consensus.cc:1275] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.997912 12944 raft_consensus.cc:1275] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.998836 13094 consensus_queue.cc:1048] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.000110 13165 consensus_queue.cc:1048] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.012709 12945 raft_consensus.cc:3060] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.022610 12945 raft_consensus.cc:1275] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.024995 13165 consensus_queue.cc:1048] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.028302 12796 raft_consensus.cc:1275] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.033174 13165 consensus_queue.cc:1048] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.060957 12944 raft_consensus.cc:1275] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.062515 13094 consensus_queue.cc:1048] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.072108 12796 raft_consensus.cc:1275] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer 2cd0edf173e64b11b1d7052cfb92c26e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.075413 13124 consensus_queue.cc:1048] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.106787 12944 raft_consensus.cc:1275] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2351aea55ff64112af613300ddc24b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.108446 13107 consensus_queue.cc:1048] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.118748 12871 raft_consensus.cc:1275] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Refusing update from remote peer 2351aea55ff64112af613300ddc24b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.122229 13133 consensus_queue.cc:1048] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.264379 12871 raft_consensus.cc:1275] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Refusing update from remote peer 2351aea55ff64112af613300ddc24b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.266217 13133 consensus_queue.cc:1048] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.277676 12944 raft_consensus.cc:1275] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Refusing update from remote peer 2351aea55ff64112af613300ddc24b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.279337 13164 consensus_queue.cc:1048] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:13.312041 12695 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50104:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:13.336374 12695 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50104:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:13.431751   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:03:13.607329 13191 log.cc:927] Time spent T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:03:13.723902 13221 tablet.cc:1724] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:13.748549 13214 log.cc:927] Time spent T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:03:13.738416 13220 tablet.cc:1724] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.782068 13226 tablet.cc:1724] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.762112 13229 tablet.cc:1724] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.756281 13218 tablet.cc:1724] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.853112 13227 tablet.cc:1724] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.866612 13233 tablet.cc:1724] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.861770 13230 tablet.cc:1724] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:13.895502 13223 log.cc:927] Time spent T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.003s
I20260709 13:03:13.914047 13236 tablet.cc:1724] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.918376 12870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
mode: GRACEFUL
new_leader_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:33858
I20260709 13:03:13.919263 12870 raft_consensus.cc:606] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Received request to transfer leadership to TS e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:13.920058 13221 tablet.cc:1724] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.906561 13237 tablet.cc:1724] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.932780 13218 tablet.cc:1724] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.886627 13231 tablet.cc:1724] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.959966 13226 tablet.cc:1724] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.969039 13220 tablet.cc:1724] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:13.998962 13229 tablet.cc:1724] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.002092 13197 raft_consensus.cc:993] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: : Instructing follower e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:13.952416 13239 tablet.cc:1724] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.002946 13204 raft_consensus.cc:1081] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Signalling peer e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.005713 12939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:59326
I20260709 13:03:14.006647 12939 raft_consensus.cc:493] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.007133 12939 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.031605 13218 tablet.cc:1724] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.042229 13230 tablet.cc:1724] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.048930 13227 tablet.cc:1724] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.059224 12939 raft_consensus.cc:515] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.033038 13220 tablet.cc:1724] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.075268 13221 tablet.cc:1724] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.085865 13233 tablet.cc:1724] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.073562 13236 tablet.cc:1724] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.082929 12796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
mode: GRACEFUL
new_leader_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:52504
I20260709 13:03:14.090404 12796 raft_consensus.cc:606] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Received request to transfer leadership to TS e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:14.095304   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:03:14.096264   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.104454 12939 leader_election.cc:290] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 3 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:14.107594 12867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:14.097632 13237 tablet.cc:1724] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.108381 12867 raft_consensus.cc:3055] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:14.108809 12867 raft_consensus.cc:740] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:14.109838 12867 consensus_queue.cc:260] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.101980 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413bd57ec994a8aa817cdeaeca0e8fa" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:14.113291 12796 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.111377 12867 raft_consensus.cc:3060] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.116966 13236 tablet.cc:1724] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.127665 13227 tablet.cc:1724] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:14.146971 12796 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 3.
I20260709 13:03:14.148831 12911 leader_election.cc:304] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:14.149933 13180 raft_consensus.cc:2804] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:14.150509 13180 raft_consensus.cc:697] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 3 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:14.151773 12870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b4038ed899742c6b84a759162730f97"
dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
mode: GRACEFUL
new_leader_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:33858
I20260709 13:03:14.151485 13180 consensus_queue.cc:237] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.152575 12870 raft_consensus.cc:606] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Received request to transfer leadership to TS e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:14.165185 12794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8"
dest_uuid: "2351aea55ff64112af613300ddc24b72"
mode: GRACEFUL
new_leader_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:52504
I20260709 13:03:14.166519 12794 raft_consensus.cc:606] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Received request to transfer leadership to TS e44283118803451fa17ec5f8f8f9833e
I20260709 13:03:14.163437 12695 catalog_manager.cc:5697] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 2 to 3, leader changed from 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194) to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.173451   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:14.173456 12867 raft_consensus.cc:2468] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 3.
I20260709 13:03:14.174357   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:14.189919 12691 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc: soft_deleted_table [id=0de37808533d4c00b355b89cd02dea70] alter complete (version 1)
I20260709 13:03:14.206830 13197 raft_consensus.cc:993] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: : Instructing follower e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.207450 13197 raft_consensus.cc:1081] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Signalling peer e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.211661 12942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b4038ed899742c6b84a759162730f97"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:59326
I20260709 13:03:14.212339 12942 raft_consensus.cc:493] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.212762 12942 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.219801 12942 raft_consensus.cc:515] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.222024 12942 leader_election.cc:290] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 3 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:14.223129 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:14.223326 12867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b4038ed899742c6b84a759162730f97" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:14.223860 12796 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.224123 12867 raft_consensus.cc:3055] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:14.224570 12867 raft_consensus.cc:740] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cd0edf173e64b11b1d7052cfb92c26e, State: Running, Role: LEADER
I20260709 13:03:14.225622 12867 consensus_queue.cc:260] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.227170 12867 raft_consensus.cc:3060] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.230219 12796 raft_consensus.cc:2468] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 3.
I20260709 13:03:14.233115 12911 leader_election.cc:304] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2351aea55ff64112af613300ddc24b72, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:14.234078 13180 raft_consensus.cc:2804] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:14.234609 13180 raft_consensus.cc:697] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 3 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:14.235834 13180 consensus_queue.cc:237] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.239269 12867 raft_consensus.cc:2468] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 3.
I20260709 13:03:14.252671 12695 catalog_manager.cc:5697] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 2 to 3, leader changed from 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194) to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.331748 13207 raft_consensus.cc:993] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: : Instructing follower e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.332515 13196 raft_consensus.cc:1081] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Signalling peer e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.334466 12942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:59340
I20260709 13:03:14.335050 12942 raft_consensus.cc:493] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.335403 12942 raft_consensus.cc:3060] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.343326 12942 raft_consensus.cc:515] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.346061 12942 leader_election.cc:290] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 2 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:14.346942 12867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:14.347085 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b87b8b2fb544fb8d8d15f4db763bb8" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:14.347782 12867 raft_consensus.cc:3060] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.347891 12796 raft_consensus.cc:3055] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:14.348398 12796 raft_consensus.cc:740] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:14.349385 12796 consensus_queue.cc:260] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.350803 12796 raft_consensus.cc:3060] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.356933 12867 raft_consensus.cc:2468] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 2.
I20260709 13:03:14.358227 12796 raft_consensus.cc:2468] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 2.
I20260709 13:03:14.358697 12909 leader_election.cc:304] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:14.360695 13166 raft_consensus.cc:2804] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:14.361356 13166 raft_consensus.cc:697] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 2 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:14.362313 13166 consensus_queue.cc:237] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.377722 12695 catalog_manager.cc:5697] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 1 to 2, leader changed from 2351aea55ff64112af613300ddc24b72 (127.0.107.193) to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.468217 13207 raft_consensus.cc:993] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: : Instructing follower e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.469133 13196 raft_consensus.cc:1081] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Signalling peer e44283118803451fa17ec5f8f8f9833e to start an election
I20260709 13:03:14.471191 12942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33"
dest_uuid: "e44283118803451fa17ec5f8f8f9833e"
 from {username='slave'} at 127.0.0.1:59340
I20260709 13:03:14.471886 12942 raft_consensus.cc:493] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.472285 12942 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.480051 12942 raft_consensus.cc:515] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.482275 12942 leader_election.cc:290] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 3 election: Requested vote from peers 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575), 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387)
I20260709 13:03:14.483471 12796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2351aea55ff64112af613300ddc24b72"
I20260709 13:03:14.483934 12867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea540bd71f614b1e80cbd8fce45e6b33" candidate_uuid: "e44283118803451fa17ec5f8f8f9833e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2cd0edf173e64b11b1d7052cfb92c26e"
I20260709 13:03:14.484423 12796 raft_consensus.cc:3055] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:14.484630 12867 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.484839 12796 raft_consensus.cc:740] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2351aea55ff64112af613300ddc24b72, State: Running, Role: LEADER
I20260709 13:03:14.485811 12796 consensus_queue.cc:260] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.487241 12796 raft_consensus.cc:3060] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.494033 12867 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 3.
I20260709 13:03:14.495822 12796 raft_consensus.cc:2468] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e44283118803451fa17ec5f8f8f9833e in term 3.
I20260709 13:03:14.495750 12909 leader_election.cc:304] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd0edf173e64b11b1d7052cfb92c26e, e44283118803451fa17ec5f8f8f9833e; no voters: 
I20260709 13:03:14.496888 13166 raft_consensus.cc:2804] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:14.497452 13166 raft_consensus.cc:697] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 3 LEADER]: Becoming Leader. State: Replica: e44283118803451fa17ec5f8f8f9833e, State: Running, Role: LEADER
I20260709 13:03:14.498404 13166 consensus_queue.cc:237] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } }
I20260709 13:03:14.506489 12695 catalog_manager.cc:5697] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e reported cstate change: term changed from 2 to 3, leader changed from 2351aea55ff64112af613300ddc24b72 (127.0.107.193) to e44283118803451fa17ec5f8f8f9833e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e44283118803451fa17ec5f8f8f9833e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e44283118803451fa17ec5f8f8f9833e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.546674 12796 raft_consensus.cc:1275] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:14.548342 13166 consensus_queue.cc:1048] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:14.565434 12870 raft_consensus.cc:1275] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:14.568491 13166 consensus_queue.cc:1048] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:14.623243 12796 raft_consensus.cc:1275] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.624794 13166 consensus_queue.cc:1048] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:14.636149 12870 raft_consensus.cc:1275] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.639391 13245 consensus_queue.cc:1048] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:14.744478 12796 raft_consensus.cc:1275] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.746049 13245 consensus_queue.cc:1048] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:14.756593 12870 raft_consensus.cc:1275] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.758697 13180 consensus_queue.cc:1048] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:14.932126 12870 raft_consensus.cc:1275] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:14.933806 13180 consensus_queue.cc:1048] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd0edf173e64b11b1d7052cfb92c26e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:14.943145 12796 raft_consensus.cc:1275] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Refusing update from remote peer e44283118803451fa17ec5f8f8f9833e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:14.945051 13166 consensus_queue.cc:1048] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351aea55ff64112af613300ddc24b72" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:15.255800   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:03:15.265244   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:03:15.266002   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:15.272866   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:03:15.273527   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:16.318346   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:16.363212 12837 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:03:16.366199   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.367823   431 tablet_replica.cc:333] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.369452   431 raft_consensus.cc:2243] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:16.369536 12837 consensus_peers.cc:597] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.370549   431 raft_consensus.cc:2272] T da4f578d99f34879be9384284ab094b6 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.374094   431 tablet_replica.cc:333] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.375222   431 raft_consensus.cc:2243] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.376282   431 raft_consensus.cc:2272] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.381105   431 tablet_replica.cc:333] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.382062   431 raft_consensus.cc:2243] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.382969   431 raft_consensus.cc:2272] T ea540bd71f614b1e80cbd8fce45e6b33 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.386052   431 tablet_replica.cc:333] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.386976   431 raft_consensus.cc:2243] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.387684   431 raft_consensus.cc:2272] T c5889444bd9d4bcb82db775ecc6ab27e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.390875   431 tablet_replica.cc:333] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.391934   431 raft_consensus.cc:2243] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.393131   431 raft_consensus.cc:2272] T 5792ca081545497eb026a3a6b5c3b368 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.396333   431 tablet_replica.cc:333] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.397091   431 raft_consensus.cc:2243] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.397738   431 raft_consensus.cc:2272] T c0375afe1e274958a80c20aa1ccae6a3 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.401288   431 tablet_replica.cc:333] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.402100   431 raft_consensus.cc:2243] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.402895   431 raft_consensus.cc:2272] T a649ce0342884eb18d8d791efb0ca69e P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.407301   431 tablet_replica.cc:333] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.408341   431 raft_consensus.cc:2243] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:16.408370 12837 consensus_peers.cc:597] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.409411   431 raft_consensus.cc:2272] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.409436 12837 consensus_peers.cc:597] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.413604   431 tablet_replica.cc:333] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.414438   431 raft_consensus.cc:2243] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.415616   431 raft_consensus.cc:2272] T f52f0bab80f34446a0a595a5de529d8e P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.418817   431 tablet_replica.cc:333] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.419920   431 raft_consensus.cc:2243] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.421506   431 raft_consensus.cc:2272] T a24148309cba4558af0f1597863fb199 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.425115   431 tablet_replica.cc:333] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.425963   431 raft_consensus.cc:2243] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.426826   431 raft_consensus.cc:2272] T 2f7103651dbc4a7ead5a87b392b08624 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.430512   431 tablet_replica.cc:333] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.431279   431 raft_consensus.cc:2243] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.432076   431 raft_consensus.cc:2272] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.434973   431 tablet_replica.cc:333] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.435766   431 raft_consensus.cc:2243] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.436952   431 raft_consensus.cc:2272] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.440196   431 tablet_replica.cc:333] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.440860   431 raft_consensus.cc:2243] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.442063   431 raft_consensus.cc:2272] T f02e718f6a8d42acb44697e5b9423354 P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.445168   431 tablet_replica.cc:333] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.445896   431 raft_consensus.cc:2243] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.446625   431 raft_consensus.cc:2272] T ea33500c4b624ccd974ecb31098630d1 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.449549   431 tablet_replica.cc:333] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.450229   431 raft_consensus.cc:2243] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.451321   431 raft_consensus.cc:2272] T 2bef478f39154cc4bdaebe662881299d P 2351aea55ff64112af613300ddc24b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.454295   431 tablet_replica.cc:333] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.455004   431 raft_consensus.cc:2243] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.455744   431 raft_consensus.cc:2272] T 0b4038ed899742c6b84a759162730f97 P 2351aea55ff64112af613300ddc24b72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.458478   431 tablet_replica.cc:333] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72: stopping tablet replica
I20260709 13:03:16.459111   431 raft_consensus.cc:2243] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.459843   431 raft_consensus.cc:2272] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2351aea55ff64112af613300ddc24b72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.500015 12911 connection.cc:573] client connection to 127.0.107.193:34575 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:03:16.507784 12911 consensus_peers.cc:597] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:16.508719 12837 consensus_peers.cc:597] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.517843   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:16.542747 12911 consensus_peers.cc:597] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.585632   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:16.619112 12909 consensus_peers.cc:597] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e -> Peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Couldn't send request to peer 2cd0edf173e64b11b1d7052cfb92c26e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.633232   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.634477   431 tablet_replica.cc:333] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.635625   431 raft_consensus.cc:2243] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.636600   431 raft_consensus.cc:2272] T ea540bd71f614b1e80cbd8fce45e6b33 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.639482   431 tablet_replica.cc:333] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.640579   431 raft_consensus.cc:2243] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.641901   431 raft_consensus.cc:2272] T da4f578d99f34879be9384284ab094b6 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.645900   431 tablet_replica.cc:333] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
W20260709 13:03:16.646260 12911 consensus_peers.cc:597] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.647226   431 raft_consensus.cc:2243] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.648056   431 raft_consensus.cc:2272] T 5413bd57ec994a8aa817cdeaeca0e8fa P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.651679 12911 consensus_peers.cc:597] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.651780   431 tablet_replica.cc:333] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.652637   431 raft_consensus.cc:2243] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.653353   431 raft_consensus.cc:2272] T 5792ca081545497eb026a3a6b5c3b368 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.656514   431 tablet_replica.cc:333] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.657298   431 raft_consensus.cc:2243] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.658458   431 raft_consensus.cc:2272] T c0375afe1e274958a80c20aa1ccae6a3 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.661311   431 tablet_replica.cc:333] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.662091   431 raft_consensus.cc:2243] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.663306   431 raft_consensus.cc:2272] T a649ce0342884eb18d8d791efb0ca69e P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.666208   431 tablet_replica.cc:333] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.666955   431 raft_consensus.cc:2243] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.667603   431 raft_consensus.cc:2272] T c5889444bd9d4bcb82db775ecc6ab27e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.670446   431 tablet_replica.cc:333] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.671232   431 raft_consensus.cc:2243] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.672433   431 raft_consensus.cc:2272] T 3a5ae7723e5a4d43bfda643d431c1d11 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.675495   431 tablet_replica.cc:333] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.676322   431 raft_consensus.cc:2243] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.677080   431 raft_consensus.cc:2272] T f52f0bab80f34446a0a595a5de529d8e P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.680058   431 tablet_replica.cc:333] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.680796   431 raft_consensus.cc:2243] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.681510   431 raft_consensus.cc:2272] T a24148309cba4558af0f1597863fb199 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.684383   431 tablet_replica.cc:333] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.685087   431 raft_consensus.cc:2243] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.686190   431 raft_consensus.cc:2272] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.689195   431 tablet_replica.cc:333] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.690049   431 raft_consensus.cc:2243] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.690747   431 raft_consensus.cc:2272] T 2f7103651dbc4a7ead5a87b392b08624 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.694392   431 tablet_replica.cc:333] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.695194   431 raft_consensus.cc:2243] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:16.696020 12911 consensus_peers.cc:597] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.696056   431 raft_consensus.cc:2272] T d26d214caf1b47e5a5c94aeb7bc80b97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.699669   431 tablet_replica.cc:333] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.700490   431 raft_consensus.cc:2243] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.701184   431 raft_consensus.cc:2272] T f02e718f6a8d42acb44697e5b9423354 P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.704250   431 tablet_replica.cc:333] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.704974   431 raft_consensus.cc:2243] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.705621   431 raft_consensus.cc:2272] T 19b87b8b2fb544fb8d8d15f4db763bb8 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.709012   431 tablet_replica.cc:333] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.709794   431 raft_consensus.cc:2243] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.710439   431 raft_consensus.cc:2272] T 0b4038ed899742c6b84a759162730f97 P 2cd0edf173e64b11b1d7052cfb92c26e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.713615   431 tablet_replica.cc:333] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.714260   431 raft_consensus.cc:2243] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.715389   431 raft_consensus.cc:2272] T ea33500c4b624ccd974ecb31098630d1 P 2cd0edf173e64b11b1d7052cfb92c26e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.718129   431 tablet_replica.cc:333] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e: stopping tablet replica
I20260709 13:03:16.718734   431 raft_consensus.cc:2243] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.719287   431 raft_consensus.cc:2272] T 2bef478f39154cc4bdaebe662881299d P 2cd0edf173e64b11b1d7052cfb92c26e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.733958 12911 consensus_peers.cc:597] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e -> Peer 2351aea55ff64112af613300ddc24b72 (127.0.107.193:34575): Couldn't send request to peer 2351aea55ff64112af613300ddc24b72. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:16.752560 12909 connection.cc:573] client connection to 127.0.107.194:45387 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:03:16.757445 12909 consensus_peers.cc:597] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e -> Peer 2cd0edf173e64b11b1d7052cfb92c26e (127.0.107.194:45387): Couldn't send request to peer 2cd0edf173e64b11b1d7052cfb92c26e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.772645   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:16.822363   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:16.859934   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.860880   431 tablet_replica.cc:333] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.861845   431 raft_consensus.cc:2243] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.862767   431 raft_consensus.cc:2272] T da4f578d99f34879be9384284ab094b6 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.865906   431 tablet_replica.cc:333] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.866767   431 raft_consensus.cc:2243] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.867993   431 raft_consensus.cc:2272] T 5413bd57ec994a8aa817cdeaeca0e8fa P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.870621   431 tablet_replica.cc:333] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.871337   431 raft_consensus.cc:2243] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.872414   431 raft_consensus.cc:2272] T ea540bd71f614b1e80cbd8fce45e6b33 P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.875092   431 tablet_replica.cc:333] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.875834   431 raft_consensus.cc:2243] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.876878   431 raft_consensus.cc:2272] T c5889444bd9d4bcb82db775ecc6ab27e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.879472   431 tablet_replica.cc:333] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.880189   431 raft_consensus.cc:2243] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.880861   431 raft_consensus.cc:2272] T 5792ca081545497eb026a3a6b5c3b368 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.883411   431 tablet_replica.cc:333] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.884104   431 raft_consensus.cc:2243] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.884693   431 raft_consensus.cc:2272] T a649ce0342884eb18d8d791efb0ca69e P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.887391   431 tablet_replica.cc:333] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.888121   431 raft_consensus.cc:2243] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.888687   431 raft_consensus.cc:2272] T c0375afe1e274958a80c20aa1ccae6a3 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.891237   431 tablet_replica.cc:333] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.891942   431 raft_consensus.cc:2243] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.892958   431 raft_consensus.cc:2272] T 19b87b8b2fb544fb8d8d15f4db763bb8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.895753   431 tablet_replica.cc:333] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.896440   431 raft_consensus.cc:2243] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.897042   431 raft_consensus.cc:2272] T f52f0bab80f34446a0a595a5de529d8e P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.899694   431 tablet_replica.cc:333] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.900487   431 raft_consensus.cc:2243] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.901342   431 raft_consensus.cc:2272] T 3a5ae7723e5a4d43bfda643d431c1d11 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.904138   431 tablet_replica.cc:333] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.904834   431 raft_consensus.cc:2243] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.905463   431 raft_consensus.cc:2272] T ea33500c4b624ccd974ecb31098630d1 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.908260   431 tablet_replica.cc:333] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.909173   431 raft_consensus.cc:2243] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.909960   431 raft_consensus.cc:2272] T 2bef478f39154cc4bdaebe662881299d P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.912807   431 tablet_replica.cc:333] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.913528   431 raft_consensus.cc:2243] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.914615   431 raft_consensus.cc:2272] T 0b4038ed899742c6b84a759162730f97 P e44283118803451fa17ec5f8f8f9833e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.917265   431 tablet_replica.cc:333] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.918036   431 raft_consensus.cc:2243] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.918685   431 raft_consensus.cc:2272] T a24148309cba4558af0f1597863fb199 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.921885   431 tablet_replica.cc:333] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.922610   431 raft_consensus.cc:2243] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.923166   431 raft_consensus.cc:2272] T f02e718f6a8d42acb44697e5b9423354 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.926147   431 tablet_replica.cc:333] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.926815   431 raft_consensus.cc:2243] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.927452   431 raft_consensus.cc:2272] T 7e1547f9a6bb4b0eabbcaf3ef5abd0b8 P e44283118803451fa17ec5f8f8f9833e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.929977   431 tablet_replica.cc:333] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.930576   431 raft_consensus.cc:2243] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.931733   431 raft_consensus.cc:2272] T 2f7103651dbc4a7ead5a87b392b08624 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.934494   431 tablet_replica.cc:333] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e: stopping tablet replica
I20260709 13:03:16.935117   431 raft_consensus.cc:2243] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.935770   431 raft_consensus.cc:2272] T d26d214caf1b47e5a5c94aeb7bc80b97 P e44283118803451fa17ec5f8f8f9833e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.982993   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:17.031530   431 master.cc:562] Master@127.0.107.254:45215 shutting down...
I20260709 13:03:17.059756   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.060539   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.060943   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P ea7410d87332475883a454ac887487fc: stopping tablet replica
I20260709 13:03:17.084913   431 master.cc:584] Master@127.0.107.254:45215 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13585 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:03:17.154132   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43809
I20260709 13:03:17.155472   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.162945 13270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.162950 13269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.164747 13272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.166750   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.168076   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.168304   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.168505   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197168486 us; error 0 us; skew 500 ppm
I20260709 13:03:17.169149   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.172583   431 webserver.cc:533] Webserver started at http://127.0.107.254:44055/ using document root <none> and password file <none>
I20260709 13:03:17.173252   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.173676   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.174114   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.175949   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/master-0-root/instance:
uuid: "74c7db2702fd43fbbd5722a8dd20bb85"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.182446   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:17.187428 13277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.188813   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:17.189240   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/master-0-root
uuid: "74c7db2702fd43fbbd5722a8dd20bb85"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.189627   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.218750   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.220500   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.274689   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43809
I20260709 13:03:17.274883 13328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43809 every 8 connection(s)
I20260709 13:03:17.279670 13329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.296133 13329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85: Bootstrap starting.
I20260709 13:03:17.304149 13329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.310356 13329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85: No bootstrap required, opened a new log
I20260709 13:03:17.313553 13329 raft_consensus.cc:359] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" member_type: VOTER }
I20260709 13:03:17.314154 13329 raft_consensus.cc:385] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.314405 13329 raft_consensus.cc:740] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74c7db2702fd43fbbd5722a8dd20bb85, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.315035 13329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" member_type: VOTER }
I20260709 13:03:17.315723 13329 raft_consensus.cc:399] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:17.316030 13329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:17.316515 13329 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.323294 13329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" member_type: VOTER }
I20260709 13:03:17.324128 13329 leader_election.cc:304] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74c7db2702fd43fbbd5722a8dd20bb85; no voters: 
I20260709 13:03:17.325613 13329 leader_election.cc:290] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:17.326231 13332 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.328142 13332 raft_consensus.cc:697] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 1 LEADER]: Becoming Leader. State: Replica: 74c7db2702fd43fbbd5722a8dd20bb85, State: Running, Role: LEADER
I20260709 13:03:17.329092 13332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" member_type: VOTER }
I20260709 13:03:17.329705 13329 sys_catalog.cc:565] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:17.334797 13334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74c7db2702fd43fbbd5722a8dd20bb85. Latest consensus state: current_term: 1 leader_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" member_type: VOTER } }
I20260709 13:03:17.336485 13333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74c7db2702fd43fbbd5722a8dd20bb85" member_type: VOTER } }
I20260709 13:03:17.336666 13334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:17.337337 13333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:17.340294 13341 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:17.348312 13341 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:17.349668   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:17.361053 13341 catalog_manager.cc:1383] Generated new cluster ID: add1f0e179324aa99bf59930cbb7c138
I20260709 13:03:17.361455 13341 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:17.394081 13341 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:17.395769 13341 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:17.410624 13341 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85: Generated new TSK 0
I20260709 13:03:17.411475 13341 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:17.419445   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.427747 13350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.429319 13351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.431418 13353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.432526   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.433746   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.434031   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.434173   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197434159 us; error 0 us; skew 500 ppm
I20260709 13:03:17.434764   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.438114   431 webserver.cc:533] Webserver started at http://127.0.107.193:37151/ using document root <none> and password file <none>
I20260709 13:03:17.438781   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.438979   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.439229   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.441001   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-0-root/instance:
uuid: "bbe172d6760941f5ac8af718cdca09eb"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.447412   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:17.452242 13358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.453333   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:17.453742   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-0-root
uuid: "bbe172d6760941f5ac8af718cdca09eb"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.454101   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.466774   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.468724   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.471091   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:17.474385   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:17.474691   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.474989   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:17.475208   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.530556   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41035
I20260709 13:03:17.530663 13420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41035 every 8 connection(s)
I20260709 13:03:17.537119   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.546026 13425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.547271 13426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.552876 13428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.553589 13421 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43809
I20260709 13:03:17.553644   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.554221 13421 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:17.555151   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:17.555222 13421 heartbeater.cc:507] Master 127.0.107.254:43809 requested a full tablet report, sending...
W20260709 13:03:17.555526   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.555892   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197555865 us; error 0 us; skew 500 ppm
I20260709 13:03:17.556834   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.558686 13294 ts_manager.cc:194] Registered new tserver with Master: bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035)
I20260709 13:03:17.560168   431 webserver.cc:533] Webserver started at http://127.0.107.194:36173/ using document root <none> and password file <none>
I20260709 13:03:17.560878   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.561128   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.561445   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.561627 13294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39782
I20260709 13:03:17.563143   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-1-root/instance:
uuid: "666c0dbd00a542d1970b42ceb7ad00af"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.569350   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:03:17.574164 13433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.575320   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:17.575821   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-1-root
uuid: "666c0dbd00a542d1970b42ceb7ad00af"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.576160   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.592054   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.593591   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.596006   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:17.598963   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:17.599258   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.599646   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:17.599871   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.656675   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43897
I20260709 13:03:17.656752 13495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43897 every 8 connection(s)
I20260709 13:03:17.663285   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.673769 13500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.674427 13499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.678085 13496 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43809
I20260709 13:03:17.678839 13496 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:17.678934 13502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.679821   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.680115 13496 heartbeater.cc:507] Master 127.0.107.254:43809 requested a full tablet report, sending...
I20260709 13:03:17.681120   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.681589   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.681864   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197681839 us; error 0 us; skew 500 ppm
I20260709 13:03:17.682722   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.682996 13294 ts_manager.cc:194] Registered new tserver with Master: 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:17.685211 13294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39794
I20260709 13:03:17.686395   431 webserver.cc:533] Webserver started at http://127.0.107.195:36279/ using document root <none> and password file <none>
I20260709 13:03:17.687266   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.687605   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.687983   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.689453   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-2-root/instance:
uuid: "050f1d3908394d78b57dc938b15660dc"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.695066   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:03:17.699258 13507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.700322   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:17.700652   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-2-root
uuid: "050f1d3908394d78b57dc938b15660dc"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-fc6v"
I20260709 13:03:17.700932   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski4hGJM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601818739156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.711311   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.712934   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.714627   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:17.717325   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:17.717573   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.717921   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:17.718094   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.768908   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44887
I20260709 13:03:17.769034 13569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44887 every 8 connection(s)
I20260709 13:03:17.786098 13570 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43809
I20260709 13:03:17.786595 13570 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:17.787573 13570 heartbeater.cc:507] Master 127.0.107.254:43809 requested a full tablet report, sending...
I20260709 13:03:17.790469 13294 ts_manager.cc:194] Registered new tserver with Master: 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:17.790781   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018501969s
I20260709 13:03:17.792582 13294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39810
I20260709 13:03:17.824807 13294 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39818:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:17.829941 13294 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:17.929171 13461 tablet_service.cc:1511] Processing CreateTablet for tablet bee39914a2b84f1691c12b49ff960d18 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:17.930022 13459 tablet_service.cc:1511] Processing CreateTablet for tablet 41a6bb5296244006b5aadf39cdf64432 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:17.931079 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee39914a2b84f1691c12b49ff960d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.931854 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a6bb5296244006b5aadf39cdf64432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.932567 13458 tablet_service.cc:1511] Processing CreateTablet for tablet 9b91824d3058435d968ef4c7ec305cc7 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:17.934152 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b91824d3058435d968ef4c7ec305cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.934808 13535 tablet_service.cc:1511] Processing CreateTablet for tablet bee39914a2b84f1691c12b49ff960d18 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:17.936360 13535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee39914a2b84f1691c12b49ff960d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.936537 13534 tablet_service.cc:1511] Processing CreateTablet for tablet 78872057c908442bab71c00bd7d8c4f4 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:17.936937 13460 tablet_service.cc:1511] Processing CreateTablet for tablet 78872057c908442bab71c00bd7d8c4f4 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:17.938028 13534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78872057c908442bab71c00bd7d8c4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.938581 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78872057c908442bab71c00bd7d8c4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.940989 13533 tablet_service.cc:1511] Processing CreateTablet for tablet 41a6bb5296244006b5aadf39cdf64432 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:17.942713 13533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a6bb5296244006b5aadf39cdf64432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.944823 13532 tablet_service.cc:1511] Processing CreateTablet for tablet 9b91824d3058435d968ef4c7ec305cc7 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:17.946619 13532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b91824d3058435d968ef4c7ec305cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.949904 13384 tablet_service.cc:1511] Processing CreateTablet for tablet 41a6bb5296244006b5aadf39cdf64432 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:17.951692 13383 tablet_service.cc:1511] Processing CreateTablet for tablet 9b91824d3058435d968ef4c7ec305cc7 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:17.952826 13457 tablet_service.cc:1511] Processing CreateTablet for tablet 7d919109a8d94113a752f51dc928a12f (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:17.954449 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d919109a8d94113a752f51dc928a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.955120 13386 tablet_service.cc:1511] Processing CreateTablet for tablet bee39914a2b84f1691c12b49ff960d18 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:17.951794 13384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a6bb5296244006b5aadf39cdf64432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.959246 13382 tablet_service.cc:1511] Processing CreateTablet for tablet 7d919109a8d94113a752f51dc928a12f (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:17.960875 13383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b91824d3058435d968ef4c7ec305cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.961771 13382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d919109a8d94113a752f51dc928a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.950111 13385 tablet_service.cc:1511] Processing CreateTablet for tablet 78872057c908442bab71c00bd7d8c4f4 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:17.963783 13385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78872057c908442bab71c00bd7d8c4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.971608 13386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee39914a2b84f1691c12b49ff960d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.975957 13531 tablet_service.cc:1511] Processing CreateTablet for tablet 7d919109a8d94113a752f51dc928a12f (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:17.977854 13531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d919109a8d94113a752f51dc928a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.992154 13381 tablet_service.cc:1511] Processing CreateTablet for tablet a44cbdb9bd824e41972b85467bd01298 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:17.993950 13381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a44cbdb9bd824e41972b85467bd01298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.998822 13456 tablet_service.cc:1511] Processing CreateTablet for tablet a44cbdb9bd824e41972b85467bd01298 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:18.000689 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a44cbdb9bd824e41972b85467bd01298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.021348 13530 tablet_service.cc:1511] Processing CreateTablet for tablet a44cbdb9bd824e41972b85467bd01298 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:18.023263 13530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a44cbdb9bd824e41972b85467bd01298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.050758 13380 tablet_service.cc:1511] Processing CreateTablet for tablet a7c2a78fdf824431a10b0303a05f389c (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:18.058543 13380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c2a78fdf824431a10b0303a05f389c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.065564 13455 tablet_service.cc:1511] Processing CreateTablet for tablet a7c2a78fdf824431a10b0303a05f389c (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:18.067970 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c2a78fdf824431a10b0303a05f389c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.080801 13535 tablet_service.cc:1511] Processing CreateTablet for tablet a7c2a78fdf824431a10b0303a05f389c (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:18.083370 13535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c2a78fdf824431a10b0303a05f389c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.084786 13585 tablet_bootstrap.cc:492] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.098376 13587 tablet_bootstrap.cc:492] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.098387 13586 tablet_bootstrap.cc:492] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.112246 13587 tablet_bootstrap.cc:654] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.113281 13586 tablet_bootstrap.cc:654] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.122812 13380 tablet_service.cc:1511] Processing CreateTablet for tablet d349b6ea90a34ab69ce72747888c75f5 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:18.124605 13380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d349b6ea90a34ab69ce72747888c75f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.136273 13456 tablet_service.cc:1511] Processing CreateTablet for tablet d349b6ea90a34ab69ce72747888c75f5 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:18.138993 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d349b6ea90a34ab69ce72747888c75f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.149478 13587 tablet_bootstrap.cc:492] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.150592 13587 ts_tablet_manager.cc:1403] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.005s
I20260709 13:03:18.152540 13381 tablet_service.cc:1511] Processing CreateTablet for tablet a742058fef84469eba3f2e8095afcbe9 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:18.154376 13381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a742058fef84469eba3f2e8095afcbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.153993 13535 tablet_service.cc:1511] Processing CreateTablet for tablet d349b6ea90a34ab69ce72747888c75f5 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:18.156189 13535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d349b6ea90a34ab69ce72747888c75f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.161597 13587 raft_consensus.cc:359] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.163210 13587 raft_consensus.cc:385] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.164151 13587 raft_consensus.cc:740] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.158684 13585 tablet_bootstrap.cc:654] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.172123 13587 consensus_queue.cc:260] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.174356 13455 tablet_service.cc:1511] Processing CreateTablet for tablet a742058fef84469eba3f2e8095afcbe9 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:18.177080 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a742058fef84469eba3f2e8095afcbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.184021 13587 ts_tablet_manager.cc:1434] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.014s
I20260709 13:03:18.183530 13530 tablet_service.cc:1511] Processing CreateTablet for tablet a742058fef84469eba3f2e8095afcbe9 (DEFAULT_TABLE table=test-workload [id=161bc3dbc1884e1d979956d21f85b1c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:18.184705 13570 heartbeater.cc:499] Master 127.0.107.254:43809 was elected leader, sending a full tablet report...
I20260709 13:03:18.185339 13530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a742058fef84469eba3f2e8095afcbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:18.186159 13585 tablet_bootstrap.cc:492] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.186760 13585 ts_tablet_manager.cc:1403] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.005s
I20260709 13:03:18.190114 13586 tablet_bootstrap.cc:492] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.190950 13586 ts_tablet_manager.cc:1403] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.035s
I20260709 13:03:18.196687 13587 tablet_bootstrap.cc:492] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.194655 13586 raft_consensus.cc:359] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.197395 13585 raft_consensus.cc:359] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.199116 13585 raft_consensus.cc:385] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.199491 13585 raft_consensus.cc:740] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.200379 13585 consensus_queue.cc:260] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.202083 13586 raft_consensus.cc:385] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.202494 13586 raft_consensus.cc:740] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.203497 13586 consensus_queue.cc:260] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.213275 13586 ts_tablet_manager.cc:1434] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.011s
I20260709 13:03:18.214190 13496 heartbeater.cc:499] Master 127.0.107.254:43809 was elected leader, sending a full tablet report...
I20260709 13:03:18.221796 13585 ts_tablet_manager.cc:1434] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.011s
I20260709 13:03:18.222205 13587 tablet_bootstrap.cc:654] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.223098 13585 tablet_bootstrap.cc:492] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.218712 13586 tablet_bootstrap.cc:492] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.221339 13421 heartbeater.cc:499] Master 127.0.107.254:43809 was elected leader, sending a full tablet report...
I20260709 13:03:18.233191 13585 tablet_bootstrap.cc:654] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.240226 13586 tablet_bootstrap.cc:654] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:18.273955 13571 tablet.cc:2406] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:18.277144 13586 tablet_bootstrap.cc:492] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.277959 13586 ts_tablet_manager.cc:1403] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.016s
I20260709 13:03:18.282955 13586 raft_consensus.cc:359] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.283989 13586 raft_consensus.cc:385] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.284379 13585 tablet_bootstrap.cc:492] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.284373 13586 raft_consensus.cc:740] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.285164 13585 ts_tablet_manager.cc:1403] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.037s
I20260709 13:03:18.285461 13587 tablet_bootstrap.cc:492] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.286083 13587 ts_tablet_manager.cc:1403] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.090s	user 0.034s	sys 0.020s
I20260709 13:03:18.285948 13586 consensus_queue.cc:260] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.288674 13586 ts_tablet_manager.cc:1434] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 13:03:18.289937 13586 tablet_bootstrap.cc:492] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.289747 13587 raft_consensus.cc:359] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.290047 13585 raft_consensus.cc:359] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.290719 13587 raft_consensus.cc:385] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.291005 13585 raft_consensus.cc:385] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.291469 13585 raft_consensus.cc:740] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.292513 13585 consensus_queue.cc:260] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.295182 13585 ts_tablet_manager.cc:1434] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:18.296623 13585 tablet_bootstrap.cc:492] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.299048 13586 tablet_bootstrap.cc:654] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.291139 13587 raft_consensus.cc:740] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.302562 13587 consensus_queue.cc:260] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.305225 13587 ts_tablet_manager.cc:1434] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 13:03:18.307163 13585 tablet_bootstrap.cc:654] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.308812 13587 tablet_bootstrap.cc:492] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.317775 13587 tablet_bootstrap.cc:654] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.325240 13586 tablet_bootstrap.cc:492] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.326292 13585 tablet_bootstrap.cc:492] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.326615 13586 ts_tablet_manager.cc:1403] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.011s
I20260709 13:03:18.326848 13585 ts_tablet_manager.cc:1403] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.005s
I20260709 13:03:18.330404 13586 raft_consensus.cc:359] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.330552 13585 raft_consensus.cc:359] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.331390 13585 raft_consensus.cc:385] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.331357 13586 raft_consensus.cc:385] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.332015 13585 raft_consensus.cc:740] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.332124 13586 raft_consensus.cc:740] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.333056 13585 consensus_queue.cc:260] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.333343 13586 consensus_queue.cc:260] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.335718 13585 ts_tablet_manager.cc:1434] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:03:18.335767 13586 ts_tablet_manager.cc:1434] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:03:18.337083 13585 tablet_bootstrap.cc:492] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.337087 13586 tablet_bootstrap.cc:492] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
W20260709 13:03:18.342435 13342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:18.340229 13587 tablet_bootstrap.cc:492] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.343830 13587 ts_tablet_manager.cc:1403] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:03:18.345727 13585 tablet_bootstrap.cc:654] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.345727 13586 tablet_bootstrap.cc:654] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.347642 13587 raft_consensus.cc:359] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.348658 13587 raft_consensus.cc:385] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.349105 13587 raft_consensus.cc:740] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.350283 13587 consensus_queue.cc:260] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.353708 13593 raft_consensus.cc:493] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.354410 13593 raft_consensus.cc:515] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.357664 13586 tablet_bootstrap.cc:492] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.358661 13586 ts_tablet_manager.cc:1403] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 13:03:18.362190 13593 leader_election.cc:290] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.363440 13586 raft_consensus.cc:359] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.366079 13586 raft_consensus.cc:385] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.366460 13586 raft_consensus.cc:740] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.367718 13585 tablet_bootstrap.cc:492] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.367529 13586 consensus_queue.cc:260] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.368400 13585 ts_tablet_manager.cc:1403] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.010s
I20260709 13:03:18.368892 13591 raft_consensus.cc:493] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.369658 13591 raft_consensus.cc:515] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.371471 13587 ts_tablet_manager.cc:1434] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:03:18.372260 13585 raft_consensus.cc:359] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.372964 13586 ts_tablet_manager.cc:1434] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 13:03:18.373235 13585 raft_consensus.cc:385] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.374511 13586 tablet_bootstrap.cc:492] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.373581 13585 raft_consensus.cc:740] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.376426 13587 tablet_bootstrap.cc:492] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.376150 13585 consensus_queue.cc:260] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.380821 13585 ts_tablet_manager.cc:1434] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:03:18.382229 13585 tablet_bootstrap.cc:492] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.383139 13586 tablet_bootstrap.cc:654] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.387940 13591 leader_election.cc:290] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.392052 13585 tablet_bootstrap.cc:654] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.405498 13587 tablet_bootstrap.cc:654] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.410029 13592 raft_consensus.cc:493] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.415225 13592 raft_consensus.cc:515] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.409626 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.420506 13592 leader_election.cc:290] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
W20260709 13:03:18.423465 13435 leader_election.cc:343] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.446038 13593 raft_consensus.cc:493] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.446972 13593 raft_consensus.cc:515] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.450265 13593 leader_election.cc:290] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.451737 13591 raft_consensus.cc:493] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.452421 13591 raft_consensus.cc:515] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.454981 13591 leader_election.cc:290] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.462821 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.463798 13396 raft_consensus.cc:2468] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:18.466048 13435 leader_election.cc:304] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.467110 13593 raft_consensus.cc:2804] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.467744 13593 raft_consensus.cc:493] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.468230 13593 raft_consensus.cc:3060] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.475680 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.476581 13396 raft_consensus.cc:2468] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.477363 13587 tablet_bootstrap.cc:492] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.478132 13587 ts_tablet_manager.cc:1403] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.008s
I20260709 13:03:18.479363 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.480243 13396 raft_consensus.cc:2468] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.482021 13587 raft_consensus.cc:359] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.483018 13587 raft_consensus.cc:385] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.482306 13593 raft_consensus.cc:515] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.482415 13509 leader_election.cc:304] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.483500 13587 raft_consensus.cc:740] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.484701 13587 consensus_queue.cc:260] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.485754 13591 raft_consensus.cc:2804] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.485045 13509 leader_election.cc:304] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.486212 13591 raft_consensus.cc:493] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.486631 13591 raft_consensus.cc:3060] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.487334 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:18.488091 13396 raft_consensus.cc:3060] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.493115 13593 leader_election.cc:290] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.515393 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:18.516456 13545 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:18.518013 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:18.518337 13434 leader_election.cc:304] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:18.519347 13593 raft_consensus.cc:2804] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.519515 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:18.520538 13593 raft_consensus.cc:493] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.520987 13593 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.522619 13586 tablet_bootstrap.cc:492] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.523607 13586 ts_tablet_manager.cc:1403] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.149s	user 0.046s	sys 0.049s
I20260709 13:03:18.529513 13591 raft_consensus.cc:515] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.544876 13544 raft_consensus.cc:2393] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 666c0dbd00a542d1970b42ceb7ad00af in current term 1: Already voted for candidate 050f1d3908394d78b57dc938b15660dc in this term.
I20260709 13:03:18.530370 13586 raft_consensus.cc:359] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.545588 13586 raft_consensus.cc:385] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.545990 13586 raft_consensus.cc:740] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.546653 13615 raft_consensus.cc:2804] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.547410 13615 raft_consensus.cc:493] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.546969 13586 consensus_queue.cc:260] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.548019 13615 raft_consensus.cc:3060] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.555995 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
W20260709 13:03:18.559595 13359 leader_election.cc:343] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.559837 13585 tablet_bootstrap.cc:492] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.560743 13585 ts_tablet_manager.cc:1403] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.179s	user 0.043s	sys 0.070s
I20260709 13:03:18.563416 13587 ts_tablet_manager.cc:1434] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.085s	user 0.031s	sys 0.026s
I20260709 13:03:18.566318 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:18.568504 13591 leader_election.cc:290] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.525025 13396 raft_consensus.cc:2468] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:18.556603 13593 raft_consensus.cc:515] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.557292 13592 raft_consensus.cc:493] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.569979 13592 raft_consensus.cc:515] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.556113 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.574180 13471 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:18.574630 13615 raft_consensus.cc:515] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.578821 13362 leader_election.cc:304] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:18.579077 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:18.579489 13586 ts_tablet_manager.cc:1434] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.055s	user 0.017s	sys 0.028s
I20260709 13:03:18.579818 13615 leader_election.cc:290] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.580019 13544 raft_consensus.cc:2468] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:18.580452 13592 leader_election.cc:290] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.581167 13592 raft_consensus.cc:2804] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.581461 13592 raft_consensus.cc:493] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.581686 13592 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.581524 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:18.582267 13395 raft_consensus.cc:3060] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.581557 13359 leader_election.cc:304] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.584126 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.584951 13471 raft_consensus.cc:2468] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:18.585495 13593 leader_election.cc:290] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.586195 13593 raft_consensus.cc:493] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.586709 13394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:18.589306 13587 tablet_bootstrap.cc:492] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.567991 13585 raft_consensus.cc:359] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.590190 13585 raft_consensus.cc:385] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.590581 13585 raft_consensus.cc:740] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.590612 13618 raft_consensus.cc:2804] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.591586 13585 consensus_queue.cc:260] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.595021 13618 raft_consensus.cc:493] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.595782 13394 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.595618 13618 raft_consensus.cc:3060] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.594343 13395 raft_consensus.cc:2468] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:18.597398 13587 tablet_bootstrap.cc:654] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.599169 13509 leader_election.cc:304] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.595338 13435 leader_election.cc:304] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:18.601305 13586 tablet_bootstrap.cc:492] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.603572 13615 raft_consensus.cc:2804] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.604828 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:18.605674 13544 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.586730 13593 raft_consensus.cc:515] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.609083 13586 tablet_bootstrap.cc:654] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.611756 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.612111 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.602492 13617 raft_consensus.cc:2804] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.611756 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.612962 13470 raft_consensus.cc:2468] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.613209 13617 raft_consensus.cc:697] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:18.614459 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:18.614267 13617 consensus_queue.cc:237] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.616135 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:18.616940 13468 raft_consensus.cc:3060] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.617286 13593 leader_election.cc:290] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.624773 13587 tablet_bootstrap.cc:492] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.624969 13585 ts_tablet_manager.cc:1434] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.008s
I20260709 13:03:18.625559 13587 ts_tablet_manager.cc:1403] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.008s
I20260709 13:03:18.625993 13586 tablet_bootstrap.cc:492] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.626475 13585 tablet_bootstrap.cc:492] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.626673 13586 ts_tablet_manager.cc:1403] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:03:18.619130 13394 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:18.630842 13586 raft_consensus.cc:359] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.631942 13586 raft_consensus.cc:385] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.632305 13586 raft_consensus.cc:740] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.632865 13587 raft_consensus.cc:359] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.633304 13586 consensus_queue.cc:260] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.633821 13615 raft_consensus.cc:697] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:18.634894 13592 raft_consensus.cc:515] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.635107 13615 consensus_queue.cc:237] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.636068 13586 ts_tablet_manager.cc:1434] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:03:18.638563 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:18.638805 13586 tablet_bootstrap.cc:492] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.639349 13469 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.647377 13468 raft_consensus.cc:2468] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:18.652067 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:18.648481 13586 tablet_bootstrap.cc:654] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.649447 13469 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:18.653884 13435 leader_election.cc:304] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.654997 13362 leader_election.cc:304] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.649670 13511 leader_election.cc:304] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc; no voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:18.650367 13592 leader_election.cc:290] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.651724 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:18.633776 13587 raft_consensus.cc:385] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.656093 13543 raft_consensus.cc:2468] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:18.655148 13616 raft_consensus.cc:2804] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.656615 13591 raft_consensus.cc:2749] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.657305 13616 raft_consensus.cc:697] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:18.657795 13585 tablet_bootstrap.cc:654] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.658270 13619 raft_consensus.cc:2804] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.658449 13616 consensus_queue.cc:237] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.662449 13434 leader_election.cc:304] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: 
I20260709 13:03:18.656096 13587 raft_consensus.cc:740] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.675088 13587 consensus_queue.cc:260] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.677490 13545 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.665933 13544 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:18.678138 13587 ts_tablet_manager.cc:1434] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:03:18.682744 13587 tablet_bootstrap.cc:492] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.666605 13593 raft_consensus.cc:2804] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.686101 13593 raft_consensus.cc:493] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.686595 13593 raft_consensus.cc:3060] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.706324 13593 raft_consensus.cc:515] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.709000 13617 raft_consensus.cc:493] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.713900 13619 raft_consensus.cc:697] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:18.718077 13618 raft_consensus.cc:515] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.721621 13396 raft_consensus.cc:2393] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 666c0dbd00a542d1970b42ceb7ad00af in current term 1: Already voted for candidate bbe172d6760941f5ac8af718cdca09eb in this term.
I20260709 13:03:18.721237 13619 consensus_queue.cc:237] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.720713 13293 catalog_manager.cc:5697] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.723956 13294 catalog_manager.cc:5697] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 1 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.725102 13618 leader_election.cc:290] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.697116 13545 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:18.726052 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:18.733026 13586 tablet_bootstrap.cc:492] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.733274 13585 tablet_bootstrap.cc:492] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.733779 13586 ts_tablet_manager.cc:1403] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.095s	user 0.022s	sys 0.021s
I20260709 13:03:18.733960 13585 ts_tablet_manager.cc:1403] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.008s
I20260709 13:03:18.720678 13617 raft_consensus.cc:515] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.737792 13586 raft_consensus.cc:359] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.738750 13586 raft_consensus.cc:385] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.739136 13586 raft_consensus.cc:740] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.737876 13585 raft_consensus.cc:359] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.740155 13586 consensus_queue.cc:260] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.740362 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.742676 13585 raft_consensus.cc:385] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.743104 13585 raft_consensus.cc:740] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
W20260709 13:03:18.744410 13435 leader_election.cc:343] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.742056 13471 raft_consensus.cc:2393] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bbe172d6760941f5ac8af718cdca09eb in current term 1: Already voted for candidate 666c0dbd00a542d1970b42ceb7ad00af in this term.
I20260709 13:03:18.741328 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:18.745096 13586 ts_tablet_manager.cc:1434] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:03:18.745693 13545 raft_consensus.cc:3060] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.746387 13586 tablet_bootstrap.cc:492] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.744200 13585 consensus_queue.cc:260] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.750934 13585 ts_tablet_manager.cc:1434] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:18.753609 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:18.764473 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:18.769171 13593 leader_election.cc:290] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.762568 13617 leader_election.cc:290] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.751392 13587 tablet_bootstrap.cc:654] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.770515 13396 raft_consensus.cc:2393] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 666c0dbd00a542d1970b42ceb7ad00af in current term 1: Already voted for candidate bbe172d6760941f5ac8af718cdca09eb in this term.
I20260709 13:03:18.770778 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee39914a2b84f1691c12b49ff960d18" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:18.775615 13586 tablet_bootstrap.cc:654] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.778165 13585 tablet_bootstrap.cc:492] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
W20260709 13:03:18.778683 13434 leader_election.cc:343] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.783145 13434 leader_election.cc:304] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af; no voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:18.775663 13545 raft_consensus.cc:2468] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:18.782553 13292 catalog_manager.cc:5697] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.799965 13359 leader_election.cc:304] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:18.800823 13619 raft_consensus.cc:2804] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.786423 13617 raft_consensus.cc:2749] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.801366 13619 raft_consensus.cc:697] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:18.785598 13434 leader_election.cc:304] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af; no voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:18.802752 13593 raft_consensus.cc:2749] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.802552 13619 consensus_queue.cc:237] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.802790 13586 tablet_bootstrap.cc:492] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.797691 13585 tablet_bootstrap.cc:654] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.804711 13586 ts_tablet_manager.cc:1403] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.021s
I20260709 13:03:18.797735 13587 tablet_bootstrap.cc:492] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.808135 13587 ts_tablet_manager.cc:1403] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.007s
I20260709 13:03:18.810738 13586 raft_consensus.cc:359] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.811775 13586 raft_consensus.cc:385] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.812094 13586 raft_consensus.cc:740] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.813340 13586 consensus_queue.cc:260] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.815795 13587 raft_consensus.cc:359] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.816660 13586 ts_tablet_manager.cc:1434] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:03:18.819697 13587 raft_consensus.cc:385] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.820165 13587 raft_consensus.cc:740] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.820555 13586 tablet_bootstrap.cc:492] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:18.821295 13587 consensus_queue.cc:260] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.825901 13587 ts_tablet_manager.cc:1434] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:03:18.828284 13587 tablet_bootstrap.cc:492] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.828819 13586 tablet_bootstrap.cc:654] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.837859 13585 tablet_bootstrap.cc:492] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.838546 13585 ts_tablet_manager.cc:1403] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.003s
I20260709 13:03:18.839912 13587 tablet_bootstrap.cc:654] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.842335 13585 raft_consensus.cc:359] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.843328 13585 raft_consensus.cc:385] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.843910 13585 raft_consensus.cc:740] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.845199 13585 consensus_queue.cc:260] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.845840 13586 tablet_bootstrap.cc:492] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:18.846582 13586 ts_tablet_manager.cc:1403] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.005s
I20260709 13:03:18.846827 13587 tablet_bootstrap.cc:492] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.847429 13587 ts_tablet_manager.cc:1403] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.005s
I20260709 13:03:18.848467 13585 ts_tablet_manager.cc:1434] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:03:18.850041 13585 tablet_bootstrap.cc:492] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.850360 13586 raft_consensus.cc:359] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.851203 13586 raft_consensus.cc:385] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.851043 13587 raft_consensus.cc:359] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.851605 13586 raft_consensus.cc:740] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.851972 13587 raft_consensus.cc:385] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.852329 13587 raft_consensus.cc:740] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.852543 13586 consensus_queue.cc:260] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.853283 13587 consensus_queue.cc:260] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.855103 13586 ts_tablet_manager.cc:1434] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:18.856349 13587 ts_tablet_manager.cc:1434] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:03:18.857695 13587 tablet_bootstrap.cc:492] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.857757 13293 catalog_manager.cc:5697] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.860567 13585 tablet_bootstrap.cc:654] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.866029 13587 tablet_bootstrap.cc:654] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.868717 13585 tablet_bootstrap.cc:492] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.869429 13585 ts_tablet_manager.cc:1403] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:03:18.872411 13587 tablet_bootstrap.cc:492] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.873126 13587 ts_tablet_manager.cc:1403] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:03:18.872895 13585 raft_consensus.cc:359] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.873760 13585 raft_consensus.cc:385] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.874076 13585 raft_consensus.cc:740] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.875106 13585 consensus_queue.cc:260] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.876688 13587 raft_consensus.cc:359] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.877565 13587 raft_consensus.cc:385] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.877633 13585 ts_tablet_manager.cc:1434] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:18.877837 13587 raft_consensus.cc:740] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.878756 13587 consensus_queue.cc:260] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.879041 13585 tablet_bootstrap.cc:492] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:18.880908 13587 ts_tablet_manager.cc:1434] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:18.881029 13292 catalog_manager.cc:5697] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.882400 13587 tablet_bootstrap.cc:492] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:18.886904 13585 tablet_bootstrap.cc:654] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.889485 13587 tablet_bootstrap.cc:654] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.892508 13585 tablet_bootstrap.cc:492] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:18.893061 13585 ts_tablet_manager.cc:1403] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:03:18.896109 13585 raft_consensus.cc:359] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.896939 13585 raft_consensus.cc:385] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.897225 13585 raft_consensus.cc:740] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.898105 13585 consensus_queue.cc:260] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.900906 13585 ts_tablet_manager.cc:1434] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:18.901945 13619 raft_consensus.cc:493] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.902741 13619 raft_consensus.cc:515] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.904258 13615 raft_consensus.cc:493] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.905207 13587 tablet_bootstrap.cc:492] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:18.904886 13615 raft_consensus.cc:515] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.906481 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.907740 13587 ts_tablet_manager.cc:1403] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:03:18.907835 13471 raft_consensus.cc:2468] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:18.908411 13615 leader_election.cc:290] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.908741 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.909363 13619 leader_election.cc:290] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.909600 13396 raft_consensus.cc:2468] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.909500 13362 leader_election.cc:304] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.911396 13509 leader_election.cc:304] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.912660 13615 raft_consensus.cc:2804] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.912712 13587 raft_consensus.cc:359] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.913180 13615 raft_consensus.cc:493] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.913848 13587 raft_consensus.cc:385] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.913218 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.914062 13615 raft_consensus.cc:3060] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.914247 13587 raft_consensus.cc:740] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.914808 13471 raft_consensus.cc:2468] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.915439 13587 consensus_queue.cc:260] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.912794 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:18.917270 13545 raft_consensus.cc:2468] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:18.917951 13587 ts_tablet_manager.cc:1434] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:18.919701 13619 raft_consensus.cc:2804] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.920239 13619 raft_consensus.cc:493] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.920764 13619 raft_consensus.cc:3060] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.924474 13615 raft_consensus.cc:515] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.928103 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:18.928859 13396 raft_consensus.cc:3060] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.930039 13619 raft_consensus.cc:515] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.932685 13619 leader_election.cc:290] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:18.933641 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:18.934000 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:18.934144 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:18.934589 13545 raft_consensus.cc:3060] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.935048 13468 raft_consensus.cc:3060] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.934465 13471 raft_consensus.cc:3060] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.938699 13396 raft_consensus.cc:2468] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:18.940469 13509 leader_election.cc:304] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.942140 13591 raft_consensus.cc:2804] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.942727 13591 raft_consensus.cc:697] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:18.944082 13545 raft_consensus.cc:2468] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:18.944051 13591 consensus_queue.cc:237] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.944496 13468 raft_consensus.cc:2468] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:18.945851 13359 leader_election.cc:304] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.947000 13619 raft_consensus.cc:2804] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.947664 13471 raft_consensus.cc:2468] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:18.944828 13615 leader_election.cc:290] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.948575 13619 raft_consensus.cc:697] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:18.949877 13619 consensus_queue.cc:237] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.956040 13293 catalog_manager.cc:5697] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 1 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.960181 13292 catalog_manager.cc:5697] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.988221 13591 raft_consensus.cc:493] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.988952 13591 raft_consensus.cc:515] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:18.990962 13591 leader_election.cc:290] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:18.992583 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:18.992583 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:18.993544 13396 raft_consensus.cc:2468] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.993541 13471 raft_consensus.cc:2468] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:18.994854 13509 leader_election.cc:304] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:18.995747 13591 raft_consensus.cc:2804] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.996138 13591 raft_consensus.cc:493] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.996484 13591 raft_consensus.cc:3060] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.003198 13591 raft_consensus.cc:515] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.005225 13591 leader_election.cc:290] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:19.006693 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:19.007128 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.007509 13471 raft_consensus.cc:3060] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.007879 13396 raft_consensus.cc:3060] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.014549 13471 raft_consensus.cc:2468] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:19.014976 13396 raft_consensus.cc:2468] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:19.016124 13511 leader_election.cc:304] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: 
I20260709 13:03:19.017274 13591 raft_consensus.cc:2804] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.017863 13591 raft_consensus.cc:697] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:19.018553 13591 consensus_queue.cc:237] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.027498 13292 catalog_manager.cc:5697] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 1 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.072129 13591 consensus_queue.cc:1048] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.073240 13617 consensus_queue.cc:1048] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.092773 13616 consensus_queue.cc:1048] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.095091 13616 raft_consensus.cc:493] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.095878 13616 raft_consensus.cc:515] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.107146 13616 leader_election.cc:290] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.110407 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:19.111346 13396 raft_consensus.cc:2468] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:19.112681 13435 leader_election.cc:304] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.113691 13617 raft_consensus.cc:2804] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:19.114118 13617 raft_consensus.cc:493] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.114498 13617 raft_consensus.cc:3060] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.120152 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:19.121088 13545 raft_consensus.cc:2468] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:19.122076 13615 consensus_queue.cc:1048] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.124235 13616 consensus_queue.cc:1048] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.125520 13617 raft_consensus.cc:515] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.130417 13618 consensus_queue.cc:1048] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.132251 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.133028 13395 raft_consensus.cc:3060] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.141863 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.142793 13543 raft_consensus.cc:3060] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.159920 13617 leader_election.cc:290] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.165462 13395 raft_consensus.cc:2468] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:19.165951 13543 raft_consensus.cc:2468] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:19.168884 13435 leader_election.cc:304] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.169988 13617 raft_consensus.cc:2804] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.170598 13617 raft_consensus.cc:697] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.171658 13617 consensus_queue.cc:237] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.175275 13618 consensus_queue.cc:1048] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.195245 13617 consensus_queue.cc:1048] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.208817 13293 catalog_manager.cc:5697] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.229265 13619 consensus_queue.cc:1048] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.251122 13618 consensus_queue.cc:1048] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.361212 13618 consensus_queue.cc:1048] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.366995 13656 consensus_queue.cc:1048] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.382817 13618 consensus_queue.cc:1048] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.393059 13544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
mode: GRACEFUL
new_leader_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:41906
I20260709 13:03:19.394052 13544 raft_consensus.cc:606] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Received request to transfer leadership to TS bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:19.397686 13591 consensus_queue.cc:1048] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.434466 13471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
mode: GRACEFUL
new_leader_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:54698
I20260709 13:03:19.435058 13471 raft_consensus.cc:606] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Received request to transfer leadership to TS bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:19.441054 13471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
mode: GRACEFUL
new_leader_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:54698
I20260709 13:03:19.441769 13471 raft_consensus.cc:606] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Received request to transfer leadership to TS bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:19.458891 13396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
mode: GRACEFUL
new_leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:35396
I20260709 13:03:19.459805 13396 raft_consensus.cc:606] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Received request to transfer leadership to TS 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:19.467301 13396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
mode: GRACEFUL
new_leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:35396
I20260709 13:03:19.468035 13396 raft_consensus.cc:606] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Received request to transfer leadership to TS 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:19.474226 13545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
mode: GRACEFUL
new_leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:41906
I20260709 13:03:19.474960 13545 raft_consensus.cc:606] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Received request to transfer leadership to TS 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:19.478556 13656 consensus_queue.cc:1048] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.481526 13545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
mode: GRACEFUL
new_leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:41906
I20260709 13:03:19.482206 13545 raft_consensus.cc:606] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Received request to transfer leadership to TS 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:19.487393 13591 raft_consensus.cc:993] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: : Instructing follower 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.488052 13615 raft_consensus.cc:1081] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Signalling peer 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.491421 13468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:54680
I20260709 13:03:19.491796 13471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
mode: GRACEFUL
new_leader_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:54698
I20260709 13:03:19.492533 13471 raft_consensus.cc:606] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Received request to transfer leadership to TS 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:19.494115 13468 raft_consensus.cc:493] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.494776 13468 raft_consensus.cc:3060] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.496425 13656 consensus_queue.cc:1048] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.507237 13468 raft_consensus.cc:515] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.512856 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.512996 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c2a78fdf824431a10b0303a05f389c" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.513247 13468 leader_election.cc:290] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.513827 13396 raft_consensus.cc:3060] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.513981 13545 raft_consensus.cc:3055] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.514430 13545 raft_consensus.cc:740] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:19.515642 13545 consensus_queue.cc:260] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.517128 13545 raft_consensus.cc:3060] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.523068 13396 raft_consensus.cc:2468] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.524947 13435 leader_election.cc:304] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.525859 13617 raft_consensus.cc:2804] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.525911 13545 raft_consensus.cc:2468] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.526487 13617 raft_consensus.cc:697] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.527491 13617 consensus_queue.cc:237] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.535056 13294 catalog_manager.cc:5697] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 1 to 2, leader changed from 050f1d3908394d78b57dc938b15660dc (127.0.107.195) to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 2 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.552651 13615 raft_consensus.cc:993] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: : Instructing follower bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:19.553238 13615 raft_consensus.cc:1081] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Signalling peer bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:19.555285 13396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:35380
I20260709 13:03:19.556216 13396 raft_consensus.cc:493] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.556694 13396 raft_consensus.cc:3060] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.563094 13593 raft_consensus.cc:993] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: : Instructing follower bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:19.563879 13616 raft_consensus.cc:1081] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Signalling peer bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:19.566162 13395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:03:19.566948 13395 raft_consensus.cc:493] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.566709 13396 raft_consensus.cc:515] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.567458 13395 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.569798 13396 leader_election.cc:290] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.570770 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:19.571130 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78872057c908442bab71c00bd7d8c4f4" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.571568 13468 raft_consensus.cc:3060] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.571931 13545 raft_consensus.cc:3055] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.572312 13545 raft_consensus.cc:740] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:19.573134 13545 consensus_queue.cc:260] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.574139 13545 raft_consensus.cc:3060] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.578315 13468 raft_consensus.cc:2468] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:19.579547 13469 raft_consensus.cc:1240] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Rejecting Update request from peer 050f1d3908394d78b57dc938b15660dc for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.580125 13362 leader_election.cc:304] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.581736 13618 raft_consensus.cc:2804] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.581956 13545 raft_consensus.cc:2468] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:19.582322 13618 raft_consensus.cc:697] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:19.583467 13618 consensus_queue.cc:237] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.585942 13395 raft_consensus.cc:515] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.588555 13395 leader_election.cc:290] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.589718 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:19.589828 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.590653 13468 raft_consensus.cc:3055] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.590785 13545 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.591087 13468 raft_consensus.cc:740] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.592218 13468 consensus_queue.cc:260] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.592139 13294 catalog_manager.cc:5697] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 1 to 2, leader changed from 050f1d3908394d78b57dc938b15660dc (127.0.107.195) to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.593899 13468 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.599643 13545 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:19.601233 13468 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:19.601236 13359 leader_election.cc:304] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.602507 13618 raft_consensus.cc:2804] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.603086 13618 raft_consensus.cc:697] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:19.604111 13618 consensus_queue.cc:237] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.612613 13294 catalog_manager.cc:5697] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 1 to 2, leader changed from 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194) to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.677481 13617 raft_consensus.cc:993] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: : Instructing follower bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:19.678020 13616 raft_consensus.cc:1081] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Signalling peer bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:19.679931 13395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:03:19.680639 13395 raft_consensus.cc:493] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.681056 13395 raft_consensus.cc:3060] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.688026 13395 raft_consensus.cc:515] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.690073 13395 leader_election.cc:290] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.691182 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:19.691186 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b91824d3058435d968ef4c7ec305cc7" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.692414 13468 raft_consensus.cc:3055] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.692586 13545 raft_consensus.cc:3060] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.692863 13468 raft_consensus.cc:740] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.693923 13468 consensus_queue.cc:260] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.694680 13616 consensus_queue.cc:1048] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.695381 13468 raft_consensus.cc:3060] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.702668 13545 raft_consensus.cc:2468] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:19.704438 13359 leader_election.cc:304] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.705538 13618 raft_consensus.cc:2804] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.706094 13618 raft_consensus.cc:697] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:19.707053 13618 consensus_queue.cc:237] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.709667 13593 consensus_queue.cc:1048] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.717034 13468 raft_consensus.cc:2468] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:19.720057 13293 catalog_manager.cc:5697] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 1 to 2, leader changed from 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194) to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.724670 13616 raft_consensus.cc:993] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: : Instructing follower 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:19.725361 13616 raft_consensus.cc:1081] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Signalling peer 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:19.727998 13544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:41898
I20260709 13:03:19.728778 13544 raft_consensus.cc:493] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.729333 13544 raft_consensus.cc:3060] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.737351 13544 raft_consensus.cc:515] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.740218 13544 leader_election.cc:290] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:19.740382 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.741436 13395 raft_consensus.cc:3060] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.741986 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742058fef84469eba3f2e8095afcbe9" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:19.742633 13468 raft_consensus.cc:3055] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.742938 13468 raft_consensus.cc:740] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.743899 13468 consensus_queue.cc:260] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.745355 13468 raft_consensus.cc:3060] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.750192 13395 raft_consensus.cc:2468] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 2.
I20260709 13:03:19.751688 13509 leader_election.cc:304] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.752379 13468 raft_consensus.cc:2468] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 2.
I20260709 13:03:19.753058 13656 raft_consensus.cc:2804] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.754024 13656 raft_consensus.cc:697] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 2 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:19.755110 13656 consensus_queue.cc:237] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.756500 13619 raft_consensus.cc:993] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: : Instructing follower 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.757128 13618 raft_consensus.cc:1081] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Signalling peer 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.759613 13468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:54686
I20260709 13:03:19.760308 13468 raft_consensus.cc:493] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.760715 13468 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.764364 13293 catalog_manager.cc:5697] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 1 to 2, leader changed from 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194) to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 2 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.767596 13468 raft_consensus.cc:515] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.769905 13468 leader_election.cc:290] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.771092 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.771498 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.772071 13395 raft_consensus.cc:3055] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.772245 13544 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.772501 13395 raft_consensus.cc:740] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:19.773515 13395 consensus_queue.cc:260] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.775104 13395 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.780750 13544 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.782213 13395 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.782789 13434 leader_election.cc:304] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: 
I20260709 13:03:19.783756 13616 raft_consensus.cc:2804] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.784356 13616 raft_consensus.cc:697] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.785296 13616 consensus_queue.cc:237] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.790656 13591 raft_consensus.cc:993] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: : Instructing follower 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.791262 13591 raft_consensus.cc:1081] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Signalling peer 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.793589 13468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:54680
I20260709 13:03:19.794222 13468 raft_consensus.cc:493] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.794600 13468 raft_consensus.cc:3060] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.795043 13293 catalog_manager.cc:5697] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 1 to 2, leader changed from bbe172d6760941f5ac8af718cdca09eb (127.0.107.193) to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 2 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.803516 13468 raft_consensus.cc:515] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.807068 13468 leader_election.cc:290] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.807708 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.808391 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d349b6ea90a34ab69ce72747888c75f5" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.808591 13395 raft_consensus.cc:3060] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.809172 13544 raft_consensus.cc:3055] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.809530 13544 raft_consensus.cc:740] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:19.810331 13544 consensus_queue.cc:260] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.811494 13544 raft_consensus.cc:3060] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.815780 13395 raft_consensus.cc:2468] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.817229 13435 leader_election.cc:304] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:19.818112 13616 raft_consensus.cc:2804] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.818629 13616 raft_consensus.cc:697] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.818845 13544 raft_consensus.cc:2468] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.819607 13616 consensus_queue.cc:237] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.828873 13292 catalog_manager.cc:5697] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 1 to 2, leader changed from 050f1d3908394d78b57dc938b15660dc (127.0.107.195) to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 2 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.940672 13618 raft_consensus.cc:993] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: : Instructing follower 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.941377 13626 raft_consensus.cc:1081] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Signalling peer 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:19.943419 13468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:54686
I20260709 13:03:19.944118 13468 raft_consensus.cc:493] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.944483 13468 raft_consensus.cc:3060] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.951164 13468 raft_consensus.cc:515] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.953249 13468 leader_election.cc:290] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:19.954495 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:19.954528 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44cbdb9bd824e41972b85467bd01298" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:19.955294 13544 raft_consensus.cc:3060] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.955461 13395 raft_consensus.cc:3055] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.956050 13395 raft_consensus.cc:740] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:19.956869 13395 consensus_queue.cc:260] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.958048 13395 raft_consensus.cc:3060] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.963406 13544 raft_consensus.cc:2468] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.965052 13434 leader_election.cc:304] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: 
I20260709 13:03:19.966074 13616 raft_consensus.cc:2804] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.966069 13395 raft_consensus.cc:2468] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:19.966674 13616 raft_consensus.cc:697] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:19.967785 13616 consensus_queue.cc:237] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:19.976259 13292 catalog_manager.cc:5697] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 1 to 2, leader changed from bbe172d6760941f5ac8af718cdca09eb (127.0.107.193) to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 2 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.028486 13395 raft_consensus.cc:1275] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.030162 13616 consensus_queue.cc:1048] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.033814 13468 raft_consensus.cc:1275] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.035730 13626 consensus_queue.cc:1048] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.040835 13544 raft_consensus.cc:1275] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.042933 13675 consensus_queue.cc:1048] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.060134 13544 raft_consensus.cc:1275] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.062500 13626 consensus_queue.cc:1048] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.121237 13544 raft_consensus.cc:1275] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.122978 13626 consensus_queue.cc:1048] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.134534 13468 raft_consensus.cc:1275] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.136751 13618 consensus_queue.cc:1048] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.177294 13468 raft_consensus.cc:1275] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.179023 13591 consensus_queue.cc:1048] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.189013 13395 raft_consensus.cc:1275] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.191452 13656 consensus_queue.cc:1048] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.229593 13544 raft_consensus.cc:1275] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.231655 13618 consensus_queue.cc:1048] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.243343 13468 raft_consensus.cc:1275] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.245605 13626 consensus_queue.cc:1048] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.281104 13395 raft_consensus.cc:1275] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.282742 13675 consensus_queue.cc:1048] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.293843 13544 raft_consensus.cc:1275] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.296607 13616 consensus_queue.cc:1048] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.379722 13544 raft_consensus.cc:1275] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.381196 13395 raft_consensus.cc:1275] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.381377 13616 consensus_queue.cc:1048] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.383042 13616 consensus_queue.cc:1048] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.401572 13545 raft_consensus.cc:1275] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.404817 13683 consensus_queue.cc:1048] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.405922 13395 raft_consensus.cc:1275] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.407691 13683 consensus_queue.cc:1048] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.525840 13294 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35572:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:22.529248 13294 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:22.586405 13381 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbd118b6ffd4688b76c4f5a28a5f253 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:22.587397 13455 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbd118b6ffd4688b76c4f5a28a5f253 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:22.588151 13381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbd118b6ffd4688b76c4f5a28a5f253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.588260 13530 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbd118b6ffd4688b76c4f5a28a5f253 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:22.589275 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbd118b6ffd4688b76c4f5a28a5f253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.589897 13530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbd118b6ffd4688b76c4f5a28a5f253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.593444 13380 tablet_service.cc:1511] Processing CreateTablet for tablet c5b136a3415744ec86e2cde08cbd5cd2 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:22.595189 13380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5b136a3415744ec86e2cde08cbd5cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.596266 13535 tablet_service.cc:1511] Processing CreateTablet for tablet c5b136a3415744ec86e2cde08cbd5cd2 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:22.599241 13384 tablet_service.cc:1511] Processing CreateTablet for tablet dd91a9d89c054a0eb530c7fb8717d9b7 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:22.601898 13384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd91a9d89c054a0eb530c7fb8717d9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.602921 13532 tablet_service.cc:1511] Processing CreateTablet for tablet dd91a9d89c054a0eb530c7fb8717d9b7 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:22.604218 13456 tablet_service.cc:1511] Processing CreateTablet for tablet c5b136a3415744ec86e2cde08cbd5cd2 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:22.605820 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5b136a3415744ec86e2cde08cbd5cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.606966 13383 tablet_service.cc:1511] Processing CreateTablet for tablet e6acd772f81a4cc58b3811917f122cb8 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:22.608614 13383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6acd772f81a4cc58b3811917f122cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.608765 13457 tablet_service.cc:1511] Processing CreateTablet for tablet dd91a9d89c054a0eb530c7fb8717d9b7 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:22.610395 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd91a9d89c054a0eb530c7fb8717d9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.598023 13535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5b136a3415744ec86e2cde08cbd5cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.617518 13532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd91a9d89c054a0eb530c7fb8717d9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.617728 13459 tablet_service.cc:1511] Processing CreateTablet for tablet e6acd772f81a4cc58b3811917f122cb8 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:22.619369 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6acd772f81a4cc58b3811917f122cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.620024 13531 tablet_service.cc:1511] Processing CreateTablet for tablet e6acd772f81a4cc58b3811917f122cb8 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:22.621620 13531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6acd772f81a4cc58b3811917f122cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.639679 13386 tablet_service.cc:1511] Processing CreateTablet for tablet 877c18a0a212421ea1554c0facce3661 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:22.641726 13386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877c18a0a212421ea1554c0facce3661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.659076 13460 tablet_service.cc:1511] Processing CreateTablet for tablet 877c18a0a212421ea1554c0facce3661 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:22.660801 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877c18a0a212421ea1554c0facce3661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.666514 13533 tablet_service.cc:1511] Processing CreateTablet for tablet 877c18a0a212421ea1554c0facce3661 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:22.668202 13533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877c18a0a212421ea1554c0facce3661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.667809 13458 tablet_service.cc:1511] Processing CreateTablet for tablet 0250819cca574f6592ce5cfd53cdca5e (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:22.669425 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0250819cca574f6592ce5cfd53cdca5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.672379 13381 tablet_service.cc:1511] Processing CreateTablet for tablet 0250819cca574f6592ce5cfd53cdca5e (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:22.674171 13381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0250819cca574f6592ce5cfd53cdca5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.687198 13534 tablet_service.cc:1511] Processing CreateTablet for tablet 0250819cca574f6592ce5cfd53cdca5e (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:22.693270 13534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0250819cca574f6592ce5cfd53cdca5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.699709 13382 tablet_service.cc:1511] Processing CreateTablet for tablet b59cce9af31549ba89138966e7921941 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:22.700414 13699 tablet_bootstrap.cc:492] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:22.701470 13382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59cce9af31549ba89138966e7921941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.706578 13461 tablet_service.cc:1511] Processing CreateTablet for tablet b59cce9af31549ba89138966e7921941 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:22.715044 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59cce9af31549ba89138966e7921941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.708860 13529 tablet_service.cc:1511] Processing CreateTablet for tablet b59cce9af31549ba89138966e7921941 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:22.723696 13529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59cce9af31549ba89138966e7921941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.735376 13383 tablet_service.cc:1511] Processing CreateTablet for tablet d4ceb884da0c4c19b1df9628523c1fe7 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:22.737103 13383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ceb884da0c4c19b1df9628523c1fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.747345 13460 tablet_service.cc:1511] Processing CreateTablet for tablet d4ceb884da0c4c19b1df9628523c1fe7 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:22.750634 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ceb884da0c4c19b1df9628523c1fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.751296 13384 tablet_service.cc:1511] Processing CreateTablet for tablet 950403f16bd84656909fdf571b80f7fb (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:22.752951 13384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950403f16bd84656909fdf571b80f7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.756395 13533 tablet_service.cc:1511] Processing CreateTablet for tablet d4ceb884da0c4c19b1df9628523c1fe7 (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:22.758302 13533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ceb884da0c4c19b1df9628523c1fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.763063 13701 tablet_bootstrap.cc:492] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:22.781499 13456 tablet_service.cc:1511] Processing CreateTablet for tablet 950403f16bd84656909fdf571b80f7fb (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:22.785585 13530 tablet_service.cc:1511] Processing CreateTablet for tablet 950403f16bd84656909fdf571b80f7fb (DEFAULT_TABLE table=soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:22.810379 13530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950403f16bd84656909fdf571b80f7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.798146 13701 tablet_bootstrap.cc:654] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.799203 13700 tablet_bootstrap.cc:492] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:22.810379 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950403f16bd84656909fdf571b80f7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.829419 13700 tablet_bootstrap.cc:654] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.832333 13699 tablet_bootstrap.cc:654] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.848511 13701 tablet_bootstrap.cc:492] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:22.849365 13701 ts_tablet_manager.cc:1403] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.005s
I20260709 13:03:22.852885 13701 raft_consensus.cc:359] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.853776 13701 raft_consensus.cc:385] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.854104 13701 raft_consensus.cc:740] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.856470 13700 tablet_bootstrap.cc:492] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:22.857213 13700 ts_tablet_manager.cc:1403] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.000s
I20260709 13:03:22.861384 13700 raft_consensus.cc:359] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.862437 13700 raft_consensus.cc:385] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.862815 13700 raft_consensus.cc:740] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.854946 13701 consensus_queue.cc:260] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.865571 13700 consensus_queue.cc:260] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.868819 13701 ts_tablet_manager.cc:1434] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:03:22.870168 13701 tablet_bootstrap.cc:492] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:22.870734 13699 tablet_bootstrap.cc:492] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:22.872025 13699 ts_tablet_manager.cc:1403] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.003s
I20260709 13:03:22.870008 13700 ts_tablet_manager.cc:1434] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:03:22.875892 13699 raft_consensus.cc:359] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.876735 13700 tablet_bootstrap.cc:492] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:22.876780 13699 raft_consensus.cc:385] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.877419 13699 raft_consensus.cc:740] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.878593 13699 consensus_queue.cc:260] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.881740 13699 ts_tablet_manager.cc:1434] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:22.885051 13700 tablet_bootstrap.cc:654] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.886101 13701 tablet_bootstrap.cc:654] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.891310 13699 tablet_bootstrap.cc:492] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:22.896312 13701 tablet_bootstrap.cc:492] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:22.896651 13700 tablet_bootstrap.cc:492] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:22.897235 13701 ts_tablet_manager.cc:1403] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.003s
I20260709 13:03:22.898007 13700 ts_tablet_manager.cc:1403] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:03:22.901160 13699 tablet_bootstrap.cc:654] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.901136 13701 raft_consensus.cc:359] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.902210 13701 raft_consensus.cc:385] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.902586 13701 raft_consensus.cc:740] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.903430 13701 consensus_queue.cc:260] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.906154 13701 ts_tablet_manager.cc:1434] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:22.907806 13701 tablet_bootstrap.cc:492] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:22.903913 13700 raft_consensus.cc:359] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.908633 13700 raft_consensus.cc:385] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.909122 13700 raft_consensus.cc:740] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.910470 13700 consensus_queue.cc:260] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.916704 13700 ts_tablet_manager.cc:1434] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:03:22.918378 13700 tablet_bootstrap.cc:492] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:22.916734 13701 tablet_bootstrap.cc:654] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.927527 13699 tablet_bootstrap.cc:492] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:22.928282 13699 ts_tablet_manager.cc:1403] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.016s
I20260709 13:03:22.930781 13700 tablet_bootstrap.cc:654] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.931978 13699 raft_consensus.cc:359] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.932967 13699 raft_consensus.cc:385] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.933331 13699 raft_consensus.cc:740] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.934294 13699 consensus_queue.cc:260] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.937505 13699 ts_tablet_manager.cc:1434] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:22.938686 13701 tablet_bootstrap.cc:492] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:22.938745 13699 tablet_bootstrap.cc:492] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:22.939643 13701 ts_tablet_manager.cc:1403] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.010s
I20260709 13:03:22.939518 13700 tablet_bootstrap.cc:492] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:22.940593 13700 ts_tablet_manager.cc:1403] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:03:22.943811 13701 raft_consensus.cc:359] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.944912 13701 raft_consensus.cc:385] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.944587 13700 raft_consensus.cc:359] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.945322 13701 raft_consensus.cc:740] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.945734 13700 raft_consensus.cc:385] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.946082 13700 raft_consensus.cc:740] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.946453 13701 consensus_queue.cc:260] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.946915 13700 consensus_queue.cc:260] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.949430 13701 ts_tablet_manager.cc:1434] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:03:22.949518 13700 ts_tablet_manager.cc:1434] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:03:22.950640 13701 tablet_bootstrap.cc:492] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:22.950640 13700 tablet_bootstrap.cc:492] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:22.955133 13699 tablet_bootstrap.cc:654] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.958915 13700 tablet_bootstrap.cc:654] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.959817 13701 tablet_bootstrap.cc:654] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.968645 13699 tablet_bootstrap.cc:492] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:22.969314 13699 ts_tablet_manager.cc:1403] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 13:03:22.973881 13699 raft_consensus.cc:359] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.974757 13699 raft_consensus.cc:385] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.975086 13699 raft_consensus.cc:740] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.975898 13699 consensus_queue.cc:260] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.984963 13701 tablet_bootstrap.cc:492] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:22.985628 13701 ts_tablet_manager.cc:1403] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.023s
I20260709 13:03:22.987677 13700 tablet_bootstrap.cc:492] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:22.988663 13700 ts_tablet_manager.cc:1403] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.008s
I20260709 13:03:22.990000 13699 ts_tablet_manager.cc:1434] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:03:22.991449 13699 tablet_bootstrap.cc:492] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:22.992852 13700 raft_consensus.cc:359] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.993803 13700 raft_consensus.cc:385] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.994104 13701 raft_consensus.cc:359] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.994987 13701 raft_consensus.cc:385] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.995287 13701 raft_consensus.cc:740] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.994148 13700 raft_consensus.cc:740] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.996192 13701 consensus_queue.cc:260] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.996889 13700 consensus_queue.cc:260] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:22.999781 13700 ts_tablet_manager.cc:1434] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:03:23.000349 13701 ts_tablet_manager.cc:1434] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:03:23.000569 13711 raft_consensus.cc:493] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.001755 13701 tablet_bootstrap.cc:492] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:23.001961 13699 tablet_bootstrap.cc:654] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.001338 13711 raft_consensus.cc:515] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.008987 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.009361 13700 tablet_bootstrap.cc:492] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:23.009922 13395 raft_consensus.cc:2468] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.011874 13435 leader_election.cc:304] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.012396 13701 tablet_bootstrap.cc:654] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.013123 13593 raft_consensus.cc:2804] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.013715 13593 raft_consensus.cc:493] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.014165 13593 raft_consensus.cc:3060] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.026366 13700 tablet_bootstrap.cc:654] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.027019 13699 tablet_bootstrap.cc:492] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:23.030092 13699 ts_tablet_manager.cc:1403] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.015s
I20260709 13:03:23.037005 13711 leader_election.cc:290] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.041541 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
W20260709 13:03:23.043742 13434 leader_election.cc:343] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.044955 13699 raft_consensus.cc:359] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.047821 13699 raft_consensus.cc:385] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.050002 13699 raft_consensus.cc:740] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.050945 13699 consensus_queue.cc:260] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.052759 13701 tablet_bootstrap.cc:492] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:23.053769 13701 ts_tablet_manager.cc:1403] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.006s
I20260709 13:03:23.053889 13699 ts_tablet_manager.cc:1434] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:03:23.055828 13699 tablet_bootstrap.cc:492] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:23.059491 13591 raft_consensus.cc:493] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.060359 13591 raft_consensus.cc:515] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.063834 13699 tablet_bootstrap.cc:654] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.064235 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.065076 13395 raft_consensus.cc:2468] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:23.067034 13509 leader_election.cc:304] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.059077 13701 raft_consensus.cc:359] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.067101 13593 raft_consensus.cc:515] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.070344 13591 leader_election.cc:290] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:23.072669 13701 raft_consensus.cc:385] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.073606 13701 raft_consensus.cc:740] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.072124 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:23.073697 13591 raft_consensus.cc:2804] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.074843 13701 consensus_queue.cc:260] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.076117 13468 raft_consensus.cc:2468] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 0.
I20260709 13:03:23.075454 13591 raft_consensus.cc:493] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.077034 13591 raft_consensus.cc:3060] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.077297 13593 leader_election.cc:290] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.077927 13701 ts_tablet_manager.cc:1434] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:03:23.079325 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.072583 13700 tablet_bootstrap.cc:492] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:23.081353 13700 ts_tablet_manager.cc:1403] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.020s
I20260709 13:03:23.082787 13699 tablet_bootstrap.cc:492] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:23.083658 13699 ts_tablet_manager.cc:1403] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 13:03:23.085841 13700 raft_consensus.cc:359] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.086846 13700 raft_consensus.cc:385] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.087075 13699 raft_consensus.cc:359] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.087239 13700 raft_consensus.cc:740] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
W20260709 13:03:23.088080 13434 leader_election.cc:343] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.088402 13701 tablet_bootstrap.cc:492] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:23.089046 13700 consensus_queue.cc:260] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.093945 13700 ts_tablet_manager.cc:1434] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:03:23.095281 13700 tablet_bootstrap.cc:492] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:23.095844 13591 raft_consensus.cc:515] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.099720 13395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:23.100548 13395 raft_consensus.cc:3060] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.103375 13700 tablet_bootstrap.cc:654] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.107319 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:23.108377 13396 raft_consensus.cc:3060] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.108875 13593 raft_consensus.cc:493] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.109501 13593 raft_consensus.cc:515] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.088080 13699 raft_consensus.cc:385] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.117043 13699 raft_consensus.cc:740] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.118247 13593 leader_election.cc:290] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.118053 13699 consensus_queue.cc:260] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.120877 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.121714 13544 raft_consensus.cc:2468] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.122903 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:23.123613 13394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.124295 13719 raft_consensus.cc:493] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.124891 13719 raft_consensus.cc:515] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.127754 13591 leader_election.cc:290] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
W20260709 13:03:23.128594 13435 leader_election.cc:343] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.139729 13701 tablet_bootstrap.cc:654] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.123733 13468 raft_consensus.cc:3060] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.142284 13434 leader_election.cc:304] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.144781 13593 raft_consensus.cc:2804] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.145427 13593 raft_consensus.cc:493] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.145778 13593 raft_consensus.cc:3060] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.134433 13719 leader_election.cc:290] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:23.134594 13394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.149188 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
W20260709 13:03:23.149711 13509 leader_election.cc:343] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.151925 13711 raft_consensus.cc:493] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.152702 13711 raft_consensus.cc:515] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.155578 13701 tablet_bootstrap.cc:492] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:23.156638 13701 ts_tablet_manager.cc:1403] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.018s
I20260709 13:03:23.157116 13394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877c18a0a212421ea1554c0facce3661" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.158505 13394 raft_consensus.cc:2468] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.160632 13711 leader_election.cc:290] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.160670 13701 raft_consensus.cc:359] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.162009 13701 raft_consensus.cc:385] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.162336 13701 raft_consensus.cc:740] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.163005 13435 leader_election.cc:304] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.164506 13711 raft_consensus.cc:2804] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.163174 13701 consensus_queue.cc:260] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.165244 13711 raft_consensus.cc:493] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.165261 13699 ts_tablet_manager.cc:1434] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.004s
I20260709 13:03:23.167438 13701 ts_tablet_manager.cc:1434] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:03:23.168947 13701 tablet_bootstrap.cc:492] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:23.165805 13711 raft_consensus.cc:3060] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.167270 13699 tablet_bootstrap.cc:492] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:23.180600 13593 raft_consensus.cc:515] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.180915 13701 tablet_bootstrap.cc:654] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.181035 13468 raft_consensus.cc:2468] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:23.182193 13469 raft_consensus.cc:2393] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 050f1d3908394d78b57dc938b15660dc in current term 1: Already voted for candidate 666c0dbd00a542d1970b42ceb7ad00af in this term.
I20260709 13:03:23.187029 13395 raft_consensus.cc:2468] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 1.
I20260709 13:03:23.188184 13593 leader_election.cc:290] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.185155 13394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:23.193594 13509 leader_election.cc:304] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.194784 13719 raft_consensus.cc:2804] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.195363 13719 raft_consensus.cc:697] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
W20260709 13:03:23.195431 13435 leader_election.cc:343] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.189267 13396 raft_consensus.cc:2468] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.196429 13719 consensus_queue.cc:237] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.197139 13435 leader_election.cc:304] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:23.197201 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877c18a0a212421ea1554c0facce3661" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.198161 13544 raft_consensus.cc:2468] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.198734 13593 raft_consensus.cc:2804] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.199340 13593 raft_consensus.cc:697] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:23.200145 13711 raft_consensus.cc:515] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.200270 13593 consensus_queue.cc:237] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.205263 13711 leader_election.cc:290] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.205492 13700 tablet_bootstrap.cc:492] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:23.206341 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877c18a0a212421ea1554c0facce3661" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:23.206828 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.208729 13544 raft_consensus.cc:3060] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.209406 13701 tablet_bootstrap.cc:492] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:23.210088 13701 ts_tablet_manager.cc:1403] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.005s
I20260709 13:03:23.207716 13700 ts_tablet_manager.cc:1403] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.113s	user 0.034s	sys 0.043s
I20260709 13:03:23.207727 13396 raft_consensus.cc:3060] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.214761 13701 raft_consensus.cc:359] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.215605 13701 raft_consensus.cc:385] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.215911 13701 raft_consensus.cc:740] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.216794 13701 consensus_queue.cc:260] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.218359 13700 raft_consensus.cc:359] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.218313 13292 catalog_manager.cc:5697] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 1 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.219671 13700 raft_consensus.cc:385] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.219873 13701 ts_tablet_manager.cc:1434] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260709 13:03:23.220336 13700 raft_consensus.cc:740] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.221392 13701 tablet_bootstrap.cc:492] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:23.221204 13700 consensus_queue.cc:260] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.222334 13396 raft_consensus.cc:2468] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.226449 13700 ts_tablet_manager.cc:1434] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:03:23.227768 13435 leader_election.cc:304] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.228873 13711 raft_consensus.cc:2804] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.229056 13700 tablet_bootstrap.cc:492] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:23.229506 13711 raft_consensus.cc:697] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:23.230266 13701 tablet_bootstrap.cc:654] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.230664 13711 consensus_queue.cc:237] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.236657 13511 leader_election.cc:304] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc; no voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.241645 13545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877c18a0a212421ea1554c0facce3661" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.242511 13545 raft_consensus.cc:3060] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.243781 13701 tablet_bootstrap.cc:492] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:23.244517 13701 ts_tablet_manager.cc:1403] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:03:23.249682 13701 raft_consensus.cc:359] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.250591 13701 raft_consensus.cc:385] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.252775 13701 raft_consensus.cc:740] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.252624 13545 raft_consensus.cc:2468] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.251832 13700 tablet_bootstrap.cc:654] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.253928 13701 consensus_queue.cc:260] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.256675 13701 ts_tablet_manager.cc:1434] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:23.257997 13701 tablet_bootstrap.cc:492] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: Bootstrap starting.
I20260709 13:03:23.259640 13711 raft_consensus.cc:493] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.260833 13711 raft_consensus.cc:515] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.264135 13711 leader_election.cc:290] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.265486 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.266426 13396 raft_consensus.cc:2468] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.268026 13435 leader_election.cc:304] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.268167 13701 tablet_bootstrap.cc:654] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.269203 13711 raft_consensus.cc:2804] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.271531 13711 raft_consensus.cc:493] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.272046 13711 raft_consensus.cc:3060] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.283761 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.284745 13543 raft_consensus.cc:2468] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.288137 13722 raft_consensus.cc:493] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.288847 13722 raft_consensus.cc:515] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.291973 13701 tablet_bootstrap.cc:492] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: No bootstrap required, opened a new log
I20260709 13:03:23.292858 13701 ts_tablet_manager.cc:1403] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.004s
I20260709 13:03:23.293458 13722 leader_election.cc:290] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.296826 13711 raft_consensus.cc:515] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.301957 13701 raft_consensus.cc:359] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.306368 13701 raft_consensus.cc:385] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.306797 13701 raft_consensus.cc:740] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.308425 13701 consensus_queue.cc:260] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.309692 13544 raft_consensus.cc:2468] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.310690 13719 raft_consensus.cc:2749] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.312275 13699 tablet_bootstrap.cc:654] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.312474 13711 leader_election.cc:290] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.312623 13701 ts_tablet_manager.cc:1434] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:03:23.316541 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.318157 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.319604 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
W20260709 13:03:23.320573 13435 leader_election.cc:343] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.327170 13396 raft_consensus.cc:3060] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.333914 13434 leader_election.cc:304] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.335007 13732 raft_consensus.cc:2804] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.335738 13732 raft_consensus.cc:697] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
W20260709 13:03:23.336802 13434 leader_election.cc:343] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.336760 13732 consensus_queue.cc:237] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.337440 13434 leader_election.cc:304] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af; no voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.337213 13294 catalog_manager.cc:5697] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.338394 13722 raft_consensus.cc:2749] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.339766 13294 catalog_manager.cc:5697] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.340400 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.341300 13544 raft_consensus.cc:3060] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.338980 13396 raft_consensus.cc:2468] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.344240 13435 leader_election.cc:304] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.345728 13722 raft_consensus.cc:2804] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.346464 13722 raft_consensus.cc:697] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:23.347759 13722 consensus_queue.cc:237] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.350461 13700 tablet_bootstrap.cc:492] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:23.351184 13700 ts_tablet_manager.cc:1403] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.122s	user 0.041s	sys 0.040s
I20260709 13:03:23.351194 13717 raft_consensus.cc:493] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.352432 13544 raft_consensus.cc:2468] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.352524 13717 raft_consensus.cc:515] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.354580 13700 raft_consensus.cc:359] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.355296 13700 raft_consensus.cc:385] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.355581 13700 raft_consensus.cc:740] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.356626 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acd772f81a4cc58b3811917f122cb8" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:23.357501 13469 raft_consensus.cc:2468] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:23.358098 13717 leader_election.cc:290] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.359786 13362 leader_election.cc:304] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.361004 13717 raft_consensus.cc:2804] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.361529 13717 raft_consensus.cc:493] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.361980 13717 raft_consensus.cc:3060] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.362224 13699 tablet_bootstrap.cc:492] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:23.363304 13699 ts_tablet_manager.cc:1403] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.004s
I20260709 13:03:23.361835 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acd772f81a4cc58b3811917f122cb8" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.365172 13544 raft_consensus.cc:2468] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:23.360541 13700 consensus_queue.cc:260] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.369328 13700 ts_tablet_manager.cc:1434] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:03:23.371009 13700 tablet_bootstrap.cc:492] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:23.367636 13699 raft_consensus.cc:359] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.372005 13699 raft_consensus.cc:385] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.372552 13699 raft_consensus.cc:740] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.373700 13699 consensus_queue.cc:260] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.377059 13699 ts_tablet_manager.cc:1434] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:03:23.378700 13699 tablet_bootstrap.cc:492] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:23.380733 13700 tablet_bootstrap.cc:654] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.388176 13699 tablet_bootstrap.cc:654] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.387329 13292 catalog_manager.cc:5697] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.389775 13292 catalog_manager.cc:5697] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:23.404456 13342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:23.420800 13717 raft_consensus.cc:515] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.422664 13699 tablet_bootstrap.cc:492] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:23.423673 13699 ts_tablet_manager.cc:1403] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.019s
I20260709 13:03:23.424499 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acd772f81a4cc58b3811917f122cb8" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.424460 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acd772f81a4cc58b3811917f122cb8" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:23.425375 13469 raft_consensus.cc:3060] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.425365 13544 raft_consensus.cc:3060] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.429045 13699 raft_consensus.cc:359] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.430320 13699 raft_consensus.cc:385] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.430721 13699 raft_consensus.cc:740] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.431429 13719 raft_consensus.cc:493] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.432209 13719 raft_consensus.cc:515] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.433100 13699 consensus_queue.cc:260] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.434273 13700 tablet_bootstrap.cc:492] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:23.434888 13700 ts_tablet_manager.cc:1403] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.034s
I20260709 13:03:23.434931 13719 leader_election.cc:290] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:23.436112 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.437216 13396 raft_consensus.cc:2393] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 050f1d3908394d78b57dc938b15660dc in current term 1: Already voted for candidate 666c0dbd00a542d1970b42ceb7ad00af in this term.
I20260709 13:03:23.439033 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:23.439384 13699 ts_tablet_manager.cc:1434] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:03:23.440661 13699 tablet_bootstrap.cc:492] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:23.438314 13700 raft_consensus.cc:359] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.441164 13700 raft_consensus.cc:385] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.441753 13700 raft_consensus.cc:740] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.442519 13700 consensus_queue.cc:260] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.445080 13700 ts_tablet_manager.cc:1434] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:03:23.446856 13700 tablet_bootstrap.cc:492] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: Bootstrap starting.
I20260709 13:03:23.448503 13509 leader_election.cc:304] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc; no voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.451813 13717 leader_election.cc:290] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.448623 13699 tablet_bootstrap.cc:654] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.454234 13700 tablet_bootstrap.cc:654] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.454901 13719 raft_consensus.cc:3060] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.457378 13544 raft_consensus.cc:2468] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:23.459173 13359 leader_election.cc:304] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.463078 13699 tablet_bootstrap.cc:492] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:23.464102 13699 ts_tablet_manager.cc:1403] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 13:03:23.465106 13469 raft_consensus.cc:2468] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:23.468621 13717 raft_consensus.cc:2804] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.468766 13699 raft_consensus.cc:359] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.470149 13699 raft_consensus.cc:385] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.470583 13699 raft_consensus.cc:740] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.474525 13719 raft_consensus.cc:2749] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.474359 13699 consensus_queue.cc:260] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.476583 13717 raft_consensus.cc:697] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:23.478098 13699 ts_tablet_manager.cc:1434] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:03:23.477782 13717 consensus_queue.cc:237] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.480765 13699 tablet_bootstrap.cc:492] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: Bootstrap starting.
I20260709 13:03:23.489212 13722 raft_consensus.cc:493] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.490296 13722 raft_consensus.cc:515] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.491515 13700 tablet_bootstrap.cc:492] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: No bootstrap required, opened a new log
I20260709 13:03:23.492043 13699 tablet_bootstrap.cc:654] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.492463 13700 ts_tablet_manager.cc:1403] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.020s
I20260709 13:03:23.494848 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250819cca574f6592ce5cfd53cdca5e" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb" is_pre_election: true
I20260709 13:03:23.495729 13396 raft_consensus.cc:2468] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.496512 13700 raft_consensus.cc:359] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.497489 13700 raft_consensus.cc:385] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.497776 13700 raft_consensus.cc:740] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.498081 13435 leader_election.cc:304] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.498478 13700 consensus_queue.cc:260] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.499672 13732 raft_consensus.cc:2804] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.500257 13732 raft_consensus.cc:493] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.500630 13732 raft_consensus.cc:3060] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.505550 13699 tablet_bootstrap.cc:492] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: No bootstrap required, opened a new log
I20260709 13:03:23.506281 13699 ts_tablet_manager.cc:1403] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:03:23.502099 13626 raft_consensus.cc:493] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.509214 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250819cca574f6592ce5cfd53cdca5e" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.509697 13699 raft_consensus.cc:359] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.511487 13699 raft_consensus.cc:385] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.507525 13291 catalog_manager.cc:5697] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.511898 13699 raft_consensus.cc:740] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.511826 13543 raft_consensus.cc:2468] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 0.
I20260709 13:03:23.513129 13699 consensus_queue.cc:260] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.515960 13699 ts_tablet_manager.cc:1434] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:03:23.514063 13722 leader_election.cc:290] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.520992 13717 raft_consensus.cc:493] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.521768 13717 raft_consensus.cc:515] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.521782 13732 raft_consensus.cc:515] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.524385 13717 leader_election.cc:290] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.525776 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.525790 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:23.526779 13468 raft_consensus.cc:2468] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:23.527652 13732 leader_election.cc:290] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.527971 13700 ts_tablet_manager.cc:1434] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: Time spent starting tablet: real 0.035s	user 0.014s	sys 0.020s
I20260709 13:03:23.526757 13543 raft_consensus.cc:2468] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:23.529541 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250819cca574f6592ce5cfd53cdca5e" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.515223 13626 raft_consensus.cc:515] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.530212 13544 raft_consensus.cc:3060] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.529146 13362 leader_election.cc:304] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.531610 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250819cca574f6592ce5cfd53cdca5e" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:23.532369 13396 raft_consensus.cc:3060] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.532603 13744 raft_consensus.cc:2804] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.533651 13744 raft_consensus.cc:493] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.534076 13744 raft_consensus.cc:3060] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.534855 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.535708 13543 raft_consensus.cc:2468] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:23.537135 13359 leader_election.cc:304] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.538234 13745 raft_consensus.cc:2804] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.538674 13745 raft_consensus.cc:493] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.539038 13745 raft_consensus.cc:3060] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.541153 13396 raft_consensus.cc:2468] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.544659 13435 leader_election.cc:304] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.544739 13744 raft_consensus.cc:515] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.545789 13732 raft_consensus.cc:2804] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.546669 13732 raft_consensus.cc:697] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:23.548056 13744 leader_election.cc:290] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.547808 13732 consensus_queue.cc:237] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.548506 13544 raft_consensus.cc:2468] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 1.
I20260709 13:03:23.550958 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.551728 13544 raft_consensus.cc:3060] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.552410 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:23.532778 13626 leader_election.cc:290] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.555883 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:23.556666 13469 raft_consensus.cc:2468] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 0.
I20260709 13:03:23.556679 13468 raft_consensus.cc:3060] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.561580 13544 raft_consensus.cc:2468] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:23.563383 13359 leader_election.cc:304] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.560158 13745 raft_consensus.cc:515] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.564527 13626 raft_consensus.cc:2804] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.565096 13626 raft_consensus.cc:697] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:23.566094 13626 consensus_queue.cc:237] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.568552 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:23.569420 13469 raft_consensus.cc:3060] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.569515 13468 raft_consensus.cc:2468] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:23.573335 13745 leader_election.cc:290] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.575498 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.576383 13544 raft_consensus.cc:3060] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.581676 13291 catalog_manager.cc:5697] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 0 to 1, leader changed from <none> to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 1 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.582518 13292 catalog_manager.cc:5697] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.584375 13469 raft_consensus.cc:2468] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:23.586081 13362 leader_election.cc:304] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.587069 13626 raft_consensus.cc:2804] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.587808 13544 raft_consensus.cc:2468] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 1.
I20260709 13:03:23.588532 13626 raft_consensus.cc:697] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:23.589802 13626 consensus_queue.cc:237] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.604476 13292 catalog_manager.cc:5697] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.626168 13719 consensus_queue.cc:1048] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.642189 13591 consensus_queue.cc:1048] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.647141 13626 raft_consensus.cc:493] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.647779 13626 raft_consensus.cc:515] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.649396 13468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
mode: GRACEFUL
new_leader_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:54698
I20260709 13:03:23.650233 13468 raft_consensus.cc:606] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Received request to transfer leadership to TS bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.657719 13626 leader_election.cc:290] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.658205 13468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
mode: GRACEFUL
new_leader_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:54698
I20260709 13:03:23.658823 13469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af" is_pre_election: true
I20260709 13:03:23.658946 13468 raft_consensus.cc:606] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Received request to transfer leadership to TS bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.659104 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ceb884da0c4c19b1df9628523c1fe7" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050f1d3908394d78b57dc938b15660dc" is_pre_election: true
I20260709 13:03:23.660221 13544 raft_consensus.cc:2393] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbe172d6760941f5ac8af718cdca09eb in current term 1: Already voted for candidate 666c0dbd00a542d1970b42ceb7ad00af in this term.
I20260709 13:03:23.663189 13359 leader_election.cc:304] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe172d6760941f5ac8af718cdca09eb; no voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:23.664968 13745 raft_consensus.cc:3060] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.668666 13544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
mode: GRACEFUL
new_leader_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:41906
I20260709 13:03:23.669648 13544 raft_consensus.cc:606] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Received request to transfer leadership to TS bbe172d6760941f5ac8af718cdca09eb
I20260709 13:03:23.672222 13732 consensus_queue.cc:1048] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.690824 13722 consensus_queue.cc:1048] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.693881 13745 raft_consensus.cc:2749] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.695192 13396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59cce9af31549ba89138966e7921941"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
mode: GRACEFUL
new_leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:35396
I20260709 13:03:23.696061 13396 raft_consensus.cc:606] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Received request to transfer leadership to TS 666c0dbd00a542d1970b42ceb7ad00af
I20260709 13:03:23.707445 13722 consensus_queue.cc:1048] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.714061 13394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
mode: GRACEFUL
new_leader_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:35396
I20260709 13:03:23.714707 13394 raft_consensus.cc:606] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Received request to transfer leadership to TS 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:23.717309 13732 raft_consensus.cc:993] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: : Instructing follower bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:23.717865 13732 raft_consensus.cc:1081] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Signalling peer bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:23.720623 13396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:03:23.722942 13396 raft_consensus.cc:493] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.723654 13396 raft_consensus.cc:3060] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.727028 13593 consensus_queue.cc:1048] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.736379 13396 raft_consensus.cc:515] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.745656 13593 consensus_queue.cc:1048] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.746490 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:23.747318 13468 raft_consensus.cc:3055] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:23.747669 13468 raft_consensus.cc:740] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:23.747944 13396 leader_election.cc:290] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.748545 13468 consensus_queue.cc:260] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.749744 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5b136a3415744ec86e2cde08cbd5cd2" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.750082 13468 raft_consensus.cc:3060] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.750582 13544 raft_consensus.cc:3060] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.754529 13593 consensus_queue.cc:1048] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.762491 13468 raft_consensus.cc:2468] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:23.764532 13362 leader_election.cc:304] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.765765 13626 raft_consensus.cc:2804] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:23.766820 13626 raft_consensus.cc:697] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:23.768267 13626 consensus_queue.cc:237] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.769709 13544 raft_consensus.cc:2468] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:23.792464 13732 consensus_queue.cc:1048] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.804652 13294 catalog_manager.cc:5697] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 1 to 2, leader changed from 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194) to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.807687 13593 raft_consensus.cc:993] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: : Instructing follower bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:23.808640 13731 raft_consensus.cc:1081] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Signalling peer bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:23.810544 13396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:03:23.811198 13396 raft_consensus.cc:493] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.811667 13396 raft_consensus.cc:3060] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.815430 13731 consensus_queue.cc:1048] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.821233 13396 raft_consensus.cc:515] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.827072 13396 leader_election.cc:290] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:23.829224 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:23.830090 13468 raft_consensus.cc:3055] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:23.830471 13468 raft_consensus.cc:740] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:23.831301 13468 consensus_queue.cc:260] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.832661 13544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbd118b6ffd4688b76c4f5a28a5f253" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:23.833361 13544 raft_consensus.cc:3060] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.832825 13468 raft_consensus.cc:3060] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.841534 13544 raft_consensus.cc:2468] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:23.843040 13359 leader_election.cc:304] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:23.844096 13626 raft_consensus.cc:2804] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:23.844650 13626 raft_consensus.cc:697] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:23.845775 13468 raft_consensus.cc:2468] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:23.845645 13626 consensus_queue.cc:237] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:23.856343 13294 catalog_manager.cc:5697] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 1 to 2, leader changed from 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194) to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.883431 13626 consensus_queue.cc:1048] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.898947 13626 consensus_queue.cc:1048] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.002120 13717 consensus_queue.cc:1048] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.019675 13731 consensus_queue.cc:1048] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.019336 13717 consensus_queue.cc:1048] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.031670 13717 raft_consensus.cc:993] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: : Instructing follower 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:24.032261 13717 raft_consensus.cc:1081] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Signalling peer 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:24.036230 13722 consensus_queue.cc:1048] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.039117 13544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:41900
I20260709 13:03:24.039848 13544 raft_consensus.cc:493] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.040247 13544 raft_consensus.cc:3060] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.049541 13544 raft_consensus.cc:515] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.052377 13544 leader_election.cc:290] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:24.053913 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:24.054697 13468 raft_consensus.cc:3060] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.054885 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950403f16bd84656909fdf571b80f7fb" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:24.055670 13396 raft_consensus.cc:3055] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:24.056284 13396 raft_consensus.cc:740] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:24.057739 13396 consensus_queue.cc:260] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.059239 13396 raft_consensus.cc:3060] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.064357 13468 raft_consensus.cc:2468] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 2.
I20260709 13:03:24.067392 13511 leader_election.cc:304] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: 
I20260709 13:03:24.068418 13396 raft_consensus.cc:2468] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 2.
I20260709 13:03:24.068643 13719 raft_consensus.cc:2804] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:24.069478 13719 raft_consensus.cc:697] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 2 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:24.070503 13719 consensus_queue.cc:237] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.078943 13294 catalog_manager.cc:5697] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 1 to 2, leader changed from bbe172d6760941f5ac8af718cdca09eb (127.0.107.193) to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 2 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.137321 13717 consensus_queue.cc:1048] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:24.151948 13626 consensus_queue.cc:1048] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.165067 13744 raft_consensus.cc:993] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: : Instructing follower 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:24.165712 13626 raft_consensus.cc:1081] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Signalling peer 666c0dbd00a542d1970b42ceb7ad00af to start an election
I20260709 13:03:24.167523 13468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59cce9af31549ba89138966e7921941"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
 from {username='slave'} at 127.0.0.1:54686
I20260709 13:03:24.168207 13468 raft_consensus.cc:493] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.168598 13468 raft_consensus.cc:3060] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.176640 13468 raft_consensus.cc:515] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.179772 13468 leader_election.cc:290] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:24.181092 13396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:24.181910 13396 raft_consensus.cc:3055] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:24.182158 13396 raft_consensus.cc:740] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:24.182082 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59cce9af31549ba89138966e7921941" candidate_uuid: "666c0dbd00a542d1970b42ceb7ad00af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:24.183622 13543 raft_consensus.cc:3060] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.183318 13396 consensus_queue.cc:260] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.184847 13396 raft_consensus.cc:3060] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.193226 13543 raft_consensus.cc:2468] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:24.193441 13396 raft_consensus.cc:2468] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666c0dbd00a542d1970b42ceb7ad00af in term 2.
I20260709 13:03:24.195397 13434 leader_election.cc:304] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, 666c0dbd00a542d1970b42ceb7ad00af; no voters: 
I20260709 13:03:24.196655 13722 raft_consensus.cc:2804] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:24.197250 13722 raft_consensus.cc:697] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Becoming Leader. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:24.198262 13722 consensus_queue.cc:237] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.206313 13292 catalog_manager.cc:5697] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af reported cstate change: term changed from 1 to 2, leader changed from bbe172d6760941f5ac8af718cdca09eb (127.0.107.193) to 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194). New cstate: current_term: 2 leader_uuid: "666c0dbd00a542d1970b42ceb7ad00af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.238384 13543 raft_consensus.cc:1275] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.240619 13626 consensus_queue.cc:1048] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:24.250816 13468 raft_consensus.cc:1275] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.252846 13626 consensus_queue.cc:1048] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:24.270741 13591 raft_consensus.cc:993] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: : Instructing follower bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:24.271320 13773 raft_consensus.cc:1081] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Signalling peer bbe172d6760941f5ac8af718cdca09eb to start an election
I20260709 13:03:24.273800 13396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
 from {username='slave'} at 127.0.0.1:35380
I20260709 13:03:24.274425 13396 raft_consensus.cc:493] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.274752 13396 raft_consensus.cc:3060] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.281423 13396 raft_consensus.cc:515] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.283270 13396 leader_election.cc:290] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Requested vote from peers 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897), 050f1d3908394d78b57dc938b15660dc (127.0.107.195:44887)
I20260709 13:03:24.284628 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:24.284713 13543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd91a9d89c054a0eb530c7fb8717d9b7" candidate_uuid: "bbe172d6760941f5ac8af718cdca09eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "050f1d3908394d78b57dc938b15660dc"
I20260709 13:03:24.285382 13468 raft_consensus.cc:3060] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.285548 13543 raft_consensus.cc:3055] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:24.286043 13543 raft_consensus.cc:740] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:24.286965 13543 consensus_queue.cc:260] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.288519 13543 raft_consensus.cc:3060] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.293246 13468 raft_consensus.cc:2468] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:24.294906 13362 leader_election.cc:304] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c0dbd00a542d1970b42ceb7ad00af, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:24.295794 13626 raft_consensus.cc:2804] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:24.296301 13626 raft_consensus.cc:697] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Leader. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:24.297206 13626 consensus_queue.cc:237] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:24.297498 13543 raft_consensus.cc:2468] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe172d6760941f5ac8af718cdca09eb in term 2.
I20260709 13:03:24.298732 13544 raft_consensus.cc:1275] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.300643 13626 consensus_queue.cc:1048] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.305153 13294 catalog_manager.cc:5697] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb reported cstate change: term changed from 1 to 2, leader changed from 050f1d3908394d78b57dc938b15660dc (127.0.107.195) to bbe172d6760941f5ac8af718cdca09eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bbe172d6760941f5ac8af718cdca09eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.313364 13468 raft_consensus.cc:1275] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.317890 13744 consensus_queue.cc:1048] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:24.486196 13396 raft_consensus.cc:1275] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.487897 13773 consensus_queue.cc:1048] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.497196 13468 raft_consensus.cc:1275] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.499200 13719 consensus_queue.cc:1048] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:24.672870 13543 raft_consensus.cc:1275] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.674424 13722 consensus_queue.cc:1048] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:24.683882 13396 raft_consensus.cc:1275] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Refusing update from remote peer 666c0dbd00a542d1970b42ceb7ad00af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.685595 13593 consensus_queue.cc:1048] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:24.766956 13468 raft_consensus.cc:1275] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.768610 13744 consensus_queue.cc:1048] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.782792 13543 raft_consensus.cc:1275] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Refusing update from remote peer bbe172d6760941f5ac8af718cdca09eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.788702 13745 consensus_queue.cc:1048] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:26.719911 13294 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35572:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:26.751255 13294 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35572:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:26.782657   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:26.983495 13816 tablet.cc:1724] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:26.993571 13422 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:c5b136a3415744ec86e2cde08cbd5cd2)
W20260709 13:03:27.002355 13422 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:c5b136a3415744ec86e2cde08cbd5cd2)
W20260709 13:03:27.011205 13422 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:c5b136a3415744ec86e2cde08cbd5cd2)
I20260709 13:03:27.093554 13826 tablet.cc:1724] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.095762 13819 tablet.cc:1724] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.063061 13394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432"
dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
mode: GRACEFUL
new_leader_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:34318
I20260709 13:03:27.126682 13394 raft_consensus.cc:606] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Received request to transfer leadership to TS 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:27.166008 13823 tablet.cc:1724] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:27.224220 13836 log.cc:927] Time spent T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: Append to log took a long time: real 0.072s	user 0.005s	sys 0.000s
W20260709 13:03:27.231016 13830 log.cc:927] Time spent T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 13:03:27.207567 13827 tablet.cc:1724] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:27.233896 13833 log.cc:927] Time spent T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:03:27.253446 13816 tablet.cc:1724] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.349788 13847 tablet.cc:1724] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:27.365351 13362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43897, user_credentials={real_user=slave}} blocked reactor thread for 76893.5us
I20260709 13:03:27.281534 13842 tablet.cc:1724] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.417428 13843 tablet.cc:1724] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:27.420451 13849 log.cc:927] Time spent T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:03:27.449431 13819 tablet.cc:1724] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.456667 13816 tablet.cc:1724] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.456524 13848 tablet.cc:1724] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.519388 13853 tablet.cc:1724] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.525934 13851 tablet.cc:1724] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.536535 13826 tablet.cc:1724] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:27.544238 13511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43897, user_credentials={real_user=slave}} blocked reactor thread for 116932us
I20260709 13:03:27.548678 13816 tablet.cc:1724] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.544322 13855 tablet.cc:1724] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.546578 13823 tablet.cc:1724] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.567600 13801 raft_consensus.cc:993] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: : Instructing follower 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:27.568692 13801 raft_consensus.cc:1081] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Signalling peer 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:27.569869 13471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f"
dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
mode: GRACEFUL
new_leader_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:37154
I20260709 13:03:27.577589 13471 raft_consensus.cc:606] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Received request to transfer leadership to TS 050f1d3908394d78b57dc938b15660dc
I20260709 13:03:27.578744 13540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:41900
I20260709 13:03:27.585790   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:27.605383   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:27.581365 13540 raft_consensus.cc:493] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:27.606742 13540 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.579492 13842 tablet.cc:1724] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.590193 13843 tablet.cc:1724] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.602255 13816 tablet.cc:1724] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.627741 13827 tablet.cc:1724] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.636157 13540 raft_consensus.cc:515] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:27.647387 13827 tablet.cc:1724] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.653095 13391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:27.654186 13391 raft_consensus.cc:3055] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.654594 13391 raft_consensus.cc:740] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bbe172d6760941f5ac8af718cdca09eb, State: Running, Role: LEADER
I20260709 13:03:27.656630 13848 tablet.cc:1724] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.658640 13391 consensus_queue.cc:260] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:27.660439 13391 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.638533 13851 tablet.cc:1724] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.678922 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a6bb5296244006b5aadf39cdf64432" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:27.679865 13471 raft_consensus.cc:3060] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.679397 13827 tablet.cc:1724] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.699257 13819 tablet.cc:1724] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:27.704666 13391 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 3.
I20260709 13:03:27.690042 13540 leader_election.cc:290] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 3 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:27.712775 13509 leader_election.cc:304] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:27.714341 13778 raft_consensus.cc:2804] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:27.714934 13778 raft_consensus.cc:697] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 3 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:27.716087 13778 consensus_queue.cc:237] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:27.713141 13471 raft_consensus.cc:2468] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 3.
I20260709 13:03:27.744344 13292 catalog_manager.cc:5697] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 2 to 3, leader changed from bbe172d6760941f5ac8af718cdca09eb (127.0.107.193) to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 3 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.746279 13291 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85: soft_deleted_table [id=6d8b92479d1d4152bd33961b258a1bca] alter complete (version 1)
I20260709 13:03:27.777112 13831 raft_consensus.cc:993] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: : Instructing follower 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:27.777763 13831 raft_consensus.cc:1081] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Signalling peer 050f1d3908394d78b57dc938b15660dc to start an election
I20260709 13:03:27.779744 13544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f"
dest_uuid: "050f1d3908394d78b57dc938b15660dc"
 from {username='slave'} at 127.0.0.1:41898
I20260709 13:03:27.780386 13544 raft_consensus.cc:493] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:27.780776 13544 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.789656 13544 raft_consensus.cc:515] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:27.792078 13544 leader_election.cc:290] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 3 election: Requested vote from peers bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035), 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897)
I20260709 13:03:27.792676 13391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbe172d6760941f5ac8af718cdca09eb"
I20260709 13:03:27.792723 13471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d919109a8d94113a752f51dc928a12f" candidate_uuid: "050f1d3908394d78b57dc938b15660dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "666c0dbd00a542d1970b42ceb7ad00af"
I20260709 13:03:27.793594 13391 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.793645 13471 raft_consensus.cc:3055] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.794176 13471 raft_consensus.cc:740] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 666c0dbd00a542d1970b42ceb7ad00af, State: Running, Role: LEADER
I20260709 13:03:27.795085 13471 consensus_queue.cc:260] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:27.796633 13471 raft_consensus.cc:3060] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.801841 13391 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 3.
I20260709 13:03:27.803339 13509 leader_election.cc:304] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050f1d3908394d78b57dc938b15660dc, bbe172d6760941f5ac8af718cdca09eb; no voters: 
I20260709 13:03:27.803740 13471 raft_consensus.cc:2468] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 050f1d3908394d78b57dc938b15660dc in term 3.
I20260709 13:03:27.804330 13778 raft_consensus.cc:2804] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:27.804996 13778 raft_consensus.cc:697] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 3 LEADER]: Becoming Leader. State: Replica: 050f1d3908394d78b57dc938b15660dc, State: Running, Role: LEADER
I20260709 13:03:27.805967 13778 consensus_queue.cc:237] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } }
I20260709 13:03:27.815837 13292 catalog_manager.cc:5697] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc reported cstate change: term changed from 2 to 3, leader changed from 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194) to 050f1d3908394d78b57dc938b15660dc (127.0.107.195). New cstate: current_term: 3 leader_uuid: "050f1d3908394d78b57dc938b15660dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050f1d3908394d78b57dc938b15660dc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.251982 13391 raft_consensus.cc:1275] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:28.253626 13778 consensus_queue.cc:1048] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:28.267192 13468 raft_consensus.cc:1275] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:28.269129 13778 consensus_queue.cc:1048] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:28.306963 13468 raft_consensus.cc:1275] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:28.309028 13778 consensus_queue.cc:1048] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c0dbd00a542d1970b42ceb7ad00af" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:28.318526 13391 raft_consensus.cc:1275] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Refusing update from remote peer 050f1d3908394d78b57dc938b15660dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:28.324086 13868 consensus_queue.cc:1048] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe172d6760941f5ac8af718cdca09eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:28.695168   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:28.743217   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:28.744537   431 tablet_replica.cc:333] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.746157   431 raft_consensus.cc:2243] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:28.746186 13435 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:03:28.747143   431 raft_consensus.cc:2272] T 0250819cca574f6592ce5cfd53cdca5e P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:28.750236 13435 consensus_peers.cc:597] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.750957   431 tablet_replica.cc:333] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.751927   431 raft_consensus.cc:2243] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.752493   431 raft_consensus.cc:2272] T d4ceb884da0c4c19b1df9628523c1fe7 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.756341   431 tablet_replica.cc:333] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.757243   431 raft_consensus.cc:2243] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.757879   431 raft_consensus.cc:2272] T 877c18a0a212421ea1554c0facce3661 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.760802   431 tablet_replica.cc:333] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.761615   431 raft_consensus.cc:2243] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.762655   431 raft_consensus.cc:2272] T e6acd772f81a4cc58b3811917f122cb8 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.765865   431 tablet_replica.cc:333] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.766716   431 raft_consensus.cc:2243] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.767907   431 raft_consensus.cc:2272] T 6fbd118b6ffd4688b76c4f5a28a5f253 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.771464   431 tablet_replica.cc:333] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.772476   431 raft_consensus.cc:2243] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.773428   431 raft_consensus.cc:2272] T c5b136a3415744ec86e2cde08cbd5cd2 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.776239   431 tablet_replica.cc:333] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.777143   431 raft_consensus.cc:2243] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.778631   431 raft_consensus.cc:2272] T 9b91824d3058435d968ef4c7ec305cc7 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.781818   431 tablet_replica.cc:333] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.782809   431 raft_consensus.cc:2243] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.783653   431 raft_consensus.cc:2272] T a44cbdb9bd824e41972b85467bd01298 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.786978   431 tablet_replica.cc:333] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.787708   431 raft_consensus.cc:2243] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.788255   431 raft_consensus.cc:2272] T a7c2a78fdf824431a10b0303a05f389c P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.791208   431 tablet_replica.cc:333] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.792096   431 raft_consensus.cc:2243] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.792734   431 raft_consensus.cc:2272] T d349b6ea90a34ab69ce72747888c75f5 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.795698   431 tablet_replica.cc:333] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.796478   431 raft_consensus.cc:2243] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.797114   431 raft_consensus.cc:2272] T 41a6bb5296244006b5aadf39cdf64432 P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.801708   431 tablet_replica.cc:333] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.802637   431 raft_consensus.cc:2243] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.803965   431 raft_consensus.cc:2272] T dd91a9d89c054a0eb530c7fb8717d9b7 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.809623   431 tablet_replica.cc:333] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.810416   431 raft_consensus.cc:2243] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.811043   431 raft_consensus.cc:2272] T 7d919109a8d94113a752f51dc928a12f P bbe172d6760941f5ac8af718cdca09eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.814627   431 tablet_replica.cc:333] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.815659   431 raft_consensus.cc:2243] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.816921   431 raft_consensus.cc:2272] T bee39914a2b84f1691c12b49ff960d18 P bbe172d6760941f5ac8af718cdca09eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.819705   431 tablet_replica.cc:333] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.820446   431 raft_consensus.cc:2243] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.821040   431 raft_consensus.cc:2272] T 950403f16bd84656909fdf571b80f7fb P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.823521   431 tablet_replica.cc:333] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.824275   431 raft_consensus.cc:2243] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.824847   431 raft_consensus.cc:2272] T a742058fef84469eba3f2e8095afcbe9 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.828346   431 tablet_replica.cc:333] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.828996   431 raft_consensus.cc:2243] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.829589   431 raft_consensus.cc:2272] T b59cce9af31549ba89138966e7921941 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:28.832747 13509 consensus_peers.cc:597] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.833266   431 tablet_replica.cc:333] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb: stopping tablet replica
I20260709 13:03:28.834216   431 raft_consensus.cc:2243] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:28.834920 13509 consensus_peers.cc:597] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.835821   431 raft_consensus.cc:2272] T 78872057c908442bab71c00bd7d8c4f4 P bbe172d6760941f5ac8af718cdca09eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.893569   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:28.908808 13435 consensus_peers.cc:597] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.921583 13509 consensus_peers.cc:597] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.926754 13435 consensus_peers.cc:597] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.948092   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:28.986950   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:28.988265   431 tablet_replica.cc:333] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:28.989595   431 raft_consensus.cc:2243] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.990592   431 raft_consensus.cc:2272] T 0250819cca574f6592ce5cfd53cdca5e P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.993680   431 tablet_replica.cc:333] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:28.994359   431 raft_consensus.cc:2243] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.995500   431 raft_consensus.cc:2272] T e6acd772f81a4cc58b3811917f122cb8 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.998302   431 tablet_replica.cc:333] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:28.998958   431 raft_consensus.cc:2243] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.000109   431 raft_consensus.cc:2272] T d4ceb884da0c4c19b1df9628523c1fe7 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.003839   431 tablet_replica.cc:333] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.004932   431 raft_consensus.cc:2243] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.005677   431 raft_consensus.cc:2272] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:29.006153 13435 consensus_peers.cc:597] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.008653   431 tablet_replica.cc:333] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.009549   431 raft_consensus.cc:2243] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.010116   431 raft_consensus.cc:2272] T c5b136a3415744ec86e2cde08cbd5cd2 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.012933   431 tablet_replica.cc:333] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.013681   431 raft_consensus.cc:2243] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.015101   431 raft_consensus.cc:2272] T a7c2a78fdf824431a10b0303a05f389c P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.018065   431 tablet_replica.cc:333] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.018733   431 raft_consensus.cc:2243] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.020731   431 raft_consensus.cc:2272] T 877c18a0a212421ea1554c0facce3661 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.023310   431 tablet_replica.cc:333] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.024232   431 raft_consensus.cc:2243] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.024761   431 raft_consensus.cc:2272] T 9b91824d3058435d968ef4c7ec305cc7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.027467   431 tablet_replica.cc:333] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.028234   431 raft_consensus.cc:2243] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.029518   431 raft_consensus.cc:2272] T a44cbdb9bd824e41972b85467bd01298 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.032536   431 tablet_replica.cc:333] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.033242   431 raft_consensus.cc:2243] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.033943   431 raft_consensus.cc:2272] T 950403f16bd84656909fdf571b80f7fb P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.036620   431 tablet_replica.cc:333] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.037575   431 raft_consensus.cc:2243] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.038190   431 raft_consensus.cc:2272] T a742058fef84469eba3f2e8095afcbe9 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.040932   431 tablet_replica.cc:333] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.041805   431 raft_consensus.cc:2243] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.042738   431 raft_consensus.cc:2272] T b59cce9af31549ba89138966e7921941 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.045415   431 tablet_replica.cc:333] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.046020   431 raft_consensus.cc:2243] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.046519   431 raft_consensus.cc:2272] T 78872057c908442bab71c00bd7d8c4f4 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.049181   431 tablet_replica.cc:333] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.049782   431 raft_consensus.cc:2243] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.050262   431 raft_consensus.cc:2272] T dd91a9d89c054a0eb530c7fb8717d9b7 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.053099   431 tablet_replica.cc:333] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.053960   431 raft_consensus.cc:2243] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.054656   431 raft_consensus.cc:2272] T 7d919109a8d94113a752f51dc928a12f P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:29.056809 13511 consensus_peers.cc:597] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc -> Peer 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897): Couldn't send request to peer 666c0dbd00a542d1970b42ceb7ad00af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.058255   431 tablet_replica.cc:333] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.058991   431 raft_consensus.cc:2243] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.059489   431 raft_consensus.cc:2272] T bee39914a2b84f1691c12b49ff960d18 P 666c0dbd00a542d1970b42ceb7ad00af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.062323   431 tablet_replica.cc:333] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.062956   431 raft_consensus.cc:2243] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.064002   431 raft_consensus.cc:2272] T d349b6ea90a34ab69ce72747888c75f5 P 666c0dbd00a542d1970b42ceb7ad00af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.066556   431 tablet_replica.cc:333] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af: stopping tablet replica
I20260709 13:03:29.067097   431 raft_consensus.cc:2243] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.067660   431 raft_consensus.cc:2272] T 41a6bb5296244006b5aadf39cdf64432 P 666c0dbd00a542d1970b42ceb7ad00af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.116624   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:29.163928   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:29.208622   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:29.209164 13509 consensus_peers.cc:597] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc -> Peer bbe172d6760941f5ac8af718cdca09eb (127.0.107.193:41035): Couldn't send request to peer bbe172d6760941f5ac8af718cdca09eb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.209741   431 tablet_replica.cc:333] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.210678   431 raft_consensus.cc:2243] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.211324   431 raft_consensus.cc:2272] T 0250819cca574f6592ce5cfd53cdca5e P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.214010   431 tablet_replica.cc:333] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.214789   431 raft_consensus.cc:2243] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.215363   431 raft_consensus.cc:2272] T c5b136a3415744ec86e2cde08cbd5cd2 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.217839   431 tablet_replica.cc:333] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.218555   431 raft_consensus.cc:2243] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.219143   431 raft_consensus.cc:2272] T d4ceb884da0c4c19b1df9628523c1fe7 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.221669   431 tablet_replica.cc:333] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.222373   431 raft_consensus.cc:2243] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.222903   431 raft_consensus.cc:2272] T 877c18a0a212421ea1554c0facce3661 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.225242   431 tablet_replica.cc:333] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.225929   431 raft_consensus.cc:2243] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.226459   431 raft_consensus.cc:2272] T e6acd772f81a4cc58b3811917f122cb8 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.229449   431 tablet_replica.cc:333] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.230160   431 raft_consensus.cc:2243] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.230743   431 raft_consensus.cc:2272] T 6fbd118b6ffd4688b76c4f5a28a5f253 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.233338   431 tablet_replica.cc:333] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.234036   431 raft_consensus.cc:2243] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.234611   431 raft_consensus.cc:2272] T a7c2a78fdf824431a10b0303a05f389c P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.237282   431 tablet_replica.cc:333] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.238011   431 raft_consensus.cc:2243] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.238592   431 raft_consensus.cc:2272] T 9b91824d3058435d968ef4c7ec305cc7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.241359   431 tablet_replica.cc:333] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.242151   431 raft_consensus.cc:2243] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.242767   431 raft_consensus.cc:2272] T a44cbdb9bd824e41972b85467bd01298 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.245301   431 tablet_replica.cc:333] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.245975   431 raft_consensus.cc:2243] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.246976   431 raft_consensus.cc:2272] T 950403f16bd84656909fdf571b80f7fb P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.249665   431 tablet_replica.cc:333] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.250360   431 raft_consensus.cc:2243] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.251389   431 raft_consensus.cc:2272] T a742058fef84469eba3f2e8095afcbe9 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.254285   431 tablet_replica.cc:333] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.254997   431 raft_consensus.cc:2243] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.255645   431 raft_consensus.cc:2272] T b59cce9af31549ba89138966e7921941 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.257908   431 tablet_replica.cc:333] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.258791   431 raft_consensus.cc:2243] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.259434   431 raft_consensus.cc:2272] T 78872057c908442bab71c00bd7d8c4f4 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.262027   431 tablet_replica.cc:333] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.262709   431 raft_consensus.cc:2243] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.263298   431 raft_consensus.cc:2272] T dd91a9d89c054a0eb530c7fb8717d9b7 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.267170   431 tablet_replica.cc:333] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.268432   431 raft_consensus.cc:2243] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.269073   431 raft_consensus.cc:2272] T bee39914a2b84f1691c12b49ff960d18 P 050f1d3908394d78b57dc938b15660dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:29.269408 13511 consensus_peers.cc:597] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc -> Peer 666c0dbd00a542d1970b42ceb7ad00af (127.0.107.194:43897): Couldn't send request to peer 666c0dbd00a542d1970b42ceb7ad00af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43897: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.271903   431 tablet_replica.cc:333] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.272697   431 raft_consensus.cc:2243] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.273654   431 raft_consensus.cc:2272] T 7d919109a8d94113a752f51dc928a12f P 050f1d3908394d78b57dc938b15660dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.276180   431 tablet_replica.cc:333] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.276777   431 raft_consensus.cc:2243] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:29.277282   431 raft_consensus.cc:2272] T d349b6ea90a34ab69ce72747888c75f5 P 050f1d3908394d78b57dc938b15660dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.279731   431 tablet_replica.cc:333] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc: stopping tablet replica
I20260709 13:03:29.280297   431 raft_consensus.cc:2243] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.281266   431 raft_consensus.cc:2272] T 41a6bb5296244006b5aadf39cdf64432 P 050f1d3908394d78b57dc938b15660dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.331437   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:29.375118   431 master.cc:562] Master@127.0.107.254:43809 shutting down...
I20260709 13:03:29.405771   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:29.406541   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:29.406986   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 74c7db2702fd43fbbd5722a8dd20bb85: stopping tablet replica
I20260709 13:03:29.431994   431 master.cc:584] Master@127.0.107.254:43809 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12344 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25930 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (390563 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:03:29.502204   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 159 messages since previous log ~2 seconds ago
I20260709 13:03:29.502498   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 159 messages since previous log ~2 seconds ago
I20260709 13:03:29.502715   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 157 messages since previous log ~2 seconds ago
I20260709 13:03:29.502931   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:03:29.503136   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:03:29.503337   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 2 messages since previous log ~87 seconds ago
I20260709 13:03:29.503928   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~167 seconds ago
I20260709 13:03:29.504225   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~167 seconds ago
I20260709 13:03:29.504901   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:03:29.505334   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
